[DEBUG] [04/25/2024 09:25:06.783] [main] [EventStream(akka://test)] logger log1-TestEventListener started
09:25:06,783 AM [test-akka.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started
[DEBUG] [04/25/2024 09:25:06.783] [main] [EventStream(akka://test)] logger log2-Slf4jLogger started
[DEBUG] [04/25/2024 09:25:06.783] [main] [EventStream(akka://test)] Default Loggers started
09:25:06,818 AM [test-akka.actor.default-dispatcher-6] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [akka://test@10.30.170.129:25520] with UID [-3218567006968344387]
09:25:06,818 AM [test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://test@10.30.170.129:25520] - Starting up, Akka version [2.6.21] ...
09:25:06,818 AM [test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://test@10.30.170.129:25520] - Registered cluster JMX MBean [akka:type=Cluster]
09:25:06,818 AM [test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://test@10.30.170.129:25520] - Started up successfully
09:25:06,818 AM [test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://test@10.30.170.129:25520] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing
[INFO] [04/25/2024 09:25:06.810] [main] [ArteryTransport(akka://test)] Remoting started with transport [Artery tcp]; listening on address [akka://test@10.30.170.129:25520] with UID [-3218567006968344387]
[INFO] [04/25/2024 09:25:06.811] [main] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.129:25520] - Starting up, Akka version [2.6.21] ...
[INFO] [04/25/2024 09:25:06.814] [main] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.129:25520] - Registered cluster JMX MBean [akka:type=Cluster]
[INFO] [04/25/2024 09:25:06.814] [main] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.129:25520] - Started up successfully
[INFO] [04/25/2024 09:25:06.815] [test-akka.actor.internal-dispatcher-2] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.129:25520] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing
[INFO] [04/25/2024 09:25:06.815] [test-akka.actor.internal-dispatcher-2] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.129:25520] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining
09:25:06,826 AM [test-akka.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [akka://test@10.30.170.129:25520] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining
09:25:06,828 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testAddServerWithOperationInProgress starting
[WARN] [04/25/2024 09:25:06.831] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/new-server152]: org.opendaylight.controller.cluster.common.actor.Monitor@889afb6
[INFO] [akkaDeadLetter][04/25/2024 09:25:06.831] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/new-server152] to Actor[akka://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
09:25:06,831 AM [test-akka.actor.default-dispatcher-12] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/new-server152] to Actor[akka://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
09:25:06,833 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - Starting recovery for new-server with journal batch size 1000
[WARN] [04/25/2024 09:25:06.835] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader153]: org.opendaylight.controller.cluster.common.actor.Monitor@3363f3c9
[INFO] [akkaDeadLetter][04/25/2024 09:25:06.835] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/leader153] to Actor[akka://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
09:25:06,835 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Moving last applied index from -1 to -1
09:25:06,835 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Set currentTerm=1, votedFor=
09:25:06,835 AM [test-akka.actor.default-dispatcher-14] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - Starting recovery for leader with journal batch size 1000
09:25:06,844 AM [test-akka.actor.default-dispatcher-13] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/leader153] to Actor[akka://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
09:25:06,845 AM [test-akka.actor.default-dispatcher-14] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:06,845 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:06,845 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Election: Leader has following peers: []
09:25:06,846 AM [test-akka.actor.default-dispatcher-14] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy
09:25:06,949 AM [main] [DEBUG] RaftActorServerConfigurationSupportTest - new-server2: Set currentTerm=1, votedFor=leader
09:25:06,964 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupport - leader: onAddServer: AddServer [newServerId=new-server, newServerAddress=akka://test/user/new-server152, votingMember=true], state: Idle
09:25:06,970 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupport - leader: Initiating AddServer [newServerId=new-server, newServerAddress=akka://test/user/new-server152, votingMember=true]
09:25:06,970 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead.
09:25:06,970 AM [test-akka.actor.default-dispatcher-17] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] to install on new-server
09:25:06,970 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: lastSequenceNumber prior to capture: -1
09:25:06,970 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupport - leader: Initiating capture snapshot for new server new-server
09:25:06,972 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: CaptureSnapshotReply received by actor
09:25:06,972 AM [test-akka.actor.default-dispatcher-17] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=, ServerConfigPayload=null]
09:25:06,973 AM [test-akka.actor.default-dispatcher-17] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1
09:25:06,973 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): sendInstallSnapshot
09:25:06,973 AM [test-akka.actor.default-dispatcher-17] [DEBUG] LeaderInstallSnapshotState - leader (Leader): Snapshot 171 bytes, total chunks to send: 1
09:25:06,973 AM [test-akka.actor.default-dispatcher-17] [DEBUG] LeaderInstallSnapshotState - leader (Leader): Next chunk: total length=171, offset=0, size=171, hashCode=-2041399403
09:25:06,977 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): next snapshot chunk size for follower new-server: 171
09:25:06,977 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): InstallSnapshot sent to follower Vector(user, new-server152), Chunk: 1/1
09:25:06,977 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Snapshot success -  sequence number: -1
09:25:06,977 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: SnapshotComplete received
09:25:07,21 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupport - leader: onAddServer: AddServer [newServerId=new-server2, newServerAddress=akka://test/user/follower150, votingMember=false], state: InstallingSnapshot
09:25:07,21 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Term 1 in "InstallSnapshot [term=1, leaderId=leader, lastIncludedIndex=-1, lastIncludedTerm=-1, datasize=171, Chunk=1/1, lastChunkHashCode=OptionalInt[-1], serverConfig=null]" message is greater than follower's term 0 - updating term
09:25:07,21 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Set currentTerm=1, votedFor=null
09:25:07,21 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupport - leader: Server operation already in progress - queueing AddServer [newServerId=new-server2, newServerAddress=akka://test/user/follower150, votingMember=false]
09:25:07,22 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): handleInstallSnapshot: InstallSnapshot [term=1, leaderId=leader, lastIncludedIndex=-1, lastIncludedTerm=-1, datasize=171, Chunk=1/1, lastChunkHashCode=OptionalInt[-1], serverConfig=null]
09:25:07,22 AM [test-akka.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - new-server: Last sync leader does not match current leader leader, need to catch up to -1
09:25:07,22 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - addChunk: chunkIndex=1, lastChunkIndex=0, collectedChunks.size=0, lastChunkHashCode=-1
09:25:07,22 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Snapshot installed from leader: leader
09:25:07,23 AM [test-akka.actor.default-dispatcher-17] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Applying snapshot on follower:  Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=null, ServerConfigPayload=null]
09:25:07,23 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - lastSequenceNumber prior to persisting applied snapshot: -1
09:25:07,23 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Snapshot success -  sequence number: -1
09:25:07,23 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Moving last applied index from -1 to -1
09:25:07,23 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Set currentTerm=1, votedFor=null
09:25:07,23 AM [test-akka.actor.default-dispatcher-17] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: applySnapshot called
[WARN] [04/25/2024 09:25:07.023] [test-akka.actor.default-dispatcher-13] [akka://test/user/new-server152] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@7375de79
[INFO] [akkaDeadLetter][04/25/2024 09:25:07.024] [test-akka.actor.default-dispatcher-13] [akka://test/user/new-server152] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/new-server152] was unhandled. [3] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
09:25:07,24 AM [test-akka.actor.default-dispatcher-16] [INFO] TestActorRef - Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/new-server152] was unhandled. [3] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
09:25:07,24 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): handleInstallSnapshot returning: InstallSnapshotReply [term=1, followerId=new-server, chunkIndex=1, success=true]
09:25:07,24 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: SnapshotComplete received
09:25:07,24 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): handleInstallSnapshotReply: InstallSnapshotReply [term=1, followerId=new-server, chunkIndex=1, success=true]
09:25:07,24 AM [test-akka.actor.default-dispatcher-16] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Snapshot successfully installed on follower new-server (last chunk 1) - matchIndex set to -1, nextIndex set to 0
09:25:07,24 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - Sent message UnInitializedFollowerSnapshotReply to self
09:25:07,25 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupport - leader: onUnInitializedFollowerSnapshotReply: UnInitializedFollowerSnapshotReply [followerId=new-server]
09:25:07,25 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupport - leader: New server configuration : [ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]
09:25:07,25 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]
09:25:07,25 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]] 
09:25:07,26 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=354a469e-d14d-48fe-b5fd-fc2211aedfcd}, logIndex: 0, payload: class org.opendaylight.controller.cluster.raft.persisted.ServerConfigurationPayload, isSendImmediate: true
09:25:07,26 AM [test-akka.actor.default-dispatcher-16] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:25:07,26 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower new-server: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:25:07,26 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): sendAppendEntries: 0 is present for follower new-server
09:25:07,26 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Sending AppendEntries to follower new-server: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]]]
09:25:07,26 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): handleAppendEntries: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]]]
09:25:07,26 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Number of entries to be appended = 1
09:25:07,26 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
09:25:07,27 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Append entry to log ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]
09:25:07,27 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]] 
09:25:07,27 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Updated server config: isVoting: true, peers: [PeerInfo [id=leader, address=null, votingState=VOTING]]
09:25:07,27 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Log size is now 1
09:25:07,27 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): handleAppendEntries returning : AppendEntriesReply [term=1, success=true, followerId=new-server, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=true, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
09:25:07,28 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupport - leader: Returning OK for operation AddServer [newServerId=new-server, newServerAddress=akka://test/user/new-server152, votingMember=true]
09:25:07,33 AM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - new-server: Lagging 0 entries behind leader leader and reached -1 (of expected -1)
09:25:07,34 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for new-server updated: matchIndex: 0, nextIndex: 1
09:25:07,34 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower new-server: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:25:07,35 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]
[WARN] [04/25/2024 09:25:07.035] [test-akka.actor.default-dispatcher-13] [akka://test/user/new-server152] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@5f249665
09:25:07,35 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]
09:25:07,35 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1
09:25:07,35 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Setting last applied to 0
[INFO] [akkaDeadLetter][04/25/2024 09:25:07.035] [test-akka.actor.default-dispatcher-13] [akka://test/user/new-server152] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/new-server152] was unhandled. [4] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
09:25:07,35 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Moving last applied index from -1 to 0
09:25:07,35 AM [test-akka.actor.default-dispatcher-13] [INFO] TestActorRef - Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/new-server152] was unhandled. [4] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
09:25:07,35 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Applying state for log index 0 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]
09:25:07,35 AM [test-akka.actor.default-dispatcher-17] [INFO] RaftActorServerConfigurationSupport - leader: ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]] has been successfully replicated to a majority of followers
09:25:07,35 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupport - leader: Initiating AddServer [newServerId=new-server2, newServerAddress=akka://test/user/follower150, votingMember=false]
09:25:07,35 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupport - leader: New follower is non-voting - directly persisting new server configuration
09:25:07,35 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupport - leader: New server configuration : [ServerInfo [id=new-server, isVoting=true], ServerInfo [id=new-server2, isVoting=false], ServerInfo [id=leader, isVoting=true]]
09:25:07,36 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=new-server2, isVoting=false], ServerInfo [id=leader, isVoting=true]]]]
09:25:07,36 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=new-server2, isVoting=false], ServerInfo [id=leader, isVoting=true]]]] 
09:25:07,36 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=6d1b92f4-3c80-4eb5-a51a-2c3110957a19}, logIndex: 1, payload: class org.opendaylight.controller.cluster.raft.persisted.ServerConfigurationPayload, isSendImmediate: true
09:25:07,36 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower new-server: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1
09:25:07,36 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): sendAppendEntries: 1 is present for follower new-server
09:25:07,36 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Sending AppendEntries to follower new-server: AppendEntries [leaderId=leader, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=1, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=new-server2, isVoting=false], ServerInfo [id=leader, isVoting=true]]]]]]
09:25:07,36 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower new-server2: active: false, followerNextIndex: 0, leaderLastIndex: 1, leaderSnapShotIndex: -1
09:25:07,36 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): handleAppendEntries: AppendEntries [leaderId=leader, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=1, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=new-server2, isVoting=false], ServerInfo [id=leader, isVoting=true]]]]]]
09:25:07,36 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupport - leader: Returning OK for operation AddServer [newServerId=new-server2, newServerAddress=akka://test/user/follower150, votingMember=false]
09:25:07,36 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Number of entries to be appended = 1
09:25:07,36 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): After cleanup, lastIndex: 0, entries to be added from: 0
09:25:07,36 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Append entry to log ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=new-server2, isVoting=false], ServerInfo [id=leader, isVoting=true]]]
09:25:07,36 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=new-server2, isVoting=false], ServerInfo [id=leader, isVoting=true]]]] 
09:25:07,36 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Updated server config: isVoting: true, peers: [PeerInfo [id=leader, address=null, votingState=VOTING], PeerInfo [id=new-server2, address=null, votingState=NON_VOTING]]
09:25:07,36 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Log size is now 2
09:25:07,36 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Commit index set to 0
09:25:07,36 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): handleAppendEntries returning : AppendEntriesReply [term=1, success=true, followerId=new-server, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=true, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
09:25:07,36 AM [test-akka.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - new-server: Lagging 0 entries behind leader leader and reached 0 (of expected -1)
09:25:07,36 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persisting ApplyJournalEntries with index=0
09:25:07,36 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 1
09:25:07,36 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Setting last applied to 0
09:25:07,36 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Moving last applied index from -1 to 0
09:25:07,37 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Applying state for log index 0 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]
09:25:07,37 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for new-server updated: matchIndex: 1, nextIndex: 2
09:25:07,37 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower new-server: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1
09:25:07,39 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=new-server2, isVoting=false], ServerInfo [id=leader, isVoting=true]]]]
09:25:07,39 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0
09:25:07,39 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Setting last applied to 1
09:25:07,39 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Moving last applied index from 0 to 1
09:25:07,39 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Applying state for log index 1 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=new-server2, isVoting=false], ServerInfo [id=leader, isVoting=true]]]
09:25:07,39 AM [test-akka.actor.default-dispatcher-11] [INFO] RaftActorServerConfigurationSupport - leader: ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=new-server2, isVoting=false], ServerInfo [id=leader, isVoting=true]]] has been successfully replicated to a majority of followers
09:25:07,39 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persisting ApplyJournalEntries with index=1
09:25:07,40 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=new-server2, isVoting=false], ServerInfo [id=leader, isVoting=true]]]]
09:25:07,40 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Persisting ApplyJournalEntries with index=0
[ERROR] [04/25/2024 09:25:07.043] [test-akka.actor.internal-dispatcher-4] [akka://test/user/follower150] Cannot invoke "org.opendaylight.controller.cluster.raft.ReplicatedLog.lastIndex()" because the return value of "org.opendaylight.controller.cluster.raft.RaftActorContext.getReplicatedLog()" is null
java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.raft.ReplicatedLog.lastIndex()" because the return value of "org.opendaylight.controller.cluster.raft.RaftActorContext.getReplicatedLog()" is null
	at org.opendaylight.controller.cluster.raft.behaviors.AbstractRaftActorBehavior.lastIndex(AbstractRaftActorBehavior.java:315)
	at org.opendaylight.controller.cluster.raft.behaviors.Follower.isOutOfSync(Follower.java:342)
	at org.opendaylight.controller.cluster.raft.behaviors.Follower.handleAppendEntries(Follower.java:177)
	at org.opendaylight.controller.cluster.raft.behaviors.AbstractRaftActorBehavior.appendEntries(AbstractRaftActorBehavior.java:142)
	at org.opendaylight.controller.cluster.raft.behaviors.AbstractRaftActorBehavior.handleMessage(AbstractRaftActorBehavior.java:415)
	at org.opendaylight.controller.cluster.raft.behaviors.Follower.handleMessage(Follower.java:485)
	at org.opendaylight.controller.cluster.raft.utils.ForwardMessageToBehaviorActor.onReceive(ForwardMessageToBehaviorActor.java:25)
	at akka.actor.UntypedAbstractActor$$anonfun$receive$1.applyOrElse(AbstractActor.scala:332)
	at akka.actor.Actor.aroundReceive(Actor.scala:537)
	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579)
	at akka.actor.ActorCell.invoke(ActorCell.scala:547)
	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
	at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373)
	at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182)
	at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655)
	at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622)
	at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165)

09:25:07,46 AM [test-akka.actor.default-dispatcher-17] [ERROR] OneForOneStrategy - Cannot invoke "org.opendaylight.controller.cluster.raft.ReplicatedLog.lastIndex()" because the return value of "org.opendaylight.controller.cluster.raft.RaftActorContext.getReplicatedLog()" is null
java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.raft.ReplicatedLog.lastIndex()" because the return value of "org.opendaylight.controller.cluster.raft.RaftActorContext.getReplicatedLog()" is null
	at org.opendaylight.controller.cluster.raft.behaviors.AbstractRaftActorBehavior.lastIndex(AbstractRaftActorBehavior.java:315)
	at org.opendaylight.controller.cluster.raft.behaviors.Follower.isOutOfSync(Follower.java:342)
	at org.opendaylight.controller.cluster.raft.behaviors.Follower.handleAppendEntries(Follower.java:177)
	at org.opendaylight.controller.cluster.raft.behaviors.AbstractRaftActorBehavior.appendEntries(AbstractRaftActorBehavior.java:142)
	at org.opendaylight.controller.cluster.raft.behaviors.AbstractRaftActorBehavior.handleMessage(AbstractRaftActorBehavior.java:415)
	at org.opendaylight.controller.cluster.raft.behaviors.Follower.handleMessage(Follower.java:485)
	at org.opendaylight.controller.cluster.raft.utils.ForwardMessageToBehaviorActor.onReceive(ForwardMessageToBehaviorActor.java:25)
	at akka.actor.UntypedAbstractActor$$anonfun$receive$1.applyOrElse(AbstractActor.scala:332)
	at akka.actor.Actor.aroundReceive(Actor.scala:537)
	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579)
	at akka.actor.ActorCell.invoke(ActorCell.scala:547)
	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
	at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373)
	at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182)
	at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655)
	at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622)
	at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165)
09:25:07,203 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Commit index set to 1
09:25:07,203 AM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - new-server: Lagging 0 entries behind leader leader and reached 1 (of expected -1)
09:25:07,203 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 1
09:25:07,203 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Setting last applied to 1
09:25:07,203 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Moving last applied index from 0 to 1
09:25:07,203 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Applying state for log index 1 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=new-server2, isVoting=false], ServerInfo [id=leader, isVoting=true]]]
09:25:07,203 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Persisting ApplyJournalEntries with index=1
09:25:07,238 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testAddServerWithOperationInProgress ending
09:25:07,238 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower150]
09:25:07,250 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/new-serverCollector151#-858381380]
09:25:07,250 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/new-server152]
09:25:07,251 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader153]
09:25:07,251 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leaderCollector154]
09:25:07,354 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testRemoveServerNonExistentServer starting
[WARN] [04/25/2024 09:25:07.355] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader156]: org.opendaylight.controller.cluster.common.actor.Monitor@d8df582
09:25:07,355 AM [test-akka.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/leader156] to Actor[akka://test/user/termination-monitor] was not delivered. [5] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[INFO] [akkaDeadLetter][04/25/2024 09:25:07.355] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/leader156] to Actor[akka://test/user/termination-monitor] was not delivered. [5] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
09:25:07,356 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Moving last applied index from -1 to -1
09:25:07,356 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Set currentTerm=1, votedFor=
09:25:07,356 AM [test-akka.actor.default-dispatcher-17] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - Starting recovery for leader with journal batch size 1000
09:25:07,359 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:07,359 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Election: Leader has following peers: [follower]
09:25:07,360 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:25:07,368 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupport - leader: onRemoveServer: RemoveServer{serverId='new-server'}, state: Idle
09:25:07,369 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testRemoveServerNonExistentServer ending
09:25:07,369 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower155]
09:25:07,380 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader156]
09:25:07,482 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testRemoveServerWithNoLeader starting
[WARN] [04/25/2024 09:25:07.484] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader158]: org.opendaylight.controller.cluster.common.actor.Monitor@2a18a0ca
[INFO] [akkaDeadLetter][04/25/2024 09:25:07.484] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/leader158] to Actor[akka://test/user/termination-monitor] was not delivered. [6] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
09:25:07,484 AM [test-akka.actor.default-dispatcher-13] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/leader158] to Actor[akka://test/user/termination-monitor] was not delivered. [6] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
09:25:07,485 AM [test-akka.actor.default-dispatcher-17] [INFO] MockRaftActor - Starting recovery for leader with journal batch size 1000
09:25:07,486 AM [test-akka.actor.default-dispatcher-6] [INFO] MockRaftActor - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:07,594 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupport - leader: onRemoveServer: RemoveServer{serverId='follower'}, state: Idle
09:25:07,595 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupport - leader: No leader - returning NO_LEADER reply
09:25:07,595 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testRemoveServerWithNoLeader ending
09:25:07,595 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower157]
09:25:07,606 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader158]
09:25:07,709 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testRemoveServerLeader starting
[WARN] [04/25/2024 09:25:07.710] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader161]: org.opendaylight.controller.cluster.common.actor.Monitor@11f935b2
[INFO] [akkaDeadLetter][04/25/2024 09:25:07.711] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/leader161] to Actor[akka://test/user/termination-monitor] was not delivered. [7] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
09:25:07,711 AM [test-akka.actor.default-dispatcher-16] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/leader161] to Actor[akka://test/user/termination-monitor] was not delivered. [7] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
09:25:07,711 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Moving last applied index from -1 to -1
09:25:07,711 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Set currentTerm=1, votedFor=
09:25:07,712 AM [test-akka.actor.default-dispatcher-17] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - Starting recovery for leader with journal batch size 1000
09:25:07,713 AM [test-akka.actor.default-dispatcher-17] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:07,714 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Election: Leader has following peers: [follower]
09:25:07,714 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [04/25/2024 09:25:07.714] [test-akka.actor.default-dispatcher-13] [akka://test/user/follower160] received dead letter from TestActor[akka://test/user/leader161]: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[]]
[INFO] [akkaDeadLetter][04/25/2024 09:25:07.714] [test-akka.actor.default-dispatcher-13] [akka://test/user/follower160] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[akka://test/user/leader161] to Actor[akka://test/user/follower160] was not delivered. [8] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/follower160] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
09:25:07,714 AM [test-akka.actor.default-dispatcher-17] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[akka://test/user/leader161] to Actor[akka://test/user/follower160] was not delivered. [8] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/follower160] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[WARN] [04/25/2024 09:25:07.815] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower160]: org.opendaylight.controller.cluster.common.actor.Monitor@395f7692
09:25:07,815 AM [test-akka.actor.default-dispatcher-17] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/follower160] to Actor[akka://test/user/termination-monitor] was not delivered. [9] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[INFO] [akkaDeadLetter][04/25/2024 09:25:07.815] [test-akka.actor.default-dispatcher-17] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/follower160] to Actor[akka://test/user/termination-monitor] was not delivered. [9] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
09:25:07,817 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - Starting recovery for follower with journal batch size 1000
09:25:07,818 AM [test-akka.actor.default-dispatcher-16] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:07,833 AM [test-akka.actor.default-dispatcher-16] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): Term 1 in "AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 0 - updating term
09:25:07,834 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: Set currentTerm=1, votedFor=null
09:25:07,834 AM [test-akka.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower: Last sync leader does not match current leader leader, need to catch up to -1
09:25:07,834 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for follower updated: matchIndex: -1, nextIndex: 0
09:25:07,834 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [04/25/2024 09:25:07.835] [test-akka.actor.default-dispatcher-17] [akka://test/user/follower160] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@695d058f
[INFO] [akkaDeadLetter][04/25/2024 09:25:07.835] [test-akka.actor.default-dispatcher-17] [akka://test/user/follower160] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower160] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
09:25:07,836 AM [test-akka.actor.default-dispatcher-16] [INFO] TestActorRef - Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower160] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
09:25:07,924 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupport - leader: onRemoveServer: RemoveServer{serverId='leader'}, state: Idle
09:25:07,927 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupport - leader: New server configuration : [ServerInfo [id=follower, isVoting=true]]
09:25:07,927 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower, isVoting=true]]]]
09:25:07,927 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower, isVoting=true]]]] 
09:25:07,928 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=e23f4f17-948f-4db7-a08c-397b0692df2f}, logIndex: 0, payload: class org.opendaylight.controller.cluster.raft.persisted.ServerConfigurationPayload, isSendImmediate: true
09:25:07,928 AM [test-akka.actor.default-dispatcher-16] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:25:07,928 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:25:07,928 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): sendAppendEntries: 0 is present for follower follower
09:25:07,928 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Sending AppendEntries to follower follower: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower, isVoting=true]]]]]]
09:25:07,928 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupport - leader: Returning OK for operation RemoveServer{serverId='leader'}
09:25:07,928 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): handleAppendEntries: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower, isVoting=true]]]]]]
09:25:07,928 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): Number of entries to be appended = 1
09:25:07,928 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
09:25:07,928 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): Append entry to log ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower, isVoting=true]]]
09:25:07,928 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower, isVoting=true]]]] 
09:25:07,928 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: Updated server config: isVoting: true, peers: []
09:25:07,928 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): Log size is now 1
09:25:07,928 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): handleAppendEntries returning : AppendEntriesReply [term=1, success=true, followerId=follower, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=true, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
09:25:07,929 AM [test-akka.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower: Lagging 0 entries behind leader leader and reached -1 (of expected -1)
09:25:07,929 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for follower updated: matchIndex: 0, nextIndex: 1
09:25:07,929 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:25:07,929 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower, isVoting=true]]]]
09:25:07,929 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1
09:25:07,929 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Setting last applied to 0
09:25:07,929 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Moving last applied index from -1 to 0
09:25:07,929 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Applying state for log index 0 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower, isVoting=true]]]
09:25:07,929 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower, isVoting=true]]]]
09:25:07,929 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupport - leader: ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower, isVoting=true]]] has been successfully replicated to a majority of followers
[WARN] [04/25/2024 09:25:07.929] [test-akka.actor.default-dispatcher-17] [akka://test/user/follower160] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@1ab6fcb6
09:25:07,930 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persisting ApplyJournalEntries with index=0
[WARN] [04/25/2024 09:25:07.931] [test-akka.actor.default-dispatcher-6] [akka://test/user/leader161] unhandled message from TestActor[akka://test/user/leader161]: ServerRemoved [serverId=leader]
09:25:08,73 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): Commit index set to 0
09:25:08,73 AM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower: Lagging 0 entries behind leader leader and reached 0 (of expected -1)
09:25:08,73 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
09:25:08,73 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): Setting last applied to 0
09:25:08,73 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: Moving last applied index from -1 to 0
09:25:08,74 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: Applying state for log index 0 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower, isVoting=true]]]
09:25:08,74 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: Persisting ApplyJournalEntries with index=0
09:25:08,80 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testRemoveServerLeader ending
09:25:08,80 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower159]
09:25:08,91 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader161]
09:25:08,92 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leaderCollector162]
09:25:08,92 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/collector163#638129188]
09:25:08,93 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower160]
09:25:08,95 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testAddServerWithLeaderChangeDuringInstallSnapshot starting
[WARN] [04/25/2024 09:25:08.097] [test-akka.actor.default-dispatcher-17] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/new-server166]: org.opendaylight.controller.cluster.common.actor.Monitor@78b134ef
09:25:08,98 AM [test-akka.actor.default-dispatcher-6] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - Starting recovery for new-server with journal batch size 1000
[WARN] [04/25/2024 09:25:08.099] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader167]: org.opendaylight.controller.cluster.common.actor.Monitor@751dc9aa
09:25:08,99 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:08,100 AM [test-akka.actor.default-dispatcher-5] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy
09:25:08,100 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Moving last applied index from -1 to -1
09:25:08,100 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Set currentTerm=1, votedFor=
09:25:08,100 AM [test-akka.actor.default-dispatcher-6] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - Starting recovery for leader with journal batch size 1000
09:25:08,101 AM [test-akka.actor.default-dispatcher-16] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:08,101 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Election: Leader has following peers: []
09:25:08,111 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupport - leader: onAddServer: AddServer [newServerId=new-server, newServerAddress=akka://test/user/new-server166, votingMember=true], state: Idle
09:25:08,111 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupport - leader: Initiating AddServer [newServerId=new-server, newServerAddress=akka://test/user/new-server166, votingMember=true]
09:25:08,111 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead.
09:25:08,111 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] to install on new-server
09:25:08,111 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: lastSequenceNumber prior to capture: -1
09:25:08,111 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupport - leader: Initiating capture snapshot for new server new-server
09:25:08,111 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: CaptureSnapshotReply received by actor
09:25:08,111 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=, ServerConfigPayload=null]
09:25:08,111 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1
09:25:08,111 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): sendInstallSnapshot
09:25:08,111 AM [test-akka.actor.default-dispatcher-5] [DEBUG] LeaderInstallSnapshotState - leader (Leader): Snapshot 171 bytes, total chunks to send: 1
09:25:08,112 AM [test-akka.actor.default-dispatcher-5] [DEBUG] LeaderInstallSnapshotState - leader (Leader): Next chunk: total length=171, offset=0, size=171, hashCode=-2041399403
09:25:08,112 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): next snapshot chunk size for follower new-server: 171
09:25:08,112 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): InstallSnapshot sent to follower Vector(user, new-server166), Chunk: 1/1
09:25:08,112 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Snapshot success -  sequence number: -1
09:25:08,112 AM [test-akka.actor.default-dispatcher-6] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Term 1 in "InstallSnapshot [term=1, leaderId=leader, lastIncludedIndex=-1, lastIncludedTerm=-1, datasize=171, Chunk=1/1, lastChunkHashCode=OptionalInt[-1], serverConfig=null]" message is greater than follower's term 0 - updating term
09:25:08,112 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: SnapshotComplete received
09:25:08,112 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Set currentTerm=1, votedFor=null
09:25:08,112 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): handleInstallSnapshot: InstallSnapshot [term=1, leaderId=leader, lastIncludedIndex=-1, lastIncludedTerm=-1, datasize=171, Chunk=1/1, lastChunkHashCode=OptionalInt[-1], serverConfig=null]
09:25:08,112 AM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - new-server: Last sync leader does not match current leader leader, need to catch up to -1
09:25:08,112 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - addChunk: chunkIndex=1, lastChunkIndex=0, collectedChunks.size=0, lastChunkHashCode=-1
09:25:08,112 AM [test-akka.actor.default-dispatcher-6] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Snapshot installed from leader: leader
09:25:08,113 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Applying snapshot on follower:  Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=null, ServerConfigPayload=null]
09:25:08,113 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - lastSequenceNumber prior to persisting applied snapshot: -1
09:25:08,113 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Snapshot success -  sequence number: -1
09:25:08,113 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Moving last applied index from -1 to -1
09:25:08,113 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Set currentTerm=1, votedFor=null
09:25:08,113 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: applySnapshot called
[WARN] [04/25/2024 09:25:08.113] [test-akka.actor.default-dispatcher-6] [akka://test/user/new-server166] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@73963ed9
09:25:08,114 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): handleInstallSnapshot returning: InstallSnapshotReply [term=1, followerId=new-server, chunkIndex=1, success=true]
09:25:08,114 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): handleInstallSnapshotReply: InstallSnapshotReply [term=1, followerId=new-server, chunkIndex=1, success=true]
09:25:08,114 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: SnapshotComplete received
09:25:08,114 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Snapshot successfully installed on follower new-server (last chunk 1) - matchIndex set to -1, nextIndex set to 0
09:25:08,114 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - Sent message UnInitializedFollowerSnapshotReply to self
09:25:08,162 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupport - leader: onUnInitializedFollowerSnapshotReply: UnInitializedFollowerSnapshotReply [followerId=new-server]
09:25:08,162 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupport - leader: Dropping UnInitializedFollowerSnapshotReply for server new-server: not leader
09:25:09,722 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupport - leader: handleInstallSnapshotTimeout for new server new-server
09:25:09,722 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupport - leader: Returning NO_LEADER for operation AddServer [newServerId=new-server, newServerAddress=akka://test/user/new-server166, votingMember=true]
09:25:09,723 AM [test-akka.actor.default-dispatcher-5] [WARN] RaftActorServerConfigurationSupport - leader: Timeout occured for new server new-server while installing snapshot
09:25:09,723 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testAddServerWithLeaderChangeDuringInstallSnapshot ending
09:25:09,723 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower164]
09:25:09,734 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/new-serverCollector165#-281556374]
09:25:09,735 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/new-server166]
09:25:09,735 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader167]
09:25:09,736 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leaderCollector168]
09:25:09,738 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testChangeToVotingWithNoLeaderAndOtherLeaderElected starting
[WARN] [04/25/2024 09:25:09.741] [test-akka.actor.default-dispatcher-17] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/node1]: org.opendaylight.controller.cluster.common.actor.Monitor@79c1270b
09:25:09,742 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - Starting recovery for node1 with journal batch size 1000
09:25:09,744 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Set currentTerm=1, votedFor=node1
09:25:09,744 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Received ReplicatedLogEntry for recovery: index: 0, size: 133
09:25:09,744 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Updated server config: isVoting: false, peers: [PeerInfo [id=node2, address=null, votingState=VOTING]]
09:25:09,744 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Recovery completed  - Switching actor to Follower - last log index = 0, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 1
[WARN] [04/25/2024 09:25:09.744] [test-akka.actor.default-dispatcher-17] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/node2]: org.opendaylight.controller.cluster.common.actor.Monitor@543f27c9
09:25:09,745 AM [test-akka.actor.default-dispatcher-6] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - Starting recovery for node2 with journal batch size 1000
09:25:09,747 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Set currentTerm=1, votedFor=node1
09:25:09,747 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Received ReplicatedLogEntry for recovery: index: 0, size: 133
09:25:09,747 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Updated server config: isVoting: true, peers: [PeerInfo [id=node1, address=null, votingState=NON_VOTING]]
09:25:09,747 AM [test-akka.actor.default-dispatcher-16] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Recovery completed  - Switching actor to Follower - last log index = 0, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 1
09:25:09,756 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupport - node1: onChangeServersVotingStatus: ChangeServersVotingStatus [serverVotingStatusMap={node1=true, node2=true}, serversVisited=[]], state: Idle
09:25:09,759 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupport - Initiating ChangeServersVotingStatusState
09:25:09,759 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupport - node1: Sending local ElectionTimeout to start leader election
09:25:09,760 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Updated server config: isVoting: true, peers: [PeerInfo [id=node2, address=null, votingState=VOTING]]
09:25:09,760 AM [test-akka.actor.default-dispatcher-11] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:25:09,760 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): Received TimeoutNow - switching to Candidate
09:25:09,760 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Candidate): Election: Candidate has following voting peers: [node2]
09:25:09,760 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Set currentTerm=2, votedFor=node1
09:25:09,760 AM [test-akka.actor.default-dispatcher-11] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Candidate): Starting new election term 2
09:25:09,760 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Candidate): Sending RequestVote [term=2, candidateId=node1, lastLogIndex=0, lastLogTerm=1] to peer node2
09:25:09,760 AM [test-akka.actor.default-dispatcher-11] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
09:25:09,812 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Follower): Received TimeoutNow - switching to Candidate
09:25:09,812 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Candidate): Election: Candidate has following voting peers: []
09:25:09,812 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Set currentTerm=2, votedFor=node2
09:25:09,812 AM [test-akka.actor.default-dispatcher-16] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Candidate): Starting new election term 2
09:25:09,812 AM [test-akka.actor.default-dispatcher-16] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
09:25:09,813 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Candidate): Received ElectionTimeout
09:25:09,813 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Leader): Election: Leader has following peers: [node1]
09:25:09,813 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Leader): Checking sendAppendEntries for follower node1: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:25:09,814 AM [test-akka.actor.default-dispatcher-6] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
09:25:09,814 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Candidate): RaftRPC message received AppendEntries [leaderId=node2, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[]], my term is 2
09:25:09,814 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Candidate): handleAppendEntries: AppendEntries [leaderId=node2, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[]]
09:25:09,814 AM [test-akka.actor.default-dispatcher-6] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Candidate): New Leader node2 sent an AppendEntries to Candidate for term 2 - will switch to Follower
09:25:09,814 AM [test-akka.actor.default-dispatcher-6] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Candidate) :- Switching from behavior Candidate to Follower, election term: 2
09:25:09,933 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - node1: Last sync leader does not match current leader node2, need to catch up to -1
09:25:09,933 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Leader): handleAppendEntriesReply - FollowerLogInformation for node1 updated: matchIndex: 0, nextIndex: 1
09:25:09,933 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupport - node1: New leader node2 elected
09:25:09,933 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Leader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2
09:25:09,933 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Leader): Checking sendAppendEntries for follower node1: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:25:09,933 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupport - node1: Forwarding ChangeServersVotingStatus [serverVotingStatusMap={node1=true, node2=true}, serversVisited=[]] to new leader
09:25:09,933 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Updated server config: isVoting: false, peers: [PeerInfo [id=node2, address=akka://test/user/node2, votingState=VOTING]]
09:25:09,933 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: getLeaderAddress leaderId = node2 peerAddress = akka://test/user/node2
09:25:09,933 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupport - node1: Not leader - forwarding to leader ActorSelection[Anchor(akka://test/), Path(/user/node2)]
09:25:09,933 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupport - node2: onChangeServersVotingStatus: ChangeServersVotingStatus [serverVotingStatusMap={node1=true, node2=true}, serversVisited=[]], state: Idle
09:25:09,934 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupport - Initiating ChangeServersVotingStatusState
[WARN] [04/25/2024 09:25:09.934] [test-akka.actor.default-dispatcher-14] [akka://test/user/node1] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@22673bed
09:25:09,934 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Updated server config: isVoting: true, peers: [PeerInfo [id=node1, address=akka://test/user/node1, votingState=VOTING]]
09:25:09,934 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupport - node2: New server configuration : [ServerInfo [id=node1, isVoting=true], ServerInfo [id=node2, isVoting=true]]
09:25:09,934 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Persist data SimpleReplicatedLogEntry [index=1, term=2, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=node1, isVoting=true], ServerInfo [id=node2, isVoting=true]]]]
09:25:09,934 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=2, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=node1, isVoting=true], ServerInfo [id=node2, isVoting=true]]]] 
09:25:09,934 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=06e1135e-0dfe-4ff4-b1e6-d53ca6f2ae6f}, logIndex: 1, payload: class org.opendaylight.controller.cluster.raft.persisted.ServerConfigurationPayload, isSendImmediate: true
09:25:09,934 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Leader): Checking sendAppendEntries for follower node1: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1
09:25:09,934 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Leader): sendAppendEntries: 1 is present for follower node1
09:25:09,934 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Leader): Sending AppendEntries to follower node1: AppendEntries [leaderId=node2, prevLogIndex=0, prevLogTerm=1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=1, term=2, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=node1, isVoting=true], ServerInfo [id=node2, isVoting=true]]]]]]
09:25:09,934 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupport - node2: Returning OK for operation ChangeServersVotingStatus [serverVotingStatusMap={node1=true, node2=true}, serversVisited=[]]
09:25:09,935 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): handleAppendEntries: AppendEntries [leaderId=node2, prevLogIndex=0, prevLogTerm=1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=1, term=2, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=node1, isVoting=true], ServerInfo [id=node2, isVoting=true]]]]]]
09:25:09,935 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): Number of entries to be appended = 1
09:25:09,935 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0
09:25:09,947 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): Append entry to log ServerConfigurationPayload [serverConfig=[ServerInfo [id=node1, isVoting=true], ServerInfo [id=node2, isVoting=true]]]
09:25:09,947 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=2, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=node1, isVoting=true], ServerInfo [id=node2, isVoting=true]]]] 
09:25:09,947 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Updated server config: isVoting: true, peers: [PeerInfo [id=node2, address=akka://test/user/node2, votingState=VOTING]]
09:25:09,947 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): Log size is now 2
09:25:09,947 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): handleAppendEntries returning : AppendEntriesReply [term=2, success=true, followerId=node1, logLastIndex=1, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
09:25:09,947 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - node1: Lagging 0 entries behind leader node2 and reached -1 (of expected -1)
09:25:09,948 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: persist complete SimpleReplicatedLogEntry [index=1, term=2, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=node1, isVoting=true], ServerInfo [id=node2, isVoting=true]]]]
[WARN] [04/25/2024 09:25:09.948] [test-akka.actor.default-dispatcher-14] [akka://test/user/node1] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@6753eac7
09:25:09,949 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Leader): handleAppendEntriesReply - FollowerLogInformation for node1 updated: matchIndex: 1, nextIndex: 2
09:25:09,949 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Leader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2
09:25:09,950 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Leader): Checking sendAppendEntries for follower node1: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1
09:25:09,950 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: persist complete SimpleReplicatedLogEntry [index=1, term=2, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=node1, isVoting=true], ServerInfo [id=node2, isVoting=true]]]]
09:25:09,950 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Leader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2
09:25:09,950 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: -1
09:25:09,950 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Leader): Setting last applied to 0
09:25:09,950 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Moving last applied index from -1 to 0
09:25:09,950 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Applying state for log index 0 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=node1, isVoting=false], ServerInfo [id=node2, isVoting=true]]]
09:25:09,950 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Leader): Setting last applied to 1
09:25:09,950 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Moving last applied index from 0 to 1
09:25:09,950 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Applying state for log index 1 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=node1, isVoting=true], ServerInfo [id=node2, isVoting=true]]]
09:25:09,950 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: fakeSnapshot purging log to 0 for term 2
09:25:09,950 AM [test-akka.actor.default-dispatcher-16] [INFO] RaftActorServerConfigurationSupport - node2: ServerConfigurationPayload [serverConfig=[ServerInfo [id=node1, isVoting=true], ServerInfo [id=node2, isVoting=true]]] has been successfully replicated to a majority of followers
09:25:09,950 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Persisting ApplyJournalEntries with index=1
09:25:10,53 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): Commit index set to 1
09:25:10,53 AM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - node1: Lagging 0 entries behind leader node2 and reached 1 (of expected -1)
09:25:10,53 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): -1, lastIndex(): 1
09:25:10,53 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): Setting last applied to 0
09:25:10,53 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Moving last applied index from -1 to 0
09:25:10,53 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Applying state for log index 0 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=node1, isVoting=false], ServerInfo [id=node2, isVoting=true]]]
09:25:10,53 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): Setting last applied to 1
09:25:10,53 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Moving last applied index from 0 to 1
09:25:10,53 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Applying state for log index 1 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=node1, isVoting=true], ServerInfo [id=node2, isVoting=true]]]
09:25:10,53 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: fakeSnapshot purging log to 0 for term 2
09:25:10,53 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Persisting ApplyJournalEntries with index=1
09:25:10,101 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testChangeToVotingWithNoLeaderAndOtherLeaderElected ending
09:25:10,101 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower169]
09:25:10,113 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/collector170#-1586126747]
09:25:10,113 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/node1]
09:25:10,113 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/collector171#-1903459741]
09:25:10,114 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/node2]
09:25:10,116 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testAddServerWithInstallSnapshotTimeout starting
[WARN] [04/25/2024 09:25:10.117] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/new-server174]: org.opendaylight.controller.cluster.common.actor.Monitor@37658e3b
09:25:10,118 AM [test-akka.actor.default-dispatcher-6] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - Starting recovery for new-server with journal batch size 1000
09:25:10,119 AM [test-akka.actor.default-dispatcher-6] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:10,119 AM [test-akka.actor.default-dispatcher-6] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy
09:25:10,119 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Moving last applied index from -1 to -1
09:25:10,119 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Set currentTerm=1, votedFor=
[WARN] [04/25/2024 09:25:10.119] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader175]: org.opendaylight.controller.cluster.common.actor.Monitor@3f5ae2fb
09:25:10,120 AM [test-akka.actor.default-dispatcher-14] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - Starting recovery for leader with journal batch size 1000
09:25:10,120 AM [test-akka.actor.default-dispatcher-14] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:10,120 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Election: Leader has following peers: []
09:25:10,229 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupport - leader: onAddServer: AddServer [newServerId=new-server, newServerAddress=akka://test/user/new-server174, votingMember=true], state: Idle
09:25:10,229 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupport - leader: Initiating AddServer [newServerId=new-server, newServerAddress=akka://test/user/new-server174, votingMember=true]
09:25:10,230 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead.
09:25:10,230 AM [test-akka.actor.default-dispatcher-16] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] to install on new-server
09:25:10,230 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: lastSequenceNumber prior to capture: -1
09:25:10,230 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupport - leader: Initiating capture snapshot for new server new-server
09:25:10,230 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupport - leader: onUnInitializedFollowerSnapshotReply: UnInitializedFollowerSnapshotReply [followerId=bogus]
09:25:10,230 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupport - leader: Dropping UnInitializedFollowerSnapshotReply for server bogus: server Id doesn't match
09:25:10,230 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: CaptureSnapshotReply received by actor
09:25:10,230 AM [test-akka.actor.default-dispatcher-16] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=, ServerConfigPayload=null]
09:25:10,230 AM [test-akka.actor.default-dispatcher-16] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1
09:25:10,230 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): sendInstallSnapshot
09:25:10,230 AM [test-akka.actor.default-dispatcher-16] [DEBUG] LeaderInstallSnapshotState - leader (Leader): Snapshot 171 bytes, total chunks to send: 1
09:25:10,230 AM [test-akka.actor.default-dispatcher-16] [DEBUG] LeaderInstallSnapshotState - leader (Leader): Next chunk: total length=171, offset=0, size=171, hashCode=-2041399403
09:25:10,230 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): next snapshot chunk size for follower new-server: 171
09:25:10,230 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): InstallSnapshot sent to follower Vector(user, new-server174), Chunk: 1/1
09:25:10,231 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Snapshot success -  sequence number: -1
09:25:10,231 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: SnapshotComplete received
09:25:10,343 AM [test-akka.actor.default-dispatcher-14] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Term 1 in "AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 0 - updating term
09:25:10,343 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Set currentTerm=1, votedFor=null
09:25:10,343 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - new-server: Last sync leader does not match current leader leader, need to catch up to -1
09:25:10,343 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for new-server updated: matchIndex: -1, nextIndex: 0
[WARN] [04/25/2024 09:25:10.344] [test-akka.actor.default-dispatcher-5] [akka://test/user/new-server174] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@64ad055f
09:25:10,443 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupport - leader: handleInstallSnapshotTimeout for new server new-server
09:25:10,443 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupport - leader: Returning TIMEOUT for operation AddServer [newServerId=new-server, newServerAddress=akka://test/user/new-server174, votingMember=true]
09:25:10,443 AM [test-akka.actor.default-dispatcher-14] [WARN] RaftActorServerConfigurationSupport - leader: Timeout occured for new server new-server while installing snapshot
09:25:10,443 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testAddServerWithInstallSnapshotTimeout ending
09:25:10,443 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower172]
09:25:10,454 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/new-serverCollector173#-1325610152]
09:25:10,455 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/new-server174]
09:25:10,455 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader175]
09:25:10,458 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testAddServerWithNoExistingFollower starting
[WARN] [04/25/2024 09:25:10.459] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/new-server178]: org.opendaylight.controller.cluster.common.actor.Monitor@4f7c28fc
09:25:10,460 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - Starting recovery for new-server with journal batch size 1000
09:25:10,460 AM [main] [DEBUG] MockRaftActorContext - test: Moving last applied index from -1 to 1
09:25:10,461 AM [test-akka.actor.default-dispatcher-16] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [04/25/2024 09:25:10.461] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader179]: org.opendaylight.controller.cluster.common.actor.Monitor@2a3f3afb
09:25:10,461 AM [test-akka.actor.default-dispatcher-16] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy
09:25:10,461 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Moving last applied index from -1 to 1
09:25:10,461 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Set currentTerm=1, votedFor=
09:25:10,461 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - Starting recovery for leader with journal batch size 1000
09:25:10,462 AM [test-akka.actor.default-dispatcher-14] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Recovery completed  - Switching actor to Follower - last log index = 1, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 2
09:25:10,462 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Election: Leader has following peers: []
09:25:10,573 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupport - leader: onAddServer: AddServer [newServerId=new-server, newServerAddress=akka://test/user/new-server178, votingMember=true], state: Idle
09:25:10,573 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupport - leader: Initiating AddServer [newServerId=new-server, newServerAddress=akka://test/user/new-server178, votingMember=true]
09:25:10,574 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=1, lastAppliedTerm=1, lastIndex=1, lastTerm=1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] to install on new-server
09:25:10,574 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: lastSequenceNumber prior to capture: -1
09:25:10,574 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupport - leader: Initiating capture snapshot for new server new-server
09:25:10,574 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: CaptureSnapshotReply received by actor
09:25:10,574 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persisting of snapshot done: Snapshot [lastIndex=1, lastTerm=1, lastAppliedIndex=1, lastAppliedTerm=1, unAppliedEntries size=0, state=MockSnapshotState [state=[0, 1]], electionTerm=1, electionVotedFor=, ServerConfigPayload=null]
09:25:10,574 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1
09:25:10,574 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): sendInstallSnapshot
09:25:10,574 AM [test-akka.actor.default-dispatcher-5] [DEBUG] LeaderInstallSnapshotState - leader (Leader): Snapshot 324 bytes, total chunks to send: 1
09:25:10,574 AM [test-akka.actor.default-dispatcher-5] [DEBUG] LeaderInstallSnapshotState - leader (Leader): Next chunk: total length=324, offset=0, size=324, hashCode=-1763937099
09:25:10,574 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): next snapshot chunk size for follower new-server: 324
09:25:10,574 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): InstallSnapshot sent to follower Vector(user, new-server178), Chunk: 1/1
09:25:10,575 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Snapshot success -  sequence number: -1
09:25:10,575 AM [test-akka.actor.default-dispatcher-14] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Term 1 in "InstallSnapshot [term=1, leaderId=leader, lastIncludedIndex=1, lastIncludedTerm=1, datasize=324, Chunk=1/1, lastChunkHashCode=OptionalInt[-1], serverConfig=null]" message is greater than follower's term 0 - updating term
09:25:10,575 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Set currentTerm=1, votedFor=null
09:25:10,575 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: SnapshotComplete received
09:25:10,575 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): handleInstallSnapshot: InstallSnapshot [term=1, leaderId=leader, lastIncludedIndex=1, lastIncludedTerm=1, datasize=324, Chunk=1/1, lastChunkHashCode=OptionalInt[-1], serverConfig=null]
09:25:10,575 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - new-server: Last sync leader does not match current leader leader, need to catch up to 1
09:25:10,575 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - addChunk: chunkIndex=1, lastChunkIndex=0, collectedChunks.size=0, lastChunkHashCode=-1
09:25:10,575 AM [test-akka.actor.default-dispatcher-14] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Snapshot installed from leader: leader
09:25:10,577 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Applying snapshot on follower:  Snapshot [lastIndex=1, lastTerm=1, lastAppliedIndex=1, lastAppliedTerm=1, unAppliedEntries size=0, state=MockSnapshotState [state=[0, 1]], electionTerm=1, electionVotedFor=null, ServerConfigPayload=null]
09:25:10,577 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - lastSequenceNumber prior to persisting applied snapshot: -1
09:25:10,577 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Snapshot success -  sequence number: -1
09:25:10,577 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Moving last applied index from -1 to 1
09:25:10,577 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Set currentTerm=1, votedFor=null
09:25:10,577 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: applySnapshot called
[WARN] [04/25/2024 09:25:10.577] [test-akka.actor.default-dispatcher-14] [akka://test/user/new-server178] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@4e105fc6
09:25:10,577 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): handleInstallSnapshot returning: InstallSnapshotReply [term=1, followerId=new-server, chunkIndex=1, success=true]
09:25:10,578 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: SnapshotComplete received
09:25:10,578 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): handleInstallSnapshotReply: InstallSnapshotReply [term=1, followerId=new-server, chunkIndex=1, success=true]
09:25:10,578 AM [test-akka.actor.default-dispatcher-14] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Snapshot successfully installed on follower new-server (last chunk 1) - matchIndex set to 1, nextIndex set to 2
09:25:10,578 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - Sent message UnInitializedFollowerSnapshotReply to self
09:25:10,578 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: fakeSnapshot purging log to 0 for term 1
09:25:10,578 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupport - leader: onUnInitializedFollowerSnapshotReply: UnInitializedFollowerSnapshotReply [followerId=new-server]
09:25:10,578 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupport - leader: New server configuration : [ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]
09:25:10,578 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persist data SimpleReplicatedLogEntry [index=2, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]
09:25:10,578 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Append log entry and persist SimpleReplicatedLogEntry [index=2, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]] 
09:25:10,578 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=89fe5e4f-d6ef-4ed8-94cf-a094d46b51e8}, logIndex: 2, payload: class org.opendaylight.controller.cluster.raft.persisted.ServerConfigurationPayload, isSendImmediate: true
09:25:10,578 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:25:10,578 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower new-server: active: true, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: 0
09:25:10,578 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): sendAppendEntries: 2 is present for follower new-server
09:25:10,579 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Sending AppendEntries to follower new-server: AppendEntries [leaderId=leader, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=0, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=2, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]]]
09:25:10,579 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupport - leader: Returning OK for operation AddServer [newServerId=new-server, newServerAddress=akka://test/user/new-server178, votingMember=true]
09:25:10,579 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): handleAppendEntries: AppendEntries [leaderId=leader, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=0, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=2, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]]]
09:25:10,579 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Number of entries to be appended = 1
09:25:10,579 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): After cleanup, lastIndex: 1, entries to be added from: 0
09:25:10,579 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Append entry to log ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]
09:25:10,579 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Append log entry and persist SimpleReplicatedLogEntry [index=2, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]] 
09:25:10,579 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Updated server config: isVoting: true, peers: [PeerInfo [id=leader, address=null, votingState=VOTING]]
09:25:10,579 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Log size is now 1
09:25:10,579 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): handleAppendEntries returning : AppendEntriesReply [term=1, success=true, followerId=new-server, logLastIndex=2, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=true, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
09:25:10,579 AM [test-akka.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - new-server: Lagging 0 entries behind leader leader and reached 1 (of expected 1)
09:25:10,580 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for new-server updated: matchIndex: 2, nextIndex: 3
09:25:10,580 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower new-server: active: true, followerNextIndex: 3, leaderLastIndex: 2, leaderSnapShotIndex: 0
09:25:10,580 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: persist complete SimpleReplicatedLogEntry [index=2, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]
09:25:10,580 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Applying to log - commitIndex: 2, lastAppliedIndex: 1
09:25:10,580 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Setting last applied to 2
09:25:10,580 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Moving last applied index from 1 to 2
09:25:10,580 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Applying state for log index 2 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]
09:25:10,580 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: fakeSnapshot purging log to 1 for term 1
09:25:10,580 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupport - leader: ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]] has been successfully replicated to a majority of followers
09:25:10,580 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persisting ApplyJournalEntries with index=2
09:25:10,580 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: persist complete SimpleReplicatedLogEntry [index=2, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]
[WARN] [04/25/2024 09:25:10.581] [test-akka.actor.default-dispatcher-5] [akka://test/user/new-server178] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@709dc4c5
09:25:10,693 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Commit index set to 2
09:25:10,693 AM [test-akka.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - new-server: Lagging 0 entries behind leader leader and reached 2 (of expected 1)
09:25:10,693 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 2, context.getLastApplied(): 1, lastIndex(): 2
09:25:10,693 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Setting last applied to 2
09:25:10,693 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Moving last applied index from 1 to 2
09:25:10,693 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Applying state for log index 2 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]
09:25:10,693 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Persisting ApplyJournalEntries with index=2
09:25:10,725 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testAddServerWithNoExistingFollower ending
09:25:10,725 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower176]
09:25:10,736 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/new-serverCollector177#-1532127143]
09:25:10,736 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/new-server178]
09:25:10,737 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader179]
09:25:10,737 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leaderCollector180]
09:25:10,739 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testChangeToVotingWithNoLeaderAndForwardedToOtherNodeAfterElectionTimeout starting
[WARN] [04/25/2024 09:25:10.744] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/node1]: org.opendaylight.controller.cluster.common.actor.Monitor@774335e6
09:25:10,745 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - Starting recovery for node1 with journal batch size 1000
09:25:10,747 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Set currentTerm=1, votedFor=node1
09:25:10,748 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Received ReplicatedLogEntry for recovery: index: 0, size: 133
09:25:10,748 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Updated server config: isVoting: false, peers: [PeerInfo [id=node2, address=null, votingState=NON_VOTING]]
09:25:10,748 AM [test-akka.actor.default-dispatcher-6] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Recovery completed  - Switching actor to Follower - last log index = 0, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 1
[WARN] [04/25/2024 09:25:10.748] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/node2]: org.opendaylight.controller.cluster.common.actor.Monitor@c2f02d5
09:25:10,748 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - Starting recovery for node2 with journal batch size 1000
09:25:10,750 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Set currentTerm=1, votedFor=node1
09:25:10,751 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Received ReplicatedLogEntry for recovery: index: 0, size: 133
09:25:10,751 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Updated server config: isVoting: false, peers: [PeerInfo [id=node1, address=null, votingState=NON_VOTING]]
09:25:10,751 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Received ReplicatedLogEntry for recovery: index: 1, size: 1
09:25:10,751 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Received apply journal entries for recovery, applying to state: 0 to 1
09:25:10,751 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Moving last applied index from -1 to 1
09:25:10,751 AM [test-akka.actor.default-dispatcher-14] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Recovery completed  in 66.62 μs - Switching actor to Follower - last log index = 1, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 2
09:25:10,858 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupport - node1: onChangeServersVotingStatus: ChangeServersVotingStatus [serverVotingStatusMap={node1=true, node2=true}, serversVisited=[]], state: Idle
09:25:10,858 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupport - Initiating ChangeServersVotingStatusState
09:25:10,858 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupport - node1: Sending local ElectionTimeout to start leader election
09:25:10,858 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Updated server config: isVoting: true, peers: [PeerInfo [id=node2, address=null, votingState=VOTING]]
09:25:10,858 AM [test-akka.actor.default-dispatcher-11] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:25:10,858 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): Received TimeoutNow - switching to Candidate
09:25:10,858 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Candidate): Election: Candidate has following voting peers: [node2]
09:25:10,859 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Set currentTerm=2, votedFor=node1
09:25:10,859 AM [test-akka.actor.default-dispatcher-11] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Candidate): Starting new election term 2
09:25:10,859 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Candidate): Sending RequestVote [term=2, candidateId=node1, lastLogIndex=0, lastLogTerm=1] to peer node2
09:25:10,859 AM [test-akka.actor.default-dispatcher-11] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
09:25:10,859 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:25:10,859 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Follower): Cluster state: []
09:25:10,859 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=node1, lastLogIndex=0, lastLogTerm=1] with higher term appears reachable, updating term.
09:25:10,859 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Follower): Term 2 in "RequestVote [term=2, candidateId=node1, lastLogIndex=0, lastLogTerm=1]" message is greater than follower's term 1 - updating term
09:25:10,859 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Set currentTerm=2, votedFor=null
09:25:10,859 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Follower): In requestVote:  RequestVote [term=2, candidateId=node1, lastLogIndex=0, lastLogTerm=1] - currentTerm: 2, votedFor: null, lastIndex: 1, lastTerm: 1
09:25:10,859 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=false]
09:25:10,860 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Candidate): RaftRPC message received RequestVoteReply [term=2, voteGranted=false], my term is 2
09:25:10,860 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Candidate): handleRequestVoteReply: RequestVoteReply [term=2, voteGranted=false], current voteCount: 1
09:25:11,172 AM [test-akka.actor.default-dispatcher-14] [WARN] RaftActorServerConfigurationSupport - node1: Leader election timed out - cannot apply operation ChangeServersVotingStatus [serverVotingStatusMap={node1=true, node2=true}, serversVisited=[]]
09:25:11,173 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Updated server config: isVoting: false, peers: [PeerInfo [id=node2, address=akka://test/user/node2, votingState=NON_VOTING]]
09:25:11,173 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupport - node1: tryToForwardOperationToAnotherServer - servers already visited []
09:25:11,173 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupport - node1: Found server ActorSelection[Anchor(akka://test/), Path(/user/node2)] to forward to
09:25:11,174 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupport - node2: onChangeServersVotingStatus: ChangeServersVotingStatus [serverVotingStatusMap={node1=true, node2=true}, serversVisited=[node1]], state: Idle
09:25:11,174 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupport - Initiating ChangeServersVotingStatusState
09:25:11,174 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupport - node2: Sending local ElectionTimeout to start leader election
09:25:11,174 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Updated server config: isVoting: true, peers: [PeerInfo [id=node1, address=null, votingState=VOTING]]
09:25:11,174 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Follower): Received TimeoutNow - switching to Candidate
09:25:11,175 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Candidate): Election: Candidate has following voting peers: [node1]
09:25:11,175 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Set currentTerm=3, votedFor=node2
09:25:11,175 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Candidate): Starting new election term 3
09:25:11,175 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Candidate): Sending RequestVote [term=3, candidateId=node2, lastLogIndex=1, lastLogTerm=1] to peer node1
09:25:11,175 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Follower) :- Switching from behavior Follower to Candidate, election term: 3
09:25:11,175 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:25:11,175 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): Cluster state: []
09:25:11,175 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): Candidate in requestVote:RequestVote [term=3, candidateId=node2, lastLogIndex=1, lastLogTerm=1] with higher term appears reachable, updating term.
09:25:11,175 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): Term 3 in "RequestVote [term=3, candidateId=node2, lastLogIndex=1, lastLogTerm=1]" message is greater than follower's term 2 - updating term
09:25:11,175 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Set currentTerm=3, votedFor=null
09:25:11,175 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): In requestVote:  RequestVote [term=3, candidateId=node2, lastLogIndex=1, lastLogTerm=1] - currentTerm: 3, votedFor: null, lastIndex: 0, lastTerm: 1
09:25:11,175 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Set currentTerm=3, votedFor=node2
09:25:11,175 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): requestVote returning: RequestVoteReply [term=3, voteGranted=true]
09:25:11,176 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Candidate): RaftRPC message received RequestVoteReply [term=3, voteGranted=true], my term is 3
09:25:11,176 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Candidate): handleRequestVoteReply: RequestVoteReply [term=3, voteGranted=true], current voteCount: 1
09:25:11,176 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Leader): Election: Leader has following peers: [node1]
09:25:11,176 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Leader): Checking sendAppendEntries for follower node1: active: false, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1
09:25:11,176 AM [test-akka.actor.default-dispatcher-11] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Candidate) :- Switching from behavior Candidate to Leader, election term: 3
09:25:11,176 AM [test-akka.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - node1: Last sync leader does not match current leader node2, need to catch up to -1
09:25:11,177 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupport - node2: New leader node2 elected
09:25:11,177 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupport - node2: New server configuration : [ServerInfo [id=node1, isVoting=true], ServerInfo [id=node2, isVoting=true]]
09:25:11,177 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Persist data SimpleReplicatedLogEntry [index=2, term=3, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=node1, isVoting=true], ServerInfo [id=node2, isVoting=true]]]]
09:25:11,177 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Append log entry and persist SimpleReplicatedLogEntry [index=2, term=3, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=node1, isVoting=true], ServerInfo [id=node2, isVoting=true]]]] 
[WARN] [04/25/2024 09:25:11.177] [test-akka.actor.default-dispatcher-13] [akka://test/user/node1] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@6836fe2e
09:25:11,177 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=c8ca814f-cc53-4348-82f1-10756a321dcd}, logIndex: 2, payload: class org.opendaylight.controller.cluster.raft.persisted.ServerConfigurationPayload, isSendImmediate: true
09:25:11,177 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Leader): Checking sendAppendEntries for follower node1: active: false, followerNextIndex: 1, leaderLastIndex: 2, leaderSnapShotIndex: -1
09:25:11,177 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupport - node2: Returning OK for operation ChangeServersVotingStatus [serverVotingStatusMap={node1=true, node2=true}, serversVisited=[node1]]
09:25:11,177 AM [test-akka.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - node1: Lagging 0 entries behind leader node2 and reached -1 (of expected -1)
09:25:11,178 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Leader): handleAppendEntriesReply - FollowerLogInformation for node1 updated: matchIndex: 0, nextIndex: 1
[WARN] [04/25/2024 09:25:11.177] [test-akka.actor.default-dispatcher-13] [akka://test/user/node1] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@1c7b6057
09:25:11,178 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: fakeSnapshot purging log to 0 for term 3
09:25:11,178 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Leader): Checking sendAppendEntries for follower node1: active: true, followerNextIndex: 1, leaderLastIndex: 2, leaderSnapShotIndex: 0
09:25:11,178 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Leader): sendAppendEntries: 1 is present for follower node1
09:25:11,178 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Leader): Sending AppendEntries to follower node1: AppendEntries [leaderId=node2, prevLogIndex=0, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=0, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=1, term=1, payload=2], SimpleReplicatedLogEntry [index=2, term=3, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=node1, isVoting=true], ServerInfo [id=node2, isVoting=true]]]]]]
09:25:11,178 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Leader): sendAppendEntries: 1 is present for follower node1
09:25:11,178 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): handleAppendEntries: AppendEntries [leaderId=node2, prevLogIndex=0, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=0, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=1, term=1, payload=2], SimpleReplicatedLogEntry [index=2, term=3, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=node1, isVoting=true], ServerInfo [id=node2, isVoting=true]]]]]]
09:25:11,178 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): Number of entries to be appended = 2
09:25:11,178 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0
09:25:11,178 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): Append entry to log 2
09:25:11,178 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=2] 
09:25:11,178 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: persist complete SimpleReplicatedLogEntry [index=2, term=3, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=node1, isVoting=true], ServerInfo [id=node2, isVoting=true]]]]
09:25:11,178 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): Append entry to log ServerConfigurationPayload [serverConfig=[ServerInfo [id=node1, isVoting=true], ServerInfo [id=node2, isVoting=true]]]
09:25:11,178 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Append log entry and persist SimpleReplicatedLogEntry [index=2, term=3, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=node1, isVoting=true], ServerInfo [id=node2, isVoting=true]]]] 
09:25:11,178 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Updated server config: isVoting: true, peers: [PeerInfo [id=node2, address=akka://test/user/node2, votingState=VOTING]]
09:25:11,178 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): Log size is now 3
09:25:11,178 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): Commit index set to 1
09:25:11,179 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): handleAppendEntries returning : AppendEntriesReply [term=3, success=true, followerId=node1, logLastIndex=2, logLastTerm=3, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
09:25:11,179 AM [test-akka.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - node1: Lagging 0 entries behind leader node2 and reached 1 (of expected -1)
09:25:11,179 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): -1, lastIndex(): 2
09:25:11,179 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): Setting last applied to 0
09:25:11,179 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Moving last applied index from -1 to 0
09:25:11,179 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Applying state for log index 0 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=node1, isVoting=false], ServerInfo [id=node2, isVoting=false]]]
09:25:11,179 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): Setting last applied to 1
09:25:11,179 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Moving last applied index from 0 to 1
09:25:11,179 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Applying state for log index 1 data 2
09:25:11,179 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: applyState called: 2
09:25:11,179 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: fakeSnapshot purging log to 0 for term 3
09:25:11,179 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Leader): handleAppendEntriesReply - FollowerLogInformation for node1 updated: matchIndex: 2, nextIndex: 3
09:25:11,179 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Leader): Applying to log - commitIndex: 2, lastAppliedIndex: 1
09:25:11,179 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Leader): Setting last applied to 2
09:25:11,179 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Moving last applied index from 1 to 2
09:25:11,179 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Applying state for log index 2 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=node1, isVoting=true], ServerInfo [id=node2, isVoting=true]]]
09:25:11,179 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: fakeSnapshot purging log to 1 for term 3
09:25:11,180 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Leader): Checking sendAppendEntries for follower node1: active: true, followerNextIndex: 3, leaderLastIndex: 2, leaderSnapShotIndex: 1
09:25:11,180 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupport - node2: ServerConfigurationPayload [serverConfig=[ServerInfo [id=node1, isVoting=true], ServerInfo [id=node2, isVoting=true]]] has been successfully replicated to a majority of followers
09:25:11,180 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=2]
09:25:11,180 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Persisting ApplyJournalEntries with index=2
09:25:11,180 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: persist complete SimpleReplicatedLogEntry [index=2, term=3, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=node1, isVoting=true], ServerInfo [id=node2, isVoting=true]]]]
09:25:11,180 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Persisting ApplyJournalEntries with index=1
09:25:11,180 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): Commit index set to 2
09:25:11,180 AM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - node1: Lagging 0 entries behind leader node2 and reached 2 (of expected -1)
09:25:11,180 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 2, context.getLastApplied(): 1, lastIndex(): 2
09:25:11,180 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): Setting last applied to 2
09:25:11,180 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Moving last applied index from 1 to 2
09:25:11,180 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Applying state for log index 2 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=node1, isVoting=true], ServerInfo [id=node2, isVoting=true]]]
09:25:11,181 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: fakeSnapshot purging log to 1 for term 3
09:25:11,181 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Persisting ApplyJournalEntries with index=2
09:25:11,229 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testChangeToVotingWithNoLeaderAndForwardedToOtherNodeAfterElectionTimeout ending
09:25:11,229 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower181]
09:25:11,240 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/collector182#1364263852]
09:25:11,240 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/node1]
09:25:11,241 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/collector183#1891768433]
09:25:11,241 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/node2]
09:25:11,243 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testAddServerWithNoConsensusReached starting
09:25:11,245 AM [test-akka.actor.default-dispatcher-16] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - Starting recovery for new-server with journal batch size 1000
[WARN] [04/25/2024 09:25:11.245] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/new-server186]: org.opendaylight.controller.cluster.common.actor.Monitor@72eb0bd8
09:25:11,247 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Moving last applied index from -1 to -1
09:25:11,247 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Set currentTerm=1, votedFor=
09:25:11,247 AM [test-akka.actor.default-dispatcher-6] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - Starting recovery for leader with journal batch size 1000
[WARN] [04/25/2024 09:25:11.247] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader187]: org.opendaylight.controller.cluster.common.actor.Monitor@70db1a19
09:25:11,247 AM [test-akka.actor.default-dispatcher-16] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:11,248 AM [test-akka.actor.default-dispatcher-16] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy
09:25:11,248 AM [test-akka.actor.default-dispatcher-17] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:11,249 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Election: Leader has following peers: []
09:25:11,358 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupport - leader: onAddServer: AddServer [newServerId=new-server, newServerAddress=akka://test/user/new-server186, votingMember=true], state: Idle
09:25:11,358 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupport - leader: Initiating AddServer [newServerId=new-server, newServerAddress=akka://test/user/new-server186, votingMember=true]
09:25:11,358 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead.
09:25:11,358 AM [test-akka.actor.default-dispatcher-14] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] to install on new-server
09:25:11,358 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: lastSequenceNumber prior to capture: -1
09:25:11,359 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupport - leader: Initiating capture snapshot for new server new-server
09:25:11,359 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: CaptureSnapshotReply received by actor
09:25:11,359 AM [test-akka.actor.default-dispatcher-14] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=, ServerConfigPayload=null]
09:25:11,359 AM [test-akka.actor.default-dispatcher-14] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1
09:25:11,359 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): sendInstallSnapshot
09:25:11,359 AM [test-akka.actor.default-dispatcher-14] [DEBUG] LeaderInstallSnapshotState - leader (Leader): Snapshot 171 bytes, total chunks to send: 1
09:25:11,359 AM [test-akka.actor.default-dispatcher-14] [DEBUG] LeaderInstallSnapshotState - leader (Leader): Next chunk: total length=171, offset=0, size=171, hashCode=-2041399403
09:25:11,359 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): next snapshot chunk size for follower new-server: 171
09:25:11,359 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): InstallSnapshot sent to follower Vector(user, new-server186), Chunk: 1/1
09:25:11,359 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Snapshot success -  sequence number: -1
09:25:11,359 AM [test-akka.actor.default-dispatcher-17] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Term 1 in "InstallSnapshot [term=1, leaderId=leader, lastIncludedIndex=-1, lastIncludedTerm=-1, datasize=171, Chunk=1/1, lastChunkHashCode=OptionalInt[-1], serverConfig=null]" message is greater than follower's term 0 - updating term
09:25:11,359 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Set currentTerm=1, votedFor=null
09:25:11,359 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: SnapshotComplete received
09:25:11,359 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): handleInstallSnapshot: InstallSnapshot [term=1, leaderId=leader, lastIncludedIndex=-1, lastIncludedTerm=-1, datasize=171, Chunk=1/1, lastChunkHashCode=OptionalInt[-1], serverConfig=null]
09:25:11,360 AM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - new-server: Last sync leader does not match current leader leader, need to catch up to -1
09:25:11,360 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - addChunk: chunkIndex=1, lastChunkIndex=0, collectedChunks.size=0, lastChunkHashCode=-1
09:25:11,360 AM [test-akka.actor.default-dispatcher-17] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Snapshot installed from leader: leader
09:25:11,361 AM [test-akka.actor.default-dispatcher-14] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Applying snapshot on follower:  Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=null, ServerConfigPayload=null]
[WARN] [04/25/2024 09:25:11.361] [test-akka.actor.default-dispatcher-17] [akka://test/user/new-server186] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@6aa4aa0
09:25:11,361 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - lastSequenceNumber prior to persisting applied snapshot: -1
09:25:11,361 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Snapshot success -  sequence number: -1
09:25:11,361 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Moving last applied index from -1 to -1
09:25:11,361 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Set currentTerm=1, votedFor=null
09:25:11,361 AM [test-akka.actor.default-dispatcher-14] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: applySnapshot called
09:25:11,362 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): handleInstallSnapshot returning: InstallSnapshotReply [term=1, followerId=new-server, chunkIndex=1, success=true]
09:25:11,362 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: SnapshotComplete received
09:25:11,362 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): handleInstallSnapshotReply: InstallSnapshotReply [term=1, followerId=new-server, chunkIndex=1, success=true]
09:25:11,362 AM [test-akka.actor.default-dispatcher-16] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Snapshot successfully installed on follower new-server (last chunk 1) - matchIndex set to -1, nextIndex set to 0
09:25:11,362 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - Sent message UnInitializedFollowerSnapshotReply to self
09:25:11,408 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupport - leader: onUnInitializedFollowerSnapshotReply: UnInitializedFollowerSnapshotReply [followerId=new-server]
09:25:11,409 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupport - leader: New server configuration : [ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]
09:25:11,409 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]
09:25:11,409 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]] 
09:25:11,409 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=64cfa552-a635-42fa-910c-9c54892b0c31}, logIndex: 0, payload: class org.opendaylight.controller.cluster.raft.persisted.ServerConfigurationPayload, isSendImmediate: true
09:25:11,409 AM [test-akka.actor.default-dispatcher-17] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:25:11,409 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower new-server: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:25:11,409 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): sendAppendEntries: 0 is present for follower new-server
09:25:11,409 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Sending AppendEntries to follower new-server: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]]]
09:25:11,409 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupport - leader: Returning OK for operation AddServer [newServerId=new-server, newServerAddress=akka://test/user/new-server186, votingMember=true]
09:25:11,410 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]
09:25:11,459 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupport - leader: onAddServer: AddServer [newServerId=new-server2, newServerAddress=, votingMember=false], state: Persisting
09:25:11,459 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupport - leader: Server operation already in progress - queueing AddServer [newServerId=new-server2, newServerAddress=, votingMember=false]
09:25:11,473 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): sendAppendEntries: 0 is present for follower new-server
09:25:11,592 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): sendAppendEntries: 0 is present for follower new-server
09:25:11,593 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Sending AppendEntries to follower new-server: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]]]
09:25:11,714 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): sendAppendEntries: 0 is present for follower new-server
09:25:11,714 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Sending AppendEntries to follower new-server: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]]]
09:25:11,833 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): sendAppendEntries: 0 is present for follower new-server
09:25:11,833 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Sending AppendEntries to follower new-server: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]]]
09:25:11,953 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): sendAppendEntries: 0 is present for follower new-server
09:25:11,953 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Sending AppendEntries to follower new-server: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]]]
09:25:12,72 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): sendAppendEntries: 0 is present for follower new-server
09:25:12,73 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Sending AppendEntries to follower new-server: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]]]
09:25:12,193 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): sendAppendEntries: 0 is present for follower new-server
09:25:12,193 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Sending AppendEntries to follower new-server: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]]]
09:25:12,313 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): sendAppendEntries: 0 is present for follower new-server
09:25:12,313 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Sending AppendEntries to follower new-server: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]]]
09:25:13,423 AM [test-akka.actor.default-dispatcher-14] [WARN] RaftActorServerConfigurationSupport - leader: Timeout occured while replicating the new server configuration for new-server
09:25:13,423 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupport - leader: Returning PRIOR_REQUEST_CONSENSUS_TIMEOUT for operation AddServer [newServerId=new-server2, newServerAddress=, votingMember=false]
09:25:13,424 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupport - leader: onAddServer: AddServer [newServerId=new-server2, newServerAddress=, votingMember=false], state: Persisting
09:25:13,424 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupport - leader: Returning PRIOR_REQUEST_CONSENSUS_TIMEOUT for operation AddServer [newServerId=new-server2, newServerAddress=, votingMember=false]
09:25:13,424 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testAddServerWithNoConsensusReached ending
09:25:13,424 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower184]
09:25:13,435 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/new-serverCollector185#-1634894661]
09:25:13,435 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/new-server186]
09:25:13,436 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader187]
09:25:13,436 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leaderCollector188]
09:25:13,437 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/new-serverCollector189]
09:25:13,539 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testRemoveServerLeaderWithNoFollowers starting
[WARN] [04/25/2024 09:25:13.540] [test-akka.actor.default-dispatcher-17] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader191]: org.opendaylight.controller.cluster.common.actor.Monitor@752febab
09:25:13,541 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Moving last applied index from -1 to -1
09:25:13,541 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Set currentTerm=1, votedFor=
09:25:13,541 AM [test-akka.actor.default-dispatcher-14] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - Starting recovery for leader with journal batch size 1000
09:25:13,543 AM [test-akka.actor.default-dispatcher-17] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:13,543 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Election: Leader has following peers: []
09:25:13,651 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupport - leader: onRemoveServer: RemoveServer{serverId='leader'}, state: Idle
09:25:13,652 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testRemoveServerLeaderWithNoFollowers ending
09:25:13,652 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower190]
09:25:13,663 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader191]
09:25:13,666 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testAddServerWithLeaderChangeBeforePriorSnapshotComplete starting
[WARN] [04/25/2024 09:25:13.667] [test-akka.actor.default-dispatcher-17] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/new-server194]: org.opendaylight.controller.cluster.common.actor.Monitor@57b497e9
09:25:13,668 AM [test-akka.actor.default-dispatcher-14] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - Starting recovery for new-server with journal batch size 1000
[WARN] [04/25/2024 09:25:13.669] [test-akka.actor.default-dispatcher-17] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader195]: org.opendaylight.controller.cluster.common.actor.Monitor@7a8c3aa0
09:25:13,669 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Moving last applied index from -1 to -1
09:25:13,669 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Set currentTerm=1, votedFor=
09:25:13,670 AM [test-akka.actor.default-dispatcher-14] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - Starting recovery for leader with journal batch size 1000
09:25:13,671 AM [test-akka.actor.default-dispatcher-16] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:13,671 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:13,671 AM [test-akka.actor.default-dispatcher-16] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy
09:25:13,671 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Election: Leader has following peers: []
09:25:13,672 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - Take a snapshot of current state. lastReplicatedLog is null and replicatedToAllIndex is -1
09:25:13,672 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead.
09:25:13,672 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=true]
09:25:13,672 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: lastSequenceNumber prior to capture: -1
09:25:13,672 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: CaptureSnapshotReply received by actor
09:25:13,672 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=, ServerConfigPayload=null]
09:25:13,672 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: user triggered or root overwrite snapshot encountered, trimming log up to last applied index -1
09:25:13,672 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1
09:25:13,681 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupport - leader: onAddServer: AddServer [newServerId=new-server, newServerAddress=akka://test/user/new-server194, votingMember=true], state: Idle
09:25:13,681 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupport - leader: Initiating AddServer [newServerId=new-server, newServerAddress=akka://test/user/new-server194, votingMember=true]
09:25:13,681 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - captureToInstall should not be called in state Persisting
09:25:13,681 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupport - leader: Snapshot already in progress - waiting for completion
09:25:13,683 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Snapshot success -  sequence number: -1
09:25:13,683 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupport - leader: handleInstallSnapshotTimeout for new server new-server
09:25:13,683 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupport - leader: Returning NO_LEADER for operation AddServer [newServerId=new-server, newServerAddress=akka://test/user/new-server194, votingMember=true]
09:25:13,684 AM [test-akka.actor.default-dispatcher-13] [WARN] RaftActorServerConfigurationSupport - leader: Timeout occured for new server new-server while waiting for prior snapshot to complete
09:25:13,684 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: SnapshotComplete received
09:25:13,684 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testAddServerWithLeaderChangeBeforePriorSnapshotComplete ending
09:25:13,684 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower192]
09:25:13,696 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/new-serverCollector193#703523979]
09:25:13,697 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/new-server194]
09:25:13,697 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader195]
09:25:13,697 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leaderCollector196]
09:25:13,699 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testAddServersAsNonVoting starting
[WARN] [04/25/2024 09:25:13.701] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/new-server199]: org.opendaylight.controller.cluster.common.actor.Monitor@6a0b73ea
09:25:13,702 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - Starting recovery for new-server with journal batch size 1000
[WARN] [04/25/2024 09:25:13.703] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader200]: org.opendaylight.controller.cluster.common.actor.Monitor@583a8c69
09:25:13,703 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Moving last applied index from -1 to -1
09:25:13,703 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Set currentTerm=1, votedFor=
09:25:13,703 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - Starting recovery for leader with journal batch size 1000
09:25:13,703 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:13,704 AM [test-akka.actor.default-dispatcher-13] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy
09:25:13,704 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:13,704 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Election: Leader has following peers: []
09:25:13,814 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupport - leader: onAddServer: AddServer [newServerId=new-server, newServerAddress=akka://test/user/new-server199, votingMember=false], state: Idle
09:25:13,814 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupport - leader: Initiating AddServer [newServerId=new-server, newServerAddress=akka://test/user/new-server199, votingMember=false]
09:25:13,814 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupport - leader: New follower is non-voting - directly persisting new server configuration
09:25:13,815 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupport - leader: New server configuration : [ServerInfo [id=new-server, isVoting=false], ServerInfo [id=leader, isVoting=true]]
09:25:13,815 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=false], ServerInfo [id=leader, isVoting=true]]]]
09:25:13,815 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=false], ServerInfo [id=leader, isVoting=true]]]] 
09:25:13,815 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=40ff7318-7817-4b15-abe8-9f5d093beedc}, logIndex: 0, payload: class org.opendaylight.controller.cluster.raft.persisted.ServerConfigurationPayload, isSendImmediate: true
09:25:13,815 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Setting last applied to 0
09:25:13,815 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Moving last applied index from -1 to 0
09:25:13,815 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Applying state for log index 0 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=false], ServerInfo [id=leader, isVoting=true]]]
09:25:13,815 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower new-server: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:25:13,815 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupport - leader: Returning OK for operation AddServer [newServerId=new-server, newServerAddress=akka://test/user/new-server199, votingMember=false]
09:25:13,816 AM [test-akka.actor.default-dispatcher-11] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Term 1 in "AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 0 - updating term
09:25:13,816 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Set currentTerm=1, votedFor=null
09:25:13,816 AM [test-akka.actor.default-dispatcher-17] [INFO] RaftActorServerConfigurationSupport - leader: ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=false], ServerInfo [id=leader, isVoting=true]]] has been successfully replicated to a majority of followers
09:25:13,816 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persisting ApplyJournalEntries with index=0
09:25:13,816 AM [test-akka.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - new-server: Last sync leader does not match current leader leader, need to catch up to -1
09:25:13,816 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for new-server updated: matchIndex: -1, nextIndex: 0
09:25:13,816 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower new-server: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:25:13,816 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): sendAppendEntries: 0 is present for follower new-server
09:25:13,816 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Sending AppendEntries to follower new-server: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=false], ServerInfo [id=leader, isVoting=true]]]]]]
09:25:13,817 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=false], ServerInfo [id=leader, isVoting=true]]]]
09:25:13,817 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): handleAppendEntries: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=false], ServerInfo [id=leader, isVoting=true]]]]]]
09:25:13,817 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Number of entries to be appended = 1
09:25:13,817 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
09:25:13,817 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Append entry to log ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=false], ServerInfo [id=leader, isVoting=true]]]
[WARN] [04/25/2024 09:25:13.817] [test-akka.actor.default-dispatcher-17] [akka://test/user/new-server199] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@242f4d99
09:25:13,817 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=false], ServerInfo [id=leader, isVoting=true]]]] 
09:25:13,817 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Updated server config: isVoting: false, peers: [PeerInfo [id=leader, address=null, votingState=VOTING]]
09:25:13,817 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Log size is now 1
09:25:13,817 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Commit index set to 0
09:25:13,817 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): handleAppendEntries returning : AppendEntriesReply [term=1, success=true, followerId=new-server, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=true, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
09:25:13,817 AM [test-akka.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - new-server: Lagging 0 entries behind leader leader and reached 0 (of expected -1)
09:25:13,817 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
09:25:13,817 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Setting last applied to 0
09:25:13,817 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Moving last applied index from -1 to 0
09:25:13,817 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for new-server updated: matchIndex: 0, nextIndex: 1
09:25:13,817 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Applying state for log index 0 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=false], ServerInfo [id=leader, isVoting=true]]]
09:25:13,817 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower new-server: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:25:13,818 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=false], ServerInfo [id=leader, isVoting=true]]]]
09:25:13,818 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Persisting ApplyJournalEntries with index=0
[WARN] [04/25/2024 09:25:13.818] [test-akka.actor.default-dispatcher-17] [akka://test/user/new-server199] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@3ad104d0
09:25:13,933 AM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - new-server: Lagging 0 entries behind leader leader and reached 0 (of expected -1)
09:25:14,53 AM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - new-server: Lagging 0 entries behind leader leader and reached 0 (of expected -1)
09:25:14,173 AM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - new-server: Lagging 0 entries behind leader leader and reached 0 (of expected -1)
09:25:14,293 AM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - new-server: Lagging 0 entries behind leader leader and reached 0 (of expected -1)
09:25:14,370 AM [main] [DEBUG] RaftActorServerConfigurationSupportTest - new-server2: Set currentTerm=1, votedFor=leader
09:25:14,370 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupport - leader: onAddServer: AddServer [newServerId=new-server2, newServerAddress=akka://test/user/follower197, votingMember=false], state: Idle
09:25:14,370 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupport - leader: Initiating AddServer [newServerId=new-server2, newServerAddress=akka://test/user/follower197, votingMember=false]
09:25:14,370 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupport - leader: New follower is non-voting - directly persisting new server configuration
09:25:14,370 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupport - leader: New server configuration : [ServerInfo [id=new-server, isVoting=false], ServerInfo [id=new-server2, isVoting=false], ServerInfo [id=leader, isVoting=true]]
09:25:14,370 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=false], ServerInfo [id=new-server2, isVoting=false], ServerInfo [id=leader, isVoting=true]]]]
09:25:14,371 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=false], ServerInfo [id=new-server2, isVoting=false], ServerInfo [id=leader, isVoting=true]]]] 
09:25:14,371 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=7493e020-75a8-475e-8b51-0ab49a72864a}, logIndex: 1, payload: class org.opendaylight.controller.cluster.raft.persisted.ServerConfigurationPayload, isSendImmediate: true
09:25:14,371 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Setting last applied to 1
09:25:14,371 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Moving last applied index from 0 to 1
09:25:14,371 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Applying state for log index 1 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=false], ServerInfo [id=new-server2, isVoting=false], ServerInfo [id=leader, isVoting=true]]]
09:25:14,371 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower new-server: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1
09:25:14,371 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): sendAppendEntries: 1 is present for follower new-server
09:25:14,371 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Sending AppendEntries to follower new-server: AppendEntries [leaderId=leader, prevLogIndex=0, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=1, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=false], ServerInfo [id=new-server2, isVoting=false], ServerInfo [id=leader, isVoting=true]]]]]]
09:25:14,371 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower new-server2: active: false, followerNextIndex: 0, leaderLastIndex: 1, leaderSnapShotIndex: -1
09:25:14,371 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupport - leader: Returning OK for operation AddServer [newServerId=new-server2, newServerAddress=akka://test/user/follower197, votingMember=false]
09:25:14,372 AM [test-akka.actor.default-dispatcher-11] [INFO] RaftActorServerConfigurationSupport - leader: ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=false], ServerInfo [id=new-server2, isVoting=false], ServerInfo [id=leader, isVoting=true]]] has been successfully replicated to a majority of followers
09:25:14,372 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persisting ApplyJournalEntries with index=1
09:25:14,372 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): handleAppendEntries: AppendEntries [leaderId=leader, prevLogIndex=0, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=1, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=false], ServerInfo [id=new-server2, isVoting=false], ServerInfo [id=leader, isVoting=true]]]]]]
09:25:14,372 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Number of entries to be appended = 1
09:25:14,372 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): After cleanup, lastIndex: 0, entries to be added from: 0
09:25:14,372 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Append entry to log ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=false], ServerInfo [id=new-server2, isVoting=false], ServerInfo [id=leader, isVoting=true]]]
09:25:14,372 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=false], ServerInfo [id=new-server2, isVoting=false], ServerInfo [id=leader, isVoting=true]]]] 
09:25:14,372 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Updated server config: isVoting: false, peers: [PeerInfo [id=leader, address=null, votingState=VOTING], PeerInfo [id=new-server2, address=null, votingState=NON_VOTING]]
09:25:14,372 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Log size is now 2
09:25:14,372 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Commit index set to 1
09:25:14,372 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): handleAppendEntries returning : AppendEntriesReply [term=1, success=true, followerId=new-server, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=true, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
09:25:14,372 AM [test-akka.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - new-server: Lagging 0 entries behind leader leader and reached 1 (of expected -1)
09:25:14,372 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 1
09:25:14,372 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Setting last applied to 1
09:25:14,372 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Moving last applied index from 0 to 1
09:25:14,372 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Applying state for log index 1 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=false], ServerInfo [id=new-server2, isVoting=false], ServerInfo [id=leader, isVoting=true]]]
09:25:14,373 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for new-server updated: matchIndex: 1, nextIndex: 2
09:25:14,373 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower new-server: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1
09:25:14,373 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=false], ServerInfo [id=new-server2, isVoting=false], ServerInfo [id=leader, isVoting=true]]]]
09:25:14,373 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=false], ServerInfo [id=new-server2, isVoting=false], ServerInfo [id=leader, isVoting=true]]]]
09:25:14,373 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Persisting ApplyJournalEntries with index=1
09:25:14,374 AM [test-akka.actor.default-dispatcher-16] [ERROR] OneForOneStrategy - Cannot invoke "org.opendaylight.controller.cluster.raft.ReplicatedLog.lastIndex()" because the return value of "org.opendaylight.controller.cluster.raft.RaftActorContext.getReplicatedLog()" is null
java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.raft.ReplicatedLog.lastIndex()" because the return value of "org.opendaylight.controller.cluster.raft.RaftActorContext.getReplicatedLog()" is null
	at org.opendaylight.controller.cluster.raft.behaviors.AbstractRaftActorBehavior.lastIndex(AbstractRaftActorBehavior.java:315)
	at org.opendaylight.controller.cluster.raft.behaviors.Follower.isOutOfSync(Follower.java:342)
	at org.opendaylight.controller.cluster.raft.behaviors.Follower.handleAppendEntries(Follower.java:177)
	at org.opendaylight.controller.cluster.raft.behaviors.AbstractRaftActorBehavior.appendEntries(AbstractRaftActorBehavior.java:142)
	at org.opendaylight.controller.cluster.raft.behaviors.AbstractRaftActorBehavior.handleMessage(AbstractRaftActorBehavior.java:415)
	at org.opendaylight.controller.cluster.raft.behaviors.Follower.handleMessage(Follower.java:485)
	at org.opendaylight.controller.cluster.raft.utils.ForwardMessageToBehaviorActor.onReceive(ForwardMessageToBehaviorActor.java:25)
	at akka.actor.UntypedAbstractActor$$anonfun$receive$1.applyOrElse(AbstractActor.scala:332)
	at akka.actor.Actor.aroundReceive(Actor.scala:537)
	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579)
	at akka.actor.ActorCell.invoke(ActorCell.scala:547)
	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
	at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373)
	at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182)
	at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655)
	at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622)
	at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165)
[ERROR] [04/25/2024 09:25:14.373] [test-akka.actor.internal-dispatcher-2] [akka://test/user/follower197] Cannot invoke "org.opendaylight.controller.cluster.raft.ReplicatedLog.lastIndex()" because the return value of "org.opendaylight.controller.cluster.raft.RaftActorContext.getReplicatedLog()" is null
java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.raft.ReplicatedLog.lastIndex()" because the return value of "org.opendaylight.controller.cluster.raft.RaftActorContext.getReplicatedLog()" is null
	at org.opendaylight.controller.cluster.raft.behaviors.AbstractRaftActorBehavior.lastIndex(AbstractRaftActorBehavior.java:315)
	at org.opendaylight.controller.cluster.raft.behaviors.Follower.isOutOfSync(Follower.java:342)
	at org.opendaylight.controller.cluster.raft.behaviors.Follower.handleAppendEntries(Follower.java:177)
	at org.opendaylight.controller.cluster.raft.behaviors.AbstractRaftActorBehavior.appendEntries(AbstractRaftActorBehavior.java:142)
	at org.opendaylight.controller.cluster.raft.behaviors.AbstractRaftActorBehavior.handleMessage(AbstractRaftActorBehavior.java:415)
	at org.opendaylight.controller.cluster.raft.behaviors.Follower.handleMessage(Follower.java:485)
	at org.opendaylight.controller.cluster.raft.utils.ForwardMessageToBehaviorActor.onReceive(ForwardMessageToBehaviorActor.java:25)
	at akka.actor.UntypedAbstractActor$$anonfun$receive$1.applyOrElse(AbstractActor.scala:332)
	at akka.actor.Actor.aroundReceive(Actor.scala:537)
	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579)
	at akka.actor.ActorCell.invoke(ActorCell.scala:547)
	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
	at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373)
	at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182)
	at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655)
	at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622)
	at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165)

09:25:14,422 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testAddServersAsNonVoting ending
09:25:14,422 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower197]
09:25:14,434 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/new-serverCollector198#872724339]
09:25:14,434 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/new-server199]
09:25:14,434 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader200]
09:25:14,434 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leaderCollector201]
09:25:14,537 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testAddServerWithPriorSnapshotInProgress starting
[WARN] [04/25/2024 09:25:14.539] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/new-server204]: org.opendaylight.controller.cluster.common.actor.Monitor@5973cd54
09:25:14,540 AM [test-akka.actor.default-dispatcher-11] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - Starting recovery for new-server with journal batch size 1000
[WARN] [04/25/2024 09:25:14.541] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader205]: org.opendaylight.controller.cluster.common.actor.Monitor@20cc1f00
09:25:14,541 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Moving last applied index from -1 to -1
09:25:14,541 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Set currentTerm=1, votedFor=
09:25:14,541 AM [test-akka.actor.default-dispatcher-6] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:14,541 AM [test-akka.actor.default-dispatcher-11] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - Starting recovery for leader with journal batch size 1000
09:25:14,542 AM [test-akka.actor.default-dispatcher-6] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy
09:25:14,543 AM [test-akka.actor.default-dispatcher-6] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:14,543 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Election: Leader has following peers: []
09:25:14,642 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - Take a snapshot of current state. lastReplicatedLog is null and replicatedToAllIndex is -1
09:25:14,642 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead.
09:25:14,642 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=true]
09:25:14,642 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: lastSequenceNumber prior to capture: -1
09:25:14,642 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: CaptureSnapshotReply received by actor
09:25:14,642 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=, ServerConfigPayload=null]
09:25:14,642 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: user triggered or root overwrite snapshot encountered, trimming log up to last applied index -1
09:25:14,642 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1
09:25:14,642 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Snapshot success -  sequence number: -1
09:25:14,642 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: SnapshotComplete received
09:25:14,702 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupport - leader: onAddServer: AddServer [newServerId=new-server, newServerAddress=akka://test/user/new-server204, votingMember=true], state: Idle
09:25:14,703 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupport - leader: Initiating AddServer [newServerId=new-server, newServerAddress=akka://test/user/new-server204, votingMember=true]
09:25:14,703 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead.
09:25:14,703 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] to install on new-server
09:25:14,703 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: lastSequenceNumber prior to capture: -1
09:25:14,703 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupport - leader: Initiating capture snapshot for new server new-server
09:25:14,703 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - commit should not be called in state Creating
09:25:14,703 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: CaptureSnapshotReply received by actor
09:25:14,703 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=, ServerConfigPayload=null]
09:25:14,703 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1
09:25:14,703 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): sendInstallSnapshot
09:25:14,703 AM [test-akka.actor.default-dispatcher-13] [DEBUG] LeaderInstallSnapshotState - leader (Leader): Snapshot 171 bytes, total chunks to send: 1
09:25:14,703 AM [test-akka.actor.default-dispatcher-13] [DEBUG] LeaderInstallSnapshotState - leader (Leader): Next chunk: total length=171, offset=0, size=171, hashCode=-2041399403
09:25:14,703 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): next snapshot chunk size for follower new-server: 171
09:25:14,704 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): InstallSnapshot sent to follower Vector(user, new-server204), Chunk: 1/1
09:25:14,704 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Snapshot success -  sequence number: -1
09:25:14,704 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: SnapshotComplete received
09:25:14,704 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Term 1 in "InstallSnapshot [term=1, leaderId=leader, lastIncludedIndex=-1, lastIncludedTerm=-1, datasize=171, Chunk=1/1, lastChunkHashCode=OptionalInt[-1], serverConfig=null]" message is greater than follower's term 0 - updating term
09:25:14,704 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Set currentTerm=1, votedFor=null
09:25:14,704 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): handleInstallSnapshot: InstallSnapshot [term=1, leaderId=leader, lastIncludedIndex=-1, lastIncludedTerm=-1, datasize=171, Chunk=1/1, lastChunkHashCode=OptionalInt[-1], serverConfig=null]
09:25:14,704 AM [test-akka.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - new-server: Last sync leader does not match current leader leader, need to catch up to -1
09:25:14,704 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - addChunk: chunkIndex=1, lastChunkIndex=0, collectedChunks.size=0, lastChunkHashCode=-1
09:25:14,704 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Snapshot installed from leader: leader
09:25:14,705 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Applying snapshot on follower:  Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=null, ServerConfigPayload=null]
09:25:14,705 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - lastSequenceNumber prior to persisting applied snapshot: -1
09:25:14,706 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Snapshot success -  sequence number: -1
09:25:14,706 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Moving last applied index from -1 to -1
09:25:14,706 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Set currentTerm=1, votedFor=null
09:25:14,706 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: applySnapshot called
[WARN] [04/25/2024 09:25:14.705] [test-akka.actor.default-dispatcher-14] [akka://test/user/new-server204] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@802230f
09:25:14,706 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): handleInstallSnapshot returning: InstallSnapshotReply [term=1, followerId=new-server, chunkIndex=1, success=true]
09:25:14,706 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): handleInstallSnapshotReply: InstallSnapshotReply [term=1, followerId=new-server, chunkIndex=1, success=true]
09:25:14,706 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Snapshot successfully installed on follower new-server (last chunk 1) - matchIndex set to -1, nextIndex set to 0
09:25:14,706 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - Sent message UnInitializedFollowerSnapshotReply to self
09:25:14,706 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: SnapshotComplete received
09:25:14,706 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupport - leader: onUnInitializedFollowerSnapshotReply: UnInitializedFollowerSnapshotReply [followerId=new-server]
09:25:14,706 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupport - leader: New server configuration : [ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]
09:25:14,706 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]
09:25:14,706 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]] 
09:25:14,706 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=ea20962e-aebf-42b7-ad6a-3f699ef7e887}, logIndex: 0, payload: class org.opendaylight.controller.cluster.raft.persisted.ServerConfigurationPayload, isSendImmediate: true
09:25:14,707 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:25:14,707 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower new-server: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:25:14,707 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): sendAppendEntries: 0 is present for follower new-server
09:25:14,707 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Sending AppendEntries to follower new-server: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]]]
09:25:14,707 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupport - leader: Returning OK for operation AddServer [newServerId=new-server, newServerAddress=akka://test/user/new-server204, votingMember=true]
09:25:14,707 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): handleAppendEntries: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]]]
09:25:14,707 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Number of entries to be appended = 1
09:25:14,707 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
09:25:14,707 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Append entry to log ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]
09:25:14,707 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]] 
09:25:14,707 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Updated server config: isVoting: true, peers: [PeerInfo [id=leader, address=null, votingState=VOTING]]
09:25:14,707 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Log size is now 1
09:25:14,708 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): handleAppendEntries returning : AppendEntriesReply [term=1, success=true, followerId=new-server, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=true, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
09:25:14,708 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]
09:25:14,708 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - new-server: Lagging 0 entries behind leader leader and reached -1 (of expected -1)
09:25:14,708 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for new-server updated: matchIndex: 0, nextIndex: 1
09:25:14,708 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1
09:25:14,708 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Setting last applied to 0
09:25:14,708 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Moving last applied index from -1 to 0
09:25:14,708 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Applying state for log index 0 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]
09:25:14,708 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower new-server: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:25:14,708 AM [test-akka.actor.default-dispatcher-16] [INFO] RaftActorServerConfigurationSupport - leader: ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]] has been successfully replicated to a majority of followers
09:25:14,708 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persisting ApplyJournalEntries with index=0
09:25:14,709 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]
09:25:14,709 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Commit index set to 0
09:25:14,709 AM [test-akka.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - new-server: Lagging 0 entries behind leader leader and reached 0 (of expected -1)
09:25:14,709 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
09:25:14,709 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Setting last applied to 0
09:25:14,709 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Moving last applied index from -1 to 0
[WARN] [04/25/2024 09:25:14.709] [test-akka.actor.default-dispatcher-6] [akka://test/user/new-server204] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@244dcf0a
09:25:14,709 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Applying state for log index 0 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]
09:25:14,709 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Persisting ApplyJournalEntries with index=0
09:25:14,712 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testAddServerWithPriorSnapshotInProgress ending
09:25:14,713 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower202]
09:25:14,724 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/new-serverCollector203#2043610382]
09:25:14,724 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/new-server204]
09:25:14,724 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader205]
09:25:14,725 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leaderCollector206]
09:25:14,727 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testChangeLeaderToNonVotingInSingleNode starting
[WARN] [04/25/2024 09:25:14.728] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader208]: org.opendaylight.controller.cluster.common.actor.Monitor@5b52a323
09:25:14,729 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Moving last applied index from -1 to -1
09:25:14,729 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Set currentTerm=1, votedFor=
09:25:14,729 AM [test-akka.actor.default-dispatcher-11] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - Starting recovery for leader with journal batch size 1000
09:25:14,731 AM [test-akka.actor.default-dispatcher-11] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:14,732 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Election: Leader has following peers: []
09:25:14,740 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupport - leader: onChangeServersVotingStatus: ChangeServersVotingStatus [serverVotingStatusMap={leader=false}, serversVisited=[]], state: Idle
09:25:14,740 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupport - Initiating ChangeServersVotingStatusState
09:25:14,740 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupport - leader: Returning INVALID_REQUEST for operation ChangeServersVotingStatus [serverVotingStatusMap={leader=false}, serversVisited=[]]
09:25:14,740 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testChangeLeaderToNonVotingInSingleNode ending
09:25:14,740 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower207]
09:25:14,751 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader208]
09:25:14,855 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testChangeLeaderToNonVoting starting
[WARN] [04/25/2024 09:25:14.856] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader212]: org.opendaylight.controller.cluster.common.actor.Monitor@596383d1
09:25:14,857 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Moving last applied index from -1 to -1
09:25:14,857 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Set currentTerm=1, votedFor=
09:25:14,857 AM [test-akka.actor.default-dispatcher-14] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - Starting recovery for leader with journal batch size 1000
09:25:14,859 AM [test-akka.actor.default-dispatcher-14] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:14,860 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Election: Leader has following peers: [follower2, follower]
09:25:14,860 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower2: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:25:14,860 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [04/25/2024 09:25:14.860] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower210]: org.opendaylight.controller.cluster.common.actor.Monitor@61db4050
[WARN] [04/25/2024 09:25:14.860] [test-akka.actor.default-dispatcher-6] [akka://test/user/follower2211] received dead letter from TestActor[akka://test/user/leader212]: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[]]
09:25:14,861 AM [test-akka.actor.default-dispatcher-11] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - Starting recovery for follower with journal batch size 1000
09:25:14,862 AM [test-akka.actor.default-dispatcher-17] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [04/25/2024 09:25:14.862] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower2211]: org.opendaylight.controller.cluster.common.actor.Monitor@3e8cbc48
09:25:14,863 AM [test-akka.actor.default-dispatcher-17] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): Term 1 in "AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 0 - updating term
09:25:14,863 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: Set currentTerm=1, votedFor=null
09:25:14,863 AM [test-akka.actor.default-dispatcher-11] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - Starting recovery for follower2 with journal batch size 1000
09:25:14,863 AM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower: Last sync leader does not match current leader leader, need to catch up to -1
09:25:14,863 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for follower updated: matchIndex: -1, nextIndex: 0
09:25:14,863 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:25:14,864 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [04/25/2024 09:25:14.864] [test-akka.actor.default-dispatcher-6] [akka://test/user/follower210] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@54b7c873
09:25:14,874 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupport - leader: onChangeServersVotingStatus: ChangeServersVotingStatus [serverVotingStatusMap={leader=false}, serversVisited=[]], state: Idle
09:25:14,874 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupport - Initiating ChangeServersVotingStatusState
09:25:14,874 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Updated server config: isVoting: false, peers: [PeerInfo [id=follower2, address=akka://test/user/follower2211, votingState=VOTING], PeerInfo [id=follower, address=akka://test/user/follower210, votingState=VOTING]]
09:25:14,874 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupport - leader: New server configuration : [ServerInfo [id=follower2, isVoting=true], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=false]]
09:25:14,874 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=true], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=false]]]]
09:25:14,874 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=true], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=false]]]] 
09:25:14,874 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=e2b41d4c-919a-4c42-8745-98aa4656ef63}, logIndex: 0, payload: class org.opendaylight.controller.cluster.raft.persisted.ServerConfigurationPayload, isSendImmediate: true
09:25:14,874 AM [test-akka.actor.default-dispatcher-6] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:25:14,875 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower2: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:25:14,875 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:25:14,875 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): sendAppendEntries: 0 is present for follower follower
09:25:14,875 AM [test-akka.actor.default-dispatcher-11] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): Term 1 in "AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 0 - updating term
09:25:14,875 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2: Set currentTerm=1, votedFor=null
09:25:14,875 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Sending AppendEntries to follower follower: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=true], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=false]]]]]]
09:25:14,875 AM [test-akka.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower2: Last sync leader does not match current leader leader, need to catch up to -1
09:25:14,875 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupport - leader: Returning OK for operation ChangeServersVotingStatus [serverVotingStatusMap={leader=false}, serversVisited=[]]
09:25:14,875 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): handleAppendEntries: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=true], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=false]]]]]]
09:25:14,875 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): Number of entries to be appended = 1
09:25:14,875 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
09:25:14,875 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): Append entry to log ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=true], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=false]]]
09:25:14,875 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=true], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=false]]]] 
09:25:14,875 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for follower2 updated: matchIndex: -1, nextIndex: 0
09:25:14,875 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower2: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:25:14,875 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): sendAppendEntries: 0 is present for follower follower2
09:25:14,875 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: Updated server config: isVoting: true, peers: [PeerInfo [id=leader, address=akka://test/user/leader212, votingState=NON_VOTING], PeerInfo [id=follower2, address=akka://test/user/follower2211, votingState=VOTING]]
09:25:14,875 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): Log size is now 1
09:25:14,875 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): handleAppendEntries returning : AppendEntriesReply [term=1, success=true, followerId=follower, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
09:25:14,875 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Sending AppendEntries to follower follower2: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=true], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=false]]]]]]
09:25:14,875 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower: Lagging 0 entries behind leader leader and reached -1 (of expected -1)
09:25:14,875 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for follower updated: matchIndex: 0, nextIndex: 1
09:25:14,875 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:25:14,876 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): handleAppendEntries: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=true], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=false]]]]]]
09:25:14,876 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): Number of entries to be appended = 1
09:25:14,876 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=true], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=false]]]]
09:25:14,876 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=true], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=false]]]]
09:25:14,876 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
09:25:14,876 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1
09:25:14,876 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): Append entry to log ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=true], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=false]]]
09:25:14,876 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Setting last applied to 0
09:25:14,876 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=true], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=false]]]] 
09:25:14,876 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Moving last applied index from -1 to 0
09:25:14,876 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Applying state for log index 0 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=true], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=false]]]
[WARN] [04/25/2024 09:25:14.876] [test-akka.actor.default-dispatcher-17] [akka://test/user/follower2211] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@101e2bd1
09:25:14,877 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2: Updated server config: isVoting: true, peers: [PeerInfo [id=leader, address=akka://test/user/leader212, votingState=NON_VOTING], PeerInfo [id=follower, address=akka://test/user/follower210, votingState=VOTING]]
[WARN] [04/25/2024 09:25:14.877] [test-akka.actor.default-dispatcher-17] [akka://test/user/follower210] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@225b5a86
09:25:14,877 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupport - leader: ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=true], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=false]]] has been successfully replicated to a majority of followers
09:25:14,877 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): Log size is now 1
09:25:14,877 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupport - Leader changed to non-voting - trying leadership transfer
09:25:14,877 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): handleAppendEntries returning : AppendEntriesReply [term=1, success=true, followerId=follower2, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
09:25:14,877 AM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower2: Lagging 0 entries behind leader leader and reached -1 (of expected -1)
09:25:14,877 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Initiating leader transfer
09:25:14,877 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorLeadershipTransferCohort - leader: pauseLeader successfully completed - doing transfer
09:25:14,877 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Attempting to transfer leadership
09:25:14,877 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower2: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:25:14,877 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): sendAppendEntries: 0 is present for follower follower2
09:25:14,877 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: onLeaderTransitioning: LeaderTransitioning [leaderId=leader]
09:25:14,877 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Sending AppendEntries to follower follower2: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=true], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=false]]]]]]
09:25:14,877 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=true], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=false]]]]
09:25:14,877 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:25:14,877 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2: onLeaderTransitioning: LeaderTransitioning [leaderId=leader]
09:25:14,877 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persisting ApplyJournalEntries with index=0
09:25:14,878 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): handleAppendEntries: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=true], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=false]]]]]]
09:25:14,878 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): Number of entries to be appended = 1
09:25:14,878 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): matchEntry SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=true], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=false]]]] is present: existingEntryTerm: 1
09:25:14,878 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): Commit index set to 0
09:25:14,878 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): After cleanup, lastIndex: 0, entries to be added from: 1
09:25:14,878 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): Log size is now 1
09:25:14,878 AM [test-akka.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower: Lagging 0 entries behind leader leader and reached 0 (of expected -1)
09:25:14,878 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): Commit index set to 0
09:25:14,878 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
09:25:14,878 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): handleAppendEntries returning : AppendEntriesReply [term=1, success=true, followerId=follower2, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
09:25:14,878 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): Setting last applied to 0
09:25:14,878 AM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower2: Lagging 0 entries behind leader leader and reached 0 (of expected -1)
09:25:14,878 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: Moving last applied index from -1 to 0
09:25:14,878 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
09:25:14,878 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): Setting last applied to 0
09:25:14,878 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: Applying state for log index 0 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=true], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=false]]]
09:25:14,878 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2: Moving last applied index from -1 to 0
09:25:14,878 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2: Applying state for log index 0 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=true], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=false]]]
09:25:14,878 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: Persisting ApplyJournalEntries with index=0
09:25:14,878 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for follower2 updated: matchIndex: 0, nextIndex: 1
09:25:14,878 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2: Persisting ApplyJournalEntries with index=0
[WARN] [04/25/2024 09:25:14.878] [test-akka.actor.default-dispatcher-6] [akka://test/user/follower2211] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@15d97de3
09:25:14,878 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower2: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:25:14,878 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): tryToCompleteLeadershipTransfer: followerId: follower2, matchIndex: 0, lastIndex: 0, isVoting: true
09:25:14,878 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Follower's log matches - sending ElectionTimeout
09:25:14,878 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower2: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:25:14,878 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:25:14,878 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower2: Lagging 0 entries behind leader leader and reached 0 (of expected -1)
09:25:14,878 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Leader transfer complete
09:25:14,878 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorLeadershipTransferCohort - leader: leader transfer complete - waiting for new leader
09:25:14,878 AM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower: Lagging 0 entries behind leader leader and reached 0 (of expected -1)
09:25:14,878 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:25:14,878 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): Received TimeoutNow - switching to Candidate
09:25:14,878 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Candidate): Election: Candidate has following voting peers: [follower]
09:25:14,878 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2: Set currentTerm=2, votedFor=follower2
09:25:14,879 AM [test-akka.actor.default-dispatcher-14] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Candidate): Starting new election term 2
09:25:14,879 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Candidate): Sending RequestVote [term=2, candidateId=follower2, lastLogIndex=0, lastLogTerm=1] to peer follower
09:25:14,879 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:25:14,879 AM [test-akka.actor.default-dispatcher-14] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
09:25:14,879 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): Cluster state: []
09:25:14,879 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=follower2, lastLogIndex=0, lastLogTerm=1] with higher term appears reachable, updating term.
09:25:14,879 AM [test-akka.actor.default-dispatcher-11] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): Term 2 in "RequestVote [term=2, candidateId=follower2, lastLogIndex=0, lastLogTerm=1]" message is greater than follower's term 1 - updating term
09:25:14,879 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: Set currentTerm=2, votedFor=null
09:25:14,879 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): In requestVote:  RequestVote [term=2, candidateId=follower2, lastLogIndex=0, lastLogTerm=1] - currentTerm: 2, votedFor: null, lastIndex: 0, lastTerm: 1
09:25:14,879 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: Set currentTerm=2, votedFor=follower2
09:25:14,879 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true]
09:25:14,881 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Candidate): RaftRPC message received RequestVoteReply [term=2, voteGranted=true], my term is 2
09:25:14,881 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Candidate): handleRequestVoteReply: RequestVoteReply [term=2, voteGranted=true], current voteCount: 1
09:25:14,881 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Leader): Election: Leader has following peers: [leader, follower]
09:25:14,881 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Leader): Checking sendAppendEntries for follower leader: active: false, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:25:14,882 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Leader): Checking sendAppendEntries for follower follower: active: false, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:25:14,882 AM [test-akka.actor.default-dispatcher-17] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
09:25:14,882 AM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower: Last sync leader does not match current leader follower2, need to catch up to -1
09:25:14,882 AM [test-akka.actor.default-dispatcher-17] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Term 2 in "AppendEntries [leaderId=follower2, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than leader's term 1 - switching to Follower
09:25:14,882 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Set currentTerm=2, votedFor=null
09:25:14,882 AM [test-akka.actor.default-dispatcher-17] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader) :- Switching from behavior Leader to Follower, election term: 2
09:25:14,882 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower updated: matchIndex: 0, nextIndex: 1
09:25:14,882 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Leader): Checking sendAppendEntries for follower follower: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
[WARN] [04/25/2024 09:25:14.882] [test-akka.actor.default-dispatcher-17] [akka://test/user/follower210] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@ee846f9
09:25:14,883 AM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower: Lagging 0 entries behind leader follower2 and reached 0 (of expected -1)
[WARN] [04/25/2024 09:25:14.883] [test-akka.actor.default-dispatcher-17] [akka://test/user/follower210] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@6f49a456
09:25:15,393 AM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - leader: Last sync leader does not match current leader follower2, need to catch up to -1
09:25:15,393 AM [test-akka.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower: Lagging 0 entries behind leader follower2 and reached 0 (of expected -1)
09:25:15,393 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorLeadershipTransferCohort - leader: leader changed to follower2
09:25:15,393 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Leader): handleAppendEntriesReply - FollowerLogInformation for leader updated: matchIndex: 0, nextIndex: 1
09:25:15,393 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Leader): Checking sendAppendEntries for follower leader: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:25:15,393 AM [test-akka.actor.default-dispatcher-17] [INFO] RaftActorLeadershipTransferCohort - leader: Successfully transferred leadership to follower2 in 516.3 ms
09:25:15,393 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: leader transfer succeeded after change to non-voting
09:25:15,394 AM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - leader: Lagging 0 entries behind leader follower2 and reached 0 (of expected -1)
[WARN] [04/25/2024 09:25:15.394] [test-akka.actor.default-dispatcher-14] [akka://test/user/leader212] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@1e847575
[WARN] [04/25/2024 09:25:15.394] [test-akka.actor.default-dispatcher-14] [akka://test/user/leader212] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@44a9121a
09:25:15,428 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testChangeLeaderToNonVoting ending
09:25:15,429 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower209]
09:25:15,440 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader212]
09:25:15,441 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leaderCollector213]
09:25:15,441 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/collector214#-308030424]
09:25:15,441 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower210]
09:25:15,441 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/collector215#1719415094]
09:25:15,441 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower2211]
09:25:15,543 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testOnApplyState starting
[WARN] [04/25/2024 09:25:15.545] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader217]: org.opendaylight.controller.cluster.common.actor.Monitor@298422e6
09:25:15,545 AM [test-akka.actor.default-dispatcher-14] [INFO] MockRaftActor - Starting recovery for leader with journal batch size 1000
09:25:15,547 AM [test-akka.actor.default-dispatcher-5] [INFO] MockRaftActor - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:15,644 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testOnApplyState ending
09:25:15,644 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower216]
09:25:15,655 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader217]
09:25:15,758 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testRemoveServer starting
[WARN] [04/25/2024 09:25:15.759] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader221]: org.opendaylight.controller.cluster.common.actor.Monitor@6848a99c
09:25:15,760 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Moving last applied index from -1 to -1
09:25:15,760 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Set currentTerm=1, votedFor=
09:25:15,760 AM [test-akka.actor.default-dispatcher-14] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - Starting recovery for leader with journal batch size 1000
09:25:15,761 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:15,762 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Election: Leader has following peers: [follower2, follower, downNode]
09:25:15,762 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower2: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:25:15,762 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:25:15,762 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower downNode: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [04/25/2024 09:25:15.762] [test-akka.actor.default-dispatcher-14] [akka://test/user/follower2220] received dead letter from TestActor[akka://test/user/leader221]: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[]]
[WARN] [04/25/2024 09:25:15.762] [test-akka.actor.default-dispatcher-14] [akka://test/user/follower219] received dead letter from TestActor[akka://test/user/leader221]: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[]]
[WARN] [04/25/2024 09:25:15.763] [test-akka.actor.default-dispatcher-14] [akka://test/] unhandled message from TestActor[akka://test/user/leader221]: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[]]
[WARN] [04/25/2024 09:25:15.861] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower219]: org.opendaylight.controller.cluster.common.actor.Monitor@26442fc2
09:25:15,862 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - Starting recovery for follower with journal batch size 1000
09:25:15,864 AM [test-akka.actor.default-dispatcher-16] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:15,883 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): Term 1 in "AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 0 - updating term
09:25:15,883 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: Set currentTerm=1, votedFor=null
09:25:15,883 AM [test-akka.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower: Last sync leader does not match current leader leader, need to catch up to -1
09:25:15,883 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for follower updated: matchIndex: -1, nextIndex: 0
09:25:15,883 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [04/25/2024 09:25:15.883] [test-akka.actor.default-dispatcher-5] [akka://test/] unhandled message from TestActor[akka://test/user/leader221]: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[]]
[WARN] [04/25/2024 09:25:15.884] [test-akka.actor.default-dispatcher-16] [akka://test/user/follower219] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@30c1b0ce
09:25:15,887 AM [test-akka.actor.default-dispatcher-14] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - Starting recovery for follower2 with journal batch size 1000
[WARN] [04/25/2024 09:25:15.887] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower2220]: org.opendaylight.controller.cluster.common.actor.Monitor@5eb8d2ad
09:25:15,893 AM [test-akka.actor.default-dispatcher-12] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:15,894 AM [test-akka.actor.default-dispatcher-12] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): Term 1 in "AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 0 - updating term
09:25:15,894 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2: Set currentTerm=1, votedFor=null
09:25:15,894 AM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower2: Last sync leader does not match current leader leader, need to catch up to -1
09:25:15,894 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for follower2 updated: matchIndex: -1, nextIndex: 0
09:25:15,894 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower2: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [04/25/2024 09:25:15.895] [test-akka.actor.default-dispatcher-12] [akka://test/user/follower2220] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@76fe99cc
09:25:15,975 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupport - leader: onRemoveServer: RemoveServer{serverId='follower'}, state: Idle
09:25:15,975 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupport - leader: New server configuration : [ServerInfo [id=follower2, isVoting=true], ServerInfo [id=downNode, isVoting=true], ServerInfo [id=leader, isVoting=true]]
09:25:15,975 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=true], ServerInfo [id=downNode, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]
09:25:15,975 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=true], ServerInfo [id=downNode, isVoting=true], ServerInfo [id=leader, isVoting=true]]]] 
09:25:15,975 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=f4457018-9b3f-413c-b486-6ec4616e4de6}, logIndex: 0, payload: class org.opendaylight.controller.cluster.raft.persisted.ServerConfigurationPayload, isSendImmediate: true
09:25:15,975 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:25:15,975 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower2: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:25:15,975 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): sendAppendEntries: 0 is present for follower follower2
09:25:15,976 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Sending AppendEntries to follower follower2: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=true], ServerInfo [id=downNode, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]]]
09:25:15,976 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower downNode: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:25:15,976 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupport - leader: Returning OK for operation RemoveServer{serverId='follower'}
[WARN] [04/25/2024 09:25:15.976] [test-akka.actor.default-dispatcher-12] [akka://test/] unhandled message from TestActor[akka://test/user/leader221]: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[]]
09:25:15,976 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): handleAppendEntries: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=true], ServerInfo [id=downNode, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]]]
09:25:15,976 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): Number of entries to be appended = 1
09:25:15,976 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
09:25:15,976 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): Append entry to log ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=true], ServerInfo [id=downNode, isVoting=true], ServerInfo [id=leader, isVoting=true]]]
09:25:15,976 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=true], ServerInfo [id=downNode, isVoting=true], ServerInfo [id=leader, isVoting=true]]]] 
09:25:15,976 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2: Updated server config: isVoting: true, peers: [PeerInfo [id=leader, address=akka://test/user/leader221, votingState=VOTING], PeerInfo [id=downNode, address=, votingState=VOTING]]
09:25:15,976 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): Log size is now 1
09:25:15,976 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): handleAppendEntries returning : AppendEntriesReply [term=1, success=true, followerId=follower2, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
09:25:15,976 AM [test-akka.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower2: Lagging 0 entries behind leader leader and reached -1 (of expected -1)
09:25:15,977 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for follower2 updated: matchIndex: 0, nextIndex: 1
09:25:15,977 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower2: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:25:15,977 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=true], ServerInfo [id=downNode, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]
09:25:15,977 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1
09:25:15,977 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Setting last applied to 0
09:25:15,977 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Moving last applied index from -1 to 0
09:25:15,977 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=true], ServerInfo [id=downNode, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]
09:25:15,977 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Applying state for log index 0 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=true], ServerInfo [id=downNode, isVoting=true], ServerInfo [id=leader, isVoting=true]]]
09:25:15,977 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupport - leader: ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=true], ServerInfo [id=downNode, isVoting=true], ServerInfo [id=leader, isVoting=true]]] has been successfully replicated to a majority of followers
[WARN] [04/25/2024 09:25:15.977] [test-akka.actor.default-dispatcher-12] [akka://test/user/follower2220] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@7aa53421
09:25:15,977 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persisting ApplyJournalEntries with index=0
[WARN] [04/25/2024 09:25:15.977] [test-akka.actor.default-dispatcher-11] [akka://test/user/follower219] unhandled message from TestActor[akka://test/user/leader221]: ServerRemoved [serverId=follower]
[WARN] [04/25/2024 09:25:16.003] [test-akka.actor.default-dispatcher-12] [akka://test/] unhandled message from TestActor[akka://test/user/leader221]: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[]]
09:25:16,123 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): Commit index set to 0
09:25:16,123 AM [test-akka.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower2: Lagging 0 entries behind leader leader and reached 0 (of expected -1)
09:25:16,123 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
[WARN] [04/25/2024 09:25:16.123] [test-akka.actor.default-dispatcher-11] [akka://test/] unhandled message from TestActor[akka://test/user/leader221]: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[]]
09:25:16,123 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): Setting last applied to 0
09:25:16,124 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2: Moving last applied index from -1 to 0
09:25:16,124 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2: Applying state for log index 0 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=true], ServerInfo [id=downNode, isVoting=true], ServerInfo [id=leader, isVoting=true]]]
09:25:16,124 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2: Persisting ApplyJournalEntries with index=0
09:25:16,128 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testRemoveServer ending
09:25:16,128 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower218]
09:25:16,139 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader221]
09:25:16,139 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leaderCollector222]
09:25:16,140 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/collector223#1617072712]
09:25:16,140 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower219]
09:25:16,140 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/collector224#1276064866]
09:25:16,141 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower2220]
09:25:16,143 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testAddServerWithNoLeader starting
[WARN] [04/25/2024 09:25:16.144] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/new-server227]: org.opendaylight.controller.cluster.common.actor.Monitor@6a82012a
09:25:16,145 AM [test-akka.actor.default-dispatcher-11] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - Starting recovery for new-server with journal batch size 1000
[WARN] [04/25/2024 09:25:16.146] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader228]: org.opendaylight.controller.cluster.common.actor.Monitor@54d39f62
09:25:16,147 AM [test-akka.actor.default-dispatcher-11] [INFO] MockRaftActor - Starting recovery for leader with journal batch size 1000
09:25:16,152 AM [test-akka.actor.default-dispatcher-11] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:16,152 AM [test-akka.actor.default-dispatcher-12] [INFO] MockRaftActor - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:16,152 AM [test-akka.actor.default-dispatcher-11] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy
09:25:16,180 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupport - leader: onAddServer: AddServer [newServerId=new-server, newServerAddress=akka://test/user/new-server227, votingMember=true], state: Idle
09:25:16,180 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupport - leader: No leader - returning NO_LEADER reply
09:25:16,180 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testAddServerWithNoLeader ending
09:25:16,181 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower225]
09:25:16,192 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/new-serverCollector226#767492948]
09:25:16,192 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/new-server227]
09:25:16,193 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader228]
09:25:16,295 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testChangeServersVotingStatus starting
[WARN] [04/25/2024 09:25:16.296] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader232]: org.opendaylight.controller.cluster.common.actor.Monitor@265cd6e5
09:25:16,297 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Moving last applied index from -1 to -1
09:25:16,297 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Set currentTerm=1, votedFor=
09:25:16,297 AM [test-akka.actor.default-dispatcher-14] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - Starting recovery for leader with journal batch size 1000
09:25:16,299 AM [test-akka.actor.default-dispatcher-14] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:16,299 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Election: Leader has following peers: [follower2, follower]
09:25:16,300 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower2: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:25:16,300 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [04/25/2024 09:25:16.300] [test-akka.actor.default-dispatcher-11] [akka://test/user/follower2231] received dead letter from TestActor[akka://test/user/leader232]: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[]]
[WARN] [04/25/2024 09:25:16.300] [test-akka.actor.default-dispatcher-11] [akka://test/user/follower230] received dead letter from TestActor[akka://test/user/leader232]: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[]]
[WARN] [04/25/2024 09:25:16.401] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower230]: org.opendaylight.controller.cluster.common.actor.Monitor@156d23d6
09:25:16,402 AM [test-akka.actor.default-dispatcher-11] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - Starting recovery for follower with journal batch size 1000
09:25:16,403 AM [test-akka.actor.default-dispatcher-14] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [04/25/2024 09:25:16.404] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower2231]: org.opendaylight.controller.cluster.common.actor.Monitor@1eb5da2
09:25:16,404 AM [test-akka.actor.default-dispatcher-11] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - Starting recovery for follower2 with journal batch size 1000
09:25:16,406 AM [test-akka.actor.default-dispatcher-14] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:16,413 AM [test-akka.actor.default-dispatcher-14] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): Term 1 in "AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 0 - updating term
09:25:16,413 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2: Set currentTerm=1, votedFor=null
09:25:16,413 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): Term 1 in "AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 0 - updating term
09:25:16,413 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: Set currentTerm=1, votedFor=null
09:25:16,413 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower2: Last sync leader does not match current leader leader, need to catch up to -1
09:25:16,413 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for follower2 updated: matchIndex: -1, nextIndex: 0
09:25:16,413 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower2: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:25:16,413 AM [test-akka.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower: Last sync leader does not match current leader leader, need to catch up to -1
09:25:16,413 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for follower updated: matchIndex: -1, nextIndex: 0
09:25:16,413 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [04/25/2024 09:25:16.414] [test-akka.actor.default-dispatcher-5] [akka://test/user/follower2231] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@69000c83
[WARN] [04/25/2024 09:25:16.414] [test-akka.actor.default-dispatcher-5] [akka://test/user/follower230] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@3255f786
09:25:16,515 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupport - leader: onChangeServersVotingStatus: ChangeServersVotingStatus [serverVotingStatusMap={follower2=false, follower=false}, serversVisited=[]], state: Idle
09:25:16,515 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupport - Initiating ChangeServersVotingStatusState
09:25:16,515 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Updated server config: isVoting: true, peers: [PeerInfo [id=follower2, address=akka://test/user/follower2231, votingState=NON_VOTING], PeerInfo [id=follower, address=akka://test/user/follower230, votingState=NON_VOTING]]
09:25:16,515 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupport - leader: New server configuration : [ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=false], ServerInfo [id=leader, isVoting=true]]
09:25:16,515 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=false], ServerInfo [id=leader, isVoting=true]]]]
09:25:16,515 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=false], ServerInfo [id=leader, isVoting=true]]]] 
09:25:16,516 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=920b7c1b-626a-4808-91dd-a06fc7460b3e}, logIndex: 0, payload: class org.opendaylight.controller.cluster.raft.persisted.ServerConfigurationPayload, isSendImmediate: true
09:25:16,516 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Setting last applied to 0
09:25:16,516 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Moving last applied index from -1 to 0
09:25:16,516 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Applying state for log index 0 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=false], ServerInfo [id=leader, isVoting=true]]]
09:25:16,516 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower2: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:25:16,516 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): sendAppendEntries: 0 is present for follower follower2
09:25:16,516 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Sending AppendEntries to follower follower2: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=false], ServerInfo [id=leader, isVoting=true]]]]]]
09:25:16,516 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:25:16,516 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): sendAppendEntries: 0 is present for follower follower
09:25:16,516 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Sending AppendEntries to follower follower: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=false], ServerInfo [id=leader, isVoting=true]]]]]]
09:25:16,516 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupport - leader: Returning OK for operation ChangeServersVotingStatus [serverVotingStatusMap={follower2=false, follower=false}, serversVisited=[]]
09:25:16,516 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): handleAppendEntries: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=false], ServerInfo [id=leader, isVoting=true]]]]]]
09:25:16,516 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupport - leader: ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=false], ServerInfo [id=leader, isVoting=true]]] has been successfully replicated to a majority of followers
09:25:16,517 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): Number of entries to be appended = 1
09:25:16,517 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
09:25:16,517 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): Append entry to log ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=false], ServerInfo [id=leader, isVoting=true]]]
09:25:16,517 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persisting ApplyJournalEntries with index=0
09:25:16,517 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=false], ServerInfo [id=leader, isVoting=true]]]] 
09:25:16,517 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): handleAppendEntries: AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=false], ServerInfo [id=leader, isVoting=true]]]]]]
09:25:16,517 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): Number of entries to be appended = 1
09:25:16,517 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
09:25:16,517 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2: Updated server config: isVoting: false, peers: [PeerInfo [id=leader, address=akka://test/user/leader232, votingState=VOTING], PeerInfo [id=follower, address=akka://test/user/follower230, votingState=NON_VOTING]]
09:25:16,517 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): Append entry to log ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=false], ServerInfo [id=leader, isVoting=true]]]
09:25:16,517 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): Log size is now 1
09:25:16,517 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=false], ServerInfo [id=leader, isVoting=true]]]] 
09:25:16,517 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): Commit index set to 0
09:25:16,517 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): handleAppendEntries returning : AppendEntriesReply [term=1, success=true, followerId=follower2, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
09:25:16,517 AM [test-akka.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower2: Lagging 0 entries behind leader leader and reached 0 (of expected -1)
09:25:16,517 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
09:25:16,517 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): Setting last applied to 0
09:25:16,517 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: Updated server config: isVoting: false, peers: [PeerInfo [id=leader, address=akka://test/user/leader232, votingState=VOTING], PeerInfo [id=follower2, address=akka://test/user/follower2231, votingState=NON_VOTING]]
09:25:16,517 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2: Moving last applied index from -1 to 0
09:25:16,517 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): Log size is now 1
09:25:16,517 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): Commit index set to 0
09:25:16,517 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2: Applying state for log index 0 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=false], ServerInfo [id=leader, isVoting=true]]]
09:25:16,517 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): handleAppendEntries returning : AppendEntriesReply [term=1, success=true, followerId=follower, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
09:25:16,517 AM [test-akka.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower: Lagging 0 entries behind leader leader and reached 0 (of expected -1)
09:25:16,517 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
09:25:16,517 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): Setting last applied to 0
09:25:16,517 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: Moving last applied index from -1 to 0
09:25:16,517 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: Applying state for log index 0 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=false], ServerInfo [id=leader, isVoting=true]]]
09:25:16,517 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for follower2 updated: matchIndex: 0, nextIndex: 1
09:25:16,517 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower2: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:25:16,518 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for follower updated: matchIndex: 0, nextIndex: 1
09:25:16,518 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:25:16,518 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=false], ServerInfo [id=leader, isVoting=true]]]]
09:25:16,518 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=false], ServerInfo [id=leader, isVoting=true]]]]
09:25:16,518 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=false], ServerInfo [id=leader, isVoting=true]]]]
09:25:16,518 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2: Persisting ApplyJournalEntries with index=0
[WARN] [04/25/2024 09:25:16.518] [test-akka.actor.default-dispatcher-12] [akka://test/user/follower2231] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@61a13e6c
[WARN] [04/25/2024 09:25:16.518] [test-akka.actor.default-dispatcher-12] [akka://test/user/follower230] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@2312fe46
09:25:16,518 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: Persisting ApplyJournalEntries with index=0
09:25:16,519 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupport - leader: onChangeServersVotingStatus: ChangeServersVotingStatus [serverVotingStatusMap={follower=true}, serversVisited=[]], state: Idle
09:25:16,519 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupport - Initiating ChangeServersVotingStatusState
09:25:16,519 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Updated server config: isVoting: true, peers: [PeerInfo [id=follower2, address=akka://test/user/follower2231, votingState=NON_VOTING], PeerInfo [id=follower, address=akka://test/user/follower230, votingState=VOTING]]
09:25:16,519 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupport - leader: New server configuration : [ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=true]]
09:25:16,519 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]
09:25:16,519 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=true]]]] 
09:25:16,519 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=f8a36ab7-949a-4919-93da-9705d26ec3ee}, logIndex: 1, payload: class org.opendaylight.controller.cluster.raft.persisted.ServerConfigurationPayload, isSendImmediate: true
09:25:16,519 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Setting last applied to 1
09:25:16,519 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Moving last applied index from 0 to 1
09:25:16,519 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Applying state for log index 1 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=true]]]
09:25:16,519 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower2: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1
09:25:16,519 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): sendAppendEntries: 1 is present for follower follower2
09:25:16,519 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Sending AppendEntries to follower follower2: AppendEntries [leaderId=leader, prevLogIndex=0, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=1, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]]]
09:25:16,519 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1
09:25:16,519 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): sendAppendEntries: 1 is present for follower follower
09:25:16,519 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Sending AppendEntries to follower follower: AppendEntries [leaderId=leader, prevLogIndex=0, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=1, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]]]
09:25:16,519 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupport - leader: Returning OK for operation ChangeServersVotingStatus [serverVotingStatusMap={follower=true}, serversVisited=[]]
09:25:16,519 AM [test-akka.actor.default-dispatcher-11] [INFO] RaftActorServerConfigurationSupport - leader: ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=true]]] has been successfully replicated to a majority of followers
09:25:16,520 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persisting ApplyJournalEntries with index=1
09:25:16,520 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): handleAppendEntries: AppendEntries [leaderId=leader, prevLogIndex=0, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=1, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]]]
09:25:16,520 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): Number of entries to be appended = 1
09:25:16,520 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0
09:25:16,520 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): Append entry to log ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=true]]]
09:25:16,520 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=true]]]] 
09:25:16,520 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2: Updated server config: isVoting: false, peers: [PeerInfo [id=leader, address=akka://test/user/leader232, votingState=VOTING], PeerInfo [id=follower, address=akka://test/user/follower230, votingState=VOTING]]
09:25:16,520 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): Log size is now 2
09:25:16,520 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): Commit index set to 1
09:25:16,520 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): handleAppendEntries returning : AppendEntriesReply [term=1, success=true, followerId=follower2, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
09:25:16,520 AM [test-akka.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower2: Lagging 0 entries behind leader leader and reached 1 (of expected -1)
09:25:16,520 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 1
09:25:16,520 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2 (Follower): Setting last applied to 1
09:25:16,520 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2: Moving last applied index from 0 to 1
09:25:16,520 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2: Applying state for log index 1 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=true]]]
09:25:16,520 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): handleAppendEntries: AppendEntries [leaderId=leader, prevLogIndex=0, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=1, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]]]
09:25:16,520 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): Number of entries to be appended = 1
09:25:16,520 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): After cleanup, lastIndex: 0, entries to be added from: 0
09:25:16,520 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): Append entry to log ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=true]]]
09:25:16,520 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=true]]]] 
09:25:16,520 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: Updated server config: isVoting: true, peers: [PeerInfo [id=leader, address=akka://test/user/leader232, votingState=VOTING], PeerInfo [id=follower2, address=akka://test/user/follower2231, votingState=NON_VOTING]]
09:25:16,520 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): Log size is now 2
09:25:16,520 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): Commit index set to 1
09:25:16,520 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): handleAppendEntries returning : AppendEntriesReply [term=1, success=true, followerId=follower, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
09:25:16,520 AM [test-akka.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower: Lagging 0 entries behind leader leader and reached 1 (of expected -1)
09:25:16,520 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 1
09:25:16,520 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower (Follower): Setting last applied to 1
09:25:16,520 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: Moving last applied index from 0 to 1
09:25:16,520 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: Applying state for log index 1 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=true]]]
09:25:16,520 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for follower2 updated: matchIndex: 1, nextIndex: 2
09:25:16,520 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: fakeSnapshot purging log to 0 for term 1
09:25:16,520 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower2: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: 0
09:25:16,520 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for follower updated: matchIndex: 1, nextIndex: 2
09:25:16,521 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: 0
09:25:16,522 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]
09:25:16,522 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]
09:25:16,522 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower2: Persisting ApplyJournalEntries with index=1
09:25:16,522 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower2, isVoting=false], ServerInfo [id=follower, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]
09:25:16,522 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - follower: Persisting ApplyJournalEntries with index=1
09:25:16,571 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testChangeServersVotingStatus ending
09:25:16,571 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower229]
09:25:16,582 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader232]
09:25:16,582 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leaderCollector233]
09:25:16,583 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/collector234#-1400411802]
09:25:16,583 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower230]
09:25:16,583 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/collector235#-621686496]
09:25:16,584 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower2231]
09:25:16,588 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testAddServerWithExistingFollower starting
09:25:16,591 AM [test-akka.actor.default-dispatcher-11] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - Starting recovery for new-server with journal batch size 1000
[WARN] [04/25/2024 09:25:16.591] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/new-server238]: org.opendaylight.controller.cluster.common.actor.Monitor@69e958ce
09:25:16,591 AM [main] [DEBUG] RaftActorServerConfigurationSupportTest - follower: Set currentTerm=1, votedFor=leader
09:25:16,592 AM [main] [DEBUG] RaftActorServerConfigurationSupportTest - follower: Moving last applied index from -1 to 2
09:25:16,593 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Moving last applied index from -1 to 2
09:25:16,593 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Set currentTerm=1, votedFor=leader
09:25:16,594 AM [test-akka.actor.default-dispatcher-12] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - Starting recovery for leader with journal batch size 1000
[WARN] [04/25/2024 09:25:16.594] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader239]: org.opendaylight.controller.cluster.common.actor.Monitor@26f1b593
09:25:16,594 AM [test-akka.actor.default-dispatcher-12] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:16,595 AM [test-akka.actor.default-dispatcher-12] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy
09:25:16,596 AM [test-akka.actor.default-dispatcher-11] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Recovery completed  - Switching actor to Follower - last log index = 2, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 3
09:25:16,596 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Election: Leader has following peers: [follower]
09:25:16,596 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower: active: false, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: -1
09:25:16,597 AM [test-akka.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower: Last sync leader does not match current leader leader, need to catch up to -1
09:25:16,597 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for follower updated: matchIndex: 2, nextIndex: 3
09:25:16,597 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: fakeSnapshot purging log to 1 for term 1
09:25:16,597 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower: active: true, followerNextIndex: 3, leaderLastIndex: 2, leaderSnapShotIndex: 1
09:25:16,597 AM [test-akka.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower: Lagging 0 entries behind leader leader and reached 2 (of expected -1)
09:25:16,597 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest - follower: fakeSnapshot purging log to 1 for term 1
09:25:16,657 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupport - leader: onAddServer: AddServer [newServerId=new-server, newServerAddress=akka://test/user/new-server238, votingMember=true], state: Idle
09:25:16,657 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupport - leader: Initiating AddServer [newServerId=new-server, newServerAddress=akka://test/user/new-server238, votingMember=true]
09:25:16,657 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=2, lastAppliedTerm=1, lastIndex=2, lastTerm=1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] to install on new-server
09:25:16,657 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: lastSequenceNumber prior to capture: -1
09:25:16,657 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupport - leader: Initiating capture snapshot for new server new-server
09:25:16,658 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: CaptureSnapshotReply received by actor
09:25:16,658 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persisting of snapshot done: Snapshot [lastIndex=2, lastTerm=1, lastAppliedIndex=2, lastAppliedTerm=1, unAppliedEntries size=0, state=MockSnapshotState [state=[0, 1, 2]], electionTerm=1, electionVotedFor=leader, ServerConfigPayload=null]
09:25:16,658 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Removed in-memory snapshotted entries, adjusted snaphsotIndex: 1 and term: 1
09:25:16,658 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): sendInstallSnapshot
09:25:16,658 AM [test-akka.actor.default-dispatcher-13] [DEBUG] LeaderInstallSnapshotState - leader (Leader): Snapshot 338 bytes, total chunks to send: 1
09:25:16,658 AM [test-akka.actor.default-dispatcher-13] [DEBUG] LeaderInstallSnapshotState - leader (Leader): Next chunk: total length=338, offset=0, size=338, hashCode=1701166743
09:25:16,658 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): next snapshot chunk size for follower new-server: 338
09:25:16,658 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): InstallSnapshot sent to follower Vector(user, new-server238), Chunk: 1/1
09:25:16,658 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Snapshot success -  sequence number: -1
09:25:16,658 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Term 1 in "InstallSnapshot [term=1, leaderId=leader, lastIncludedIndex=2, lastIncludedTerm=1, datasize=338, Chunk=1/1, lastChunkHashCode=OptionalInt[-1], serverConfig=null]" message is greater than follower's term 0 - updating term
09:25:16,658 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: SnapshotComplete received
09:25:16,658 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Set currentTerm=1, votedFor=null
09:25:16,658 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): handleInstallSnapshot: InstallSnapshot [term=1, leaderId=leader, lastIncludedIndex=2, lastIncludedTerm=1, datasize=338, Chunk=1/1, lastChunkHashCode=OptionalInt[-1], serverConfig=null]
09:25:16,658 AM [test-akka.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - new-server: Last sync leader does not match current leader leader, need to catch up to 2
09:25:16,658 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - addChunk: chunkIndex=1, lastChunkIndex=0, collectedChunks.size=0, lastChunkHashCode=-1
09:25:16,658 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Snapshot installed from leader: leader
09:25:16,661 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Applying snapshot on follower:  Snapshot [lastIndex=2, lastTerm=1, lastAppliedIndex=2, lastAppliedTerm=1, unAppliedEntries size=0, state=MockSnapshotState [state=[0, 1, 2]], electionTerm=1, electionVotedFor=null, ServerConfigPayload=null]
09:25:16,661 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - lastSequenceNumber prior to persisting applied snapshot: -1
09:25:16,661 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Snapshot success -  sequence number: -1
09:25:16,661 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Moving last applied index from -1 to 2
09:25:16,661 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Set currentTerm=1, votedFor=null
[WARN] [04/25/2024 09:25:16.661] [test-akka.actor.default-dispatcher-12] [akka://test/user/new-server238] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@30e62d47
09:25:16,661 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: applySnapshot called
09:25:16,661 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): handleInstallSnapshot returning: InstallSnapshotReply [term=1, followerId=new-server, chunkIndex=1, success=true]
09:25:16,661 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: SnapshotComplete received
09:25:16,661 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): handleInstallSnapshotReply: InstallSnapshotReply [term=1, followerId=new-server, chunkIndex=1, success=true]
09:25:16,661 AM [test-akka.actor.default-dispatcher-17] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Snapshot successfully installed on follower new-server (last chunk 1) - matchIndex set to 2, nextIndex set to 3
09:25:16,661 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - Sent message UnInitializedFollowerSnapshotReply to self
09:25:16,661 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupport - leader: onUnInitializedFollowerSnapshotReply: UnInitializedFollowerSnapshotReply [followerId=new-server]
09:25:16,661 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupport - leader: New server configuration : [ServerInfo [id=follower, isVoting=true], ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]
09:25:16,661 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persist data SimpleReplicatedLogEntry [index=3, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower, isVoting=true], ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]
09:25:16,661 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Append log entry and persist SimpleReplicatedLogEntry [index=3, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower, isVoting=true], ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]] 
09:25:16,662 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=ebe976ab-7798-438d-a9d6-8d3c45ad27f5}, logIndex: 3, payload: class org.opendaylight.controller.cluster.raft.persisted.ServerConfigurationPayload, isSendImmediate: true
09:25:16,662 AM [test-akka.actor.default-dispatcher-17] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:25:16,662 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower: active: true, followerNextIndex: 3, leaderLastIndex: 3, leaderSnapShotIndex: 1
09:25:16,662 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): sendAppendEntries: 3 is present for follower follower
09:25:16,662 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Sending AppendEntries to follower follower: AppendEntries [leaderId=leader, prevLogIndex=2, prevLogTerm=1, leaderCommit=2, replicatedToAllIndex=1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=3, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower, isVoting=true], ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]]]
09:25:16,662 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower new-server: active: true, followerNextIndex: 3, leaderLastIndex: 3, leaderSnapShotIndex: 1
09:25:16,662 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): sendAppendEntries: 3 is present for follower new-server
09:25:16,662 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Sending AppendEntries to follower new-server: AppendEntries [leaderId=leader, prevLogIndex=2, prevLogTerm=1, leaderCommit=2, replicatedToAllIndex=1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=3, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower, isVoting=true], ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]]]
09:25:16,662 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest - follower (Follower): handleAppendEntries: AppendEntries [leaderId=leader, prevLogIndex=2, prevLogTerm=1, leaderCommit=2, replicatedToAllIndex=1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=3, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower, isVoting=true], ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]]]
09:25:16,662 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupport - leader: Returning OK for operation AddServer [newServerId=new-server, newServerAddress=akka://test/user/new-server238, votingMember=true]
09:25:16,662 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest - follower (Follower): Number of entries to be appended = 1
09:25:16,662 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest - follower (Follower): After cleanup, lastIndex: 2, entries to be added from: 0
09:25:16,662 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): handleAppendEntries: AppendEntries [leaderId=leader, prevLogIndex=2, prevLogTerm=1, leaderCommit=2, replicatedToAllIndex=1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=3, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower, isVoting=true], ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]]]
09:25:16,662 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest - follower (Follower): Append entry to log ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower, isVoting=true], ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]
09:25:16,662 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Number of entries to be appended = 1
09:25:16,662 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): After cleanup, lastIndex: 2, entries to be added from: 0
09:25:16,662 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Append entry to log ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower, isVoting=true], ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]
09:25:16,662 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest - follower: Updated server config: isVoting: true, peers: [PeerInfo [id=leader, address=, votingState=VOTING], PeerInfo [id=new-server, address=null, votingState=VOTING]]
09:25:16,662 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Append log entry and persist SimpleReplicatedLogEntry [index=3, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower, isVoting=true], ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]] 
09:25:16,662 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest - follower (Follower): Log size is now 2
09:25:16,662 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest - follower (Follower): handleAppendEntries returning : AppendEntriesReply [term=1, success=true, followerId=follower, logLastIndex=3, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=0, raftVersion=5, recipientRaftVersion=5]
09:25:16,662 AM [test-akka.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower: Lagging 0 entries behind leader leader and reached 2 (of expected -1)
09:25:16,663 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Updated server config: isVoting: true, peers: [PeerInfo [id=leader, address=null, votingState=VOTING], PeerInfo [id=follower, address=null, votingState=VOTING]]
09:25:16,663 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for follower updated: matchIndex: 3, nextIndex: 4
09:25:16,663 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Log size is now 1
09:25:16,663 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): handleAppendEntries returning : AppendEntriesReply [term=1, success=true, followerId=new-server, logLastIndex=3, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=true, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
09:25:16,663 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower: active: true, followerNextIndex: 4, leaderLastIndex: 3, leaderSnapShotIndex: 1
09:25:16,663 AM [test-akka.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - new-server: Lagging 0 entries behind leader leader and reached 2 (of expected 2)
09:25:16,663 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for new-server updated: matchIndex: 3, nextIndex: 4
09:25:16,663 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower new-server: active: true, followerNextIndex: 4, leaderLastIndex: 3, leaderSnapShotIndex: 1
09:25:16,668 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: persist complete SimpleReplicatedLogEntry [index=3, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower, isVoting=true], ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]
09:25:16,668 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Applying to log - commitIndex: 3, lastAppliedIndex: 2
09:25:16,668 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Setting last applied to 3
09:25:16,668 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Moving last applied index from 2 to 3
09:25:16,668 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: persist complete SimpleReplicatedLogEntry [index=3, term=1, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower, isVoting=true], ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]]
09:25:16,668 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Applying state for log index 3 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower, isVoting=true], ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]
09:25:16,668 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: fakeSnapshot purging log to 2 for term 1
09:25:16,668 AM [test-akka.actor.default-dispatcher-12] [INFO] RaftActorServerConfigurationSupport - leader: ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower, isVoting=true], ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]] has been successfully replicated to a majority of followers
09:25:16,668 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persisting ApplyJournalEntries with index=3
[WARN] [04/25/2024 09:25:16.668] [test-akka.actor.default-dispatcher-11] [akka://test/user/new-server238] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@12a1f11
09:25:16,833 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest - follower (Follower): Commit index set to 3
09:25:16,833 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Commit index set to 3
09:25:16,833 AM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower: Lagging 0 entries behind leader leader and reached 3 (of expected -1)
09:25:16,833 AM [test-akka.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - new-server: Lagging 0 entries behind leader leader and reached 3 (of expected 2)
09:25:16,833 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest - follower (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 3, context.getLastApplied(): 2, lastIndex(): 3
09:25:16,833 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 3, context.getLastApplied(): 2, lastIndex(): 3
09:25:16,833 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest - follower (Follower): Setting last applied to 3
09:25:16,833 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Setting last applied to 3
09:25:16,833 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest - follower: Moving last applied index from 2 to 3
09:25:16,833 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Moving last applied index from 2 to 3
09:25:16,833 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest - follower: fakeSnapshot purging log to 2 for term 1
09:25:16,833 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Applying state for log index 3 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=follower, isVoting=true], ServerInfo [id=new-server, isVoting=true], ServerInfo [id=leader, isVoting=true]]]
09:25:16,833 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Persisting ApplyJournalEntries with index=3
09:25:16,860 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testAddServerWithExistingFollower ending
09:25:16,860 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower236]
09:25:16,871 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/new-serverCollector237#2072751741]
09:25:16,871 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/new-server238]
09:25:16,872 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader239]
09:25:16,872 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leaderCollector240]
09:25:16,874 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testAddServerForwardedToLeader starting
[WARN] [04/25/2024 09:25:16.876] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/new-server243]: org.opendaylight.controller.cluster.common.actor.Monitor@2a03783e
09:25:16,877 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - Starting recovery for new-server with journal batch size 1000
09:25:16,878 AM [test-akka.actor.default-dispatcher-12] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:16,879 AM [test-akka.actor.default-dispatcher-12] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy
[WARN] [04/25/2024 09:25:16.882] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower245]: org.opendaylight.controller.cluster.common.actor.Monitor@46c651a0
09:25:16,883 AM [test-akka.actor.default-dispatcher-12] [INFO] MockRaftActor - Starting recovery for follower with journal batch size 1000
09:25:16,884 AM [test-akka.actor.default-dispatcher-13] [INFO] MockRaftActor - follower: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:16,885 AM [test-akka.actor.default-dispatcher-11] [INFO] MockRaftActor - follower (Follower): Term 1 in "AppendEntries [leaderId=leader, prevLogIndex=0, prevLogTerm=1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=0, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 0 - updating term
09:25:16,885 AM [test-akka.actor.default-dispatcher-11] [DEBUG] MockRaftActor - follower: Set currentTerm=1, votedFor=null
09:25:16,885 AM [test-akka.actor.default-dispatcher-11] [INFO] MockRaftActor - follower (Follower): The followers log is empty and the senders prevLogIndex is 0
09:25:16,885 AM [test-akka.actor.default-dispatcher-11] [INFO] MockRaftActor - follower (Follower): Follower is out-of-sync so sending negative reply: AppendEntriesReply [term=1, success=false, followerId=follower, logLastIndex=-1, logLastTerm=-1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
09:25:16,885 AM [test-akka.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower: Last sync leader does not match current leader leader, need to catch up to -1
[WARN] [04/25/2024 09:25:16.885] [test-akka.actor.default-dispatcher-12] [akka://test/user/follower245] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@72b31399
09:25:16,895 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupport - follower: onAddServer: AddServer [newServerId=new-server, newServerAddress=akka://test/user/new-server243, votingMember=true], state: Idle
09:25:16,895 AM [test-akka.actor.default-dispatcher-11] [DEBUG] MockRaftActor - follower: getLeaderAddress leaderId = leader peerAddress = akka://test/user/leader244
09:25:16,895 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupport - follower: Not leader - forwarding to leader ActorSelection[Anchor(akka://test/), Path(/user/leader244)]
09:25:16,945 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testAddServerForwardedToLeader ending
09:25:16,945 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower241]
09:25:16,956 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/new-serverCollector242#908819871]
09:25:16,956 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/new-server243]
09:25:16,957 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader244#-1349028181]
09:25:16,957 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower245]
09:25:17,59 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testRemoveServerForwardToLeader starting
[WARN] [04/25/2024 09:25:17.161] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower248]: org.opendaylight.controller.cluster.common.actor.Monitor@2b465cf
09:25:17,162 AM [test-akka.actor.default-dispatcher-12] [INFO] MockRaftActor - Starting recovery for follower with journal batch size 1000
09:25:17,163 AM [test-akka.actor.default-dispatcher-11] [INFO] MockRaftActor - follower: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:17,164 AM [test-akka.actor.default-dispatcher-11] [INFO] MockRaftActor - follower (Follower): Term 1 in "AppendEntries [leaderId=leader, prevLogIndex=0, prevLogTerm=1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=0, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 0 - updating term
09:25:17,164 AM [test-akka.actor.default-dispatcher-11] [DEBUG] MockRaftActor - follower: Set currentTerm=1, votedFor=null
09:25:17,164 AM [test-akka.actor.default-dispatcher-11] [INFO] MockRaftActor - follower (Follower): The followers log is empty and the senders prevLogIndex is 0
09:25:17,164 AM [test-akka.actor.default-dispatcher-11] [INFO] MockRaftActor - follower (Follower): Follower is out-of-sync so sending negative reply: AppendEntriesReply [term=1, success=false, followerId=follower, logLastIndex=-1, logLastTerm=-1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
09:25:17,164 AM [test-akka.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower: Last sync leader does not match current leader leader, need to catch up to -1
[WARN] [04/25/2024 09:25:17.165] [test-akka.actor.default-dispatcher-11] [akka://test/user/follower248] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@1732ddf6
09:25:17,174 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupport - follower: onRemoveServer: RemoveServer{serverId='follower'}, state: Idle
09:25:17,174 AM [test-akka.actor.default-dispatcher-11] [DEBUG] MockRaftActor - follower: getLeaderAddress leaderId = leader peerAddress = akka://test/user/leader247
09:25:17,174 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupport - follower: Not leader - forwarding to leader ActorSelection[Anchor(akka://test/), Path(/user/leader247)]
09:25:17,224 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testRemoveServerForwardToLeader ending
09:25:17,224 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower246]
09:25:17,236 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader247]
09:25:17,236 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower248]
09:25:17,239 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testAddServerWithExistingServer starting
[WARN] [04/25/2024 09:25:17.242] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader250]: org.opendaylight.controller.cluster.common.actor.Monitor@56ab76f9
09:25:17,242 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Moving last applied index from -1 to -1
09:25:17,242 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Set currentTerm=1, votedFor=
09:25:17,243 AM [test-akka.actor.default-dispatcher-11] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - Starting recovery for leader with journal batch size 1000
09:25:17,244 AM [test-akka.actor.default-dispatcher-12] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:17,244 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Election: Leader has following peers: [follower]
09:25:17,245 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower follower: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:25:17,253 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupport - leader: onAddServer: AddServer [newServerId=follower, newServerAddress=akka://test/user/follower249, votingMember=true], state: Idle
09:25:17,253 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupport - leader: Initiating AddServer [newServerId=follower, newServerAddress=akka://test/user/follower249, votingMember=true]
09:25:17,253 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupport - leader: Returning ALREADY_EXISTS for operation AddServer [newServerId=follower, newServerAddress=akka://test/user/follower249, votingMember=true]
09:25:17,253 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testAddServerWithExistingServer ending
09:25:17,254 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower249]
09:25:17,264 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader250]
09:25:17,268 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testChangeToVotingWithNoLeaderAndElectionTimeout starting
[WARN] [04/25/2024 09:25:17.272] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/node1]: org.opendaylight.controller.cluster.common.actor.Monitor@33d948e4
09:25:17,273 AM [test-akka.actor.default-dispatcher-11] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - Starting recovery for node1 with journal batch size 1000
09:25:17,275 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Set currentTerm=1, votedFor=node1
09:25:17,275 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Received ReplicatedLogEntry for recovery: index: 0, size: 133
09:25:17,275 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Updated server config: isVoting: false, peers: [PeerInfo [id=node2, address=null, votingState=VOTING]]
09:25:17,275 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Recovery completed  - Switching actor to Follower - last log index = 0, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 1
[WARN] [04/25/2024 09:25:17.275] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/node2]: org.opendaylight.controller.cluster.common.actor.Monitor@24c87f84
09:25:17,276 AM [test-akka.actor.default-dispatcher-12] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - Starting recovery for node2 with journal batch size 1000
09:25:17,278 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Set currentTerm=1, votedFor=node1
09:25:17,278 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Received ReplicatedLogEntry for recovery: index: 0, size: 133
09:25:17,278 AM [test-akka.actor.default-dispatcher-13] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Updated server config: isVoting: true, peers: [PeerInfo [id=node1, address=null, votingState=NON_VOTING]]
09:25:17,278 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Recovery completed  - Switching actor to Follower - last log index = 0, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 1
09:25:17,287 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupport - node1: onChangeServersVotingStatus: ChangeServersVotingStatus [serverVotingStatusMap={node1=true}, serversVisited=[]], state: Idle
09:25:17,287 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupport - Initiating ChangeServersVotingStatusState
09:25:17,287 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupport - node1: Sending local ElectionTimeout to start leader election
09:25:17,287 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Updated server config: isVoting: true, peers: [PeerInfo [id=node2, address=null, votingState=VOTING]]
09:25:17,287 AM [test-akka.actor.default-dispatcher-5] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:25:17,287 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): Received TimeoutNow - switching to Candidate
09:25:17,287 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Candidate): Election: Candidate has following voting peers: [node2]
09:25:17,287 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Set currentTerm=2, votedFor=node1
09:25:17,287 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Candidate): Starting new election term 2
09:25:17,287 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Candidate): Sending RequestVote [term=2, candidateId=node1, lastLogIndex=0, lastLogTerm=1] to peer node2
09:25:17,288 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
09:25:17,402 AM [test-akka.actor.default-dispatcher-5] [WARN] RaftActorServerConfigurationSupport - node1: Leader election timed out - cannot apply operation ChangeServersVotingStatus [serverVotingStatusMap={node1=true}, serversVisited=[]]
09:25:17,402 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Updated server config: isVoting: false, peers: [PeerInfo [id=node2, address=akka://test/user/node2, votingState=VOTING]]
09:25:17,403 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupport - node1: tryToForwardOperationToAnotherServer - servers already visited []
09:25:17,403 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupport - node1: Returning NO_LEADER for operation ChangeServersVotingStatus [serverVotingStatusMap={node1=true}, serversVisited=[]]
09:25:17,403 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testChangeToVotingWithNoLeaderAndElectionTimeout ending
09:25:17,403 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower251]
09:25:17,414 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/collector252#-1649531720]
09:25:17,415 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/node1]
09:25:17,415 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/collector253#1334913404]
09:25:17,415 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/node2]
09:25:17,417 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testChangeToVotingWithNoLeader starting
[WARN] [04/25/2024 09:25:17.419] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/node1]: org.opendaylight.controller.cluster.common.actor.Monitor@1fa62784
09:25:17,420 AM [test-akka.actor.default-dispatcher-13] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - Starting recovery for node1 with journal batch size 1000
[WARN] [04/25/2024 09:25:17.422] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/node2]: org.opendaylight.controller.cluster.common.actor.Monitor@5665f302
09:25:17,422 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Set currentTerm=1, votedFor=downNode1
09:25:17,422 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Received ReplicatedLogEntry for recovery: index: 0, size: 163
09:25:17,422 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Updated server config: isVoting: false, peers: [PeerInfo [id=node2, address=null, votingState=NON_VOTING], PeerInfo [id=downNode2, address=null, votingState=VOTING], PeerInfo [id=downNode1, address=null, votingState=VOTING]]
09:25:17,422 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Received apply journal entries for recovery, applying to state: 0 to 0
09:25:17,422 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Moving last applied index from -1 to 0
09:25:17,423 AM [test-akka.actor.default-dispatcher-12] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - Starting recovery for node2 with journal batch size 1000
09:25:17,423 AM [test-akka.actor.default-dispatcher-11] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Recovery completed  in 61.94 μs - Switching actor to Follower - last log index = 0, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 1
09:25:17,424 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Set currentTerm=1, votedFor=downNode2
09:25:17,424 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Received ReplicatedLogEntry for recovery: index: 0, size: 163
09:25:17,424 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Updated server config: isVoting: false, peers: [PeerInfo [id=downNode2, address=null, votingState=VOTING], PeerInfo [id=downNode1, address=null, votingState=VOTING], PeerInfo [id=node1, address=null, votingState=NON_VOTING]]
09:25:17,424 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Received apply journal entries for recovery, applying to state: 0 to 0
09:25:17,424 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Moving last applied index from -1 to 0
09:25:17,424 AM [test-akka.actor.default-dispatcher-12] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Recovery completed  in 53.94 μs - Switching actor to Follower - last log index = 0, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 1
09:25:17,435 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupport - node1: onChangeServersVotingStatus: ChangeServersVotingStatus [serverVotingStatusMap={downNode2=false, node2=true, downNode1=false, node1=true}, serversVisited=[]], state: Idle
09:25:17,435 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupport - Initiating ChangeServersVotingStatusState
09:25:17,435 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupport - node1: Sending local ElectionTimeout to start leader election
09:25:17,435 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Updated server config: isVoting: true, peers: [PeerInfo [id=node2, address=null, votingState=VOTING], PeerInfo [id=downNode2, address=null, votingState=NON_VOTING], PeerInfo [id=downNode1, address=null, votingState=NON_VOTING]]
09:25:17,436 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:25:17,436 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): Received TimeoutNow - switching to Candidate
09:25:17,436 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Candidate): Election: Candidate has following voting peers: [node2]
09:25:17,436 AM [test-akka.actor.default-dispatcher-14] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Set currentTerm=2, votedFor=node1
09:25:17,436 AM [test-akka.actor.default-dispatcher-14] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Candidate): Starting new election term 2
09:25:17,436 AM [test-akka.actor.default-dispatcher-14] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
09:25:17,953 AM [test-akka.actor.default-dispatcher-12] [WARN] RaftActorServerConfigurationSupport - node1: Leader election timed out - cannot apply operation ChangeServersVotingStatus [serverVotingStatusMap={downNode2=false, node2=true, downNode1=false, node1=true}, serversVisited=[]]
09:25:17,953 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Updated server config: isVoting: false, peers: [PeerInfo [id=node2, address=null, votingState=NON_VOTING], PeerInfo [id=downNode2, address=null, votingState=VOTING], PeerInfo [id=downNode1, address=null, votingState=VOTING]]
09:25:17,953 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupport - node1: tryToForwardOperationToAnotherServer - servers already visited []
09:25:17,953 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupport - node1: Returning NO_LEADER for operation ChangeServersVotingStatus [serverVotingStatusMap={downNode2=false, node2=true, downNode1=false, node1=true}, serversVisited=[]]
09:25:17,954 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - node1: Last sync leader does not match current leader downNode1, need to catch up to 0
[WARN] [04/25/2024 09:25:17.955] [test-akka.actor.default-dispatcher-12] [akka://test/deadLetters] received dead letter from TestActor[akka://test/user/node1]: AppendEntriesReply [term=2, success=true, followerId=node1, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=true, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
[WARN] [04/25/2024 09:25:17.955] [test-akka.actor.default-dispatcher-12] [akka://test/user/node1] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@6e4bc0aa
09:25:18,561 AM [main] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - Peer address for peer node2 set to akka://test/user/node2
09:25:18,561 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupport - node1: onChangeServersVotingStatus: ChangeServersVotingStatus [serverVotingStatusMap={downNode2=false, node2=true, downNode1=false, node1=true}, serversVisited=[]], state: Idle
09:25:18,562 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupport - Initiating ChangeServersVotingStatusState
09:25:18,562 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupport - node1: Sending local ElectionTimeout to start leader election
09:25:18,562 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Updated server config: isVoting: true, peers: [PeerInfo [id=node2, address=akka://test/user/node2, votingState=VOTING], PeerInfo [id=downNode2, address=null, votingState=NON_VOTING], PeerInfo [id=downNode1, address=null, votingState=NON_VOTING]]
09:25:18,562 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower): Received TimeoutNow - switching to Candidate
09:25:18,562 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Candidate): Election: Candidate has following voting peers: [node2]
09:25:18,562 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Set currentTerm=3, votedFor=node1
09:25:18,562 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Candidate): Starting new election term 3
09:25:18,562 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Candidate): Sending RequestVote [term=3, candidateId=node1, lastLogIndex=0, lastLogTerm=1] to peer node2
09:25:18,562 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Follower) :- Switching from behavior Follower to Candidate, election term: 3
09:25:18,562 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:25:18,562 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Follower): Cluster state: []
09:25:18,562 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Follower): Candidate in requestVote:RequestVote [term=3, candidateId=node1, lastLogIndex=0, lastLogTerm=1] with higher term appears reachable, updating term.
09:25:18,562 AM [test-akka.actor.default-dispatcher-12] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Follower): Term 3 in "RequestVote [term=3, candidateId=node1, lastLogIndex=0, lastLogTerm=1]" message is greater than follower's term 1 - updating term
09:25:18,562 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Set currentTerm=3, votedFor=null
09:25:18,563 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Follower): In requestVote:  RequestVote [term=3, candidateId=node1, lastLogIndex=0, lastLogTerm=1] - currentTerm: 3, votedFor: null, lastIndex: 0, lastTerm: 1
09:25:18,563 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Set currentTerm=3, votedFor=node1
09:25:18,563 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Follower): requestVote returning: RequestVoteReply [term=3, voteGranted=true]
09:25:18,563 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Candidate): RaftRPC message received RequestVoteReply [term=3, voteGranted=true], my term is 3
09:25:18,564 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Candidate): handleRequestVoteReply: RequestVoteReply [term=3, voteGranted=true], current voteCount: 1
09:25:18,564 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Leader): Election: Leader has following peers: [node2, downNode2, downNode1]
09:25:18,564 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Leader): Checking sendAppendEntries for follower node2: active: false, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:25:18,564 AM [test-akka.actor.default-dispatcher-11] [INFO] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Candidate) :- Switching from behavior Candidate to Leader, election term: 3
09:25:18,564 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - node2: Last sync leader does not match current leader node1, need to catch up to -1
09:25:18,564 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupport - node1: New leader node1 elected
09:25:18,564 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupport - node1: New server configuration : [ServerInfo [id=node2, isVoting=true], ServerInfo [id=downNode2, isVoting=false], ServerInfo [id=downNode1, isVoting=false], ServerInfo [id=node1, isVoting=true]]
09:25:18,564 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Persist data SimpleReplicatedLogEntry [index=1, term=3, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=node2, isVoting=true], ServerInfo [id=downNode2, isVoting=false], ServerInfo [id=downNode1, isVoting=false], ServerInfo [id=node1, isVoting=true]]]]
09:25:18,564 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=3, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=node2, isVoting=true], ServerInfo [id=downNode2, isVoting=false], ServerInfo [id=downNode1, isVoting=false], ServerInfo [id=node1, isVoting=true]]]] 
[WARN] [04/25/2024 09:25:18.564] [test-akka.actor.default-dispatcher-14] [akka://test/user/node2] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@56c25902
09:25:18,565 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=6ed943b0-5a94-4523-87fb-c59be84cb2b0}, logIndex: 1, payload: class org.opendaylight.controller.cluster.raft.persisted.ServerConfigurationPayload, isSendImmediate: true
09:25:18,565 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Leader): Checking sendAppendEntries for follower node2: active: false, followerNextIndex: 0, leaderLastIndex: 1, leaderSnapShotIndex: -1
09:25:18,565 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupport - node1: Returning OK for operation ChangeServersVotingStatus [serverVotingStatusMap={downNode2=false, node2=true, downNode1=false, node1=true}, serversVisited=[]]
09:25:18,565 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Leader): handleAppendEntriesReply - FollowerLogInformation for node2 updated: matchIndex: 0, nextIndex: 1
09:25:18,565 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Leader): Checking sendAppendEntries for follower node2: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1
09:25:18,565 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Leader): sendAppendEntries: 1 is present for follower node2
09:25:18,565 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Leader): Sending AppendEntries to follower node2: AppendEntries [leaderId=node1, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=1, term=3, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=node2, isVoting=true], ServerInfo [id=downNode2, isVoting=false], ServerInfo [id=downNode1, isVoting=false], ServerInfo [id=node1, isVoting=true]]]]]]
09:25:18,565 AM [test-akka.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - node2: Lagging -1 entries behind leader node1 and reached 0 (of expected -1)
09:25:18,566 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Follower): handleAppendEntries: AppendEntries [leaderId=node1, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=1, term=3, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=node2, isVoting=true], ServerInfo [id=downNode2, isVoting=false], ServerInfo [id=downNode1, isVoting=false], ServerInfo [id=node1, isVoting=true]]]]]]
09:25:18,566 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Follower): Number of entries to be appended = 1
09:25:18,566 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0
09:25:18,566 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Follower): Append entry to log ServerConfigurationPayload [serverConfig=[ServerInfo [id=node2, isVoting=true], ServerInfo [id=downNode2, isVoting=false], ServerInfo [id=downNode1, isVoting=false], ServerInfo [id=node1, isVoting=true]]]
09:25:18,566 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=3, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=node2, isVoting=true], ServerInfo [id=downNode2, isVoting=false], ServerInfo [id=downNode1, isVoting=false], ServerInfo [id=node1, isVoting=true]]]] 
09:25:18,566 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Leader): sendAppendEntries: 1 is present for follower node2
09:25:18,566 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Updated server config: isVoting: true, peers: [PeerInfo [id=downNode2, address=null, votingState=NON_VOTING], PeerInfo [id=downNode1, address=null, votingState=NON_VOTING], PeerInfo [id=node1, address=null, votingState=VOTING]]
09:25:18,566 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Follower): Log size is now 2
09:25:18,566 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: persist complete SimpleReplicatedLogEntry [index=1, term=3, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=node2, isVoting=true], ServerInfo [id=downNode2, isVoting=false], ServerInfo [id=downNode1, isVoting=false], ServerInfo [id=node1, isVoting=true]]]]
09:25:18,566 AM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Follower): handleAppendEntries returning : AppendEntriesReply [term=3, success=true, followerId=node2, logLastIndex=1, logLastTerm=3, forceInstallSnapshot=false, needsLeaderAddress=true, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
09:25:18,566 AM [test-akka.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - node2: Lagging 0 entries behind leader node1 and reached 0 (of expected -1)
09:25:18,566 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Leader): handleAppendEntriesReply - FollowerLogInformation for node2 updated: matchIndex: 1, nextIndex: 2
09:25:18,566 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0
09:25:18,566 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Leader): Setting last applied to 1
09:25:18,566 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Moving last applied index from 0 to 1
09:25:18,566 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Applying state for log index 1 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=node2, isVoting=true], ServerInfo [id=downNode2, isVoting=false], ServerInfo [id=downNode1, isVoting=false], ServerInfo [id=node1, isVoting=true]]]
09:25:18,566 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1 (Leader): Checking sendAppendEntries for follower node2: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1
09:25:18,566 AM [test-akka.actor.default-dispatcher-17] [INFO] RaftActorServerConfigurationSupport - node1: ServerConfigurationPayload [serverConfig=[ServerInfo [id=node2, isVoting=true], ServerInfo [id=downNode2, isVoting=false], ServerInfo [id=downNode1, isVoting=false], ServerInfo [id=node1, isVoting=true]]] has been successfully replicated to a majority of followers
09:25:18,566 AM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node1: Persisting ApplyJournalEntries with index=1
09:25:18,568 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: persist complete SimpleReplicatedLogEntry [index=1, term=3, payload=ServerConfigurationPayload [serverConfig=[ServerInfo [id=node2, isVoting=true], ServerInfo [id=downNode2, isVoting=false], ServerInfo [id=downNode1, isVoting=false], ServerInfo [id=node1, isVoting=true]]]]
09:25:18,568 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Follower): Commit index set to 1
09:25:18,568 AM [test-akka.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - node2: Lagging 0 entries behind leader node1 and reached 1 (of expected -1)
09:25:18,568 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 1
09:25:18,568 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2 (Follower): Setting last applied to 1
09:25:18,568 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Moving last applied index from 0 to 1
09:25:18,568 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Applying state for log index 1 data ServerConfigurationPayload [serverConfig=[ServerInfo [id=node2, isVoting=true], ServerInfo [id=downNode2, isVoting=false], ServerInfo [id=downNode1, isVoting=false], ServerInfo [id=node1, isVoting=true]]]
09:25:18,568 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$CollectingMockRaftActor - node2: Persisting ApplyJournalEntries with index=1
[WARN] [04/25/2024 09:25:18.568] [test-akka.actor.default-dispatcher-5] [akka://test/user/node2] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@71fded99
09:25:18,617 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testChangeToVotingWithNoLeader ending
09:25:18,617 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower254]
09:25:18,628 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/collector255#-1847547827]
09:25:18,628 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/node1]
09:25:18,628 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/collector256#-1776863888]
09:25:18,629 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/node2]
09:25:18,631 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testAddServerWithPriorSnapshotCompleteTimeout starting
[WARN] [04/25/2024 09:25:18.632] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/new-server259]: org.opendaylight.controller.cluster.common.actor.Monitor@378b370
09:25:18,633 AM [test-akka.actor.default-dispatcher-14] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - Starting recovery for new-server with journal batch size 1000
[WARN] [04/25/2024 09:25:18.635] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader260]: org.opendaylight.controller.cluster.common.actor.Monitor@5775ce85
09:25:18,635 AM [test-akka.actor.default-dispatcher-17] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:18,635 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Moving last applied index from -1 to -1
09:25:18,635 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Set currentTerm=1, votedFor=
09:25:18,636 AM [test-akka.actor.default-dispatcher-17] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy
09:25:18,636 AM [test-akka.actor.default-dispatcher-12] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - Starting recovery for leader with journal batch size 1000
09:25:18,637 AM [test-akka.actor.default-dispatcher-16] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:25:18,637 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Election: Leader has following peers: []
09:25:18,735 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - Take a snapshot of current state. lastReplicatedLog is null and replicatedToAllIndex is -1
09:25:18,735 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead.
09:25:18,735 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=true]
09:25:18,735 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: lastSequenceNumber prior to capture: -1
09:25:18,735 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: CaptureSnapshotReply received by actor
09:25:18,735 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=, ServerConfigPayload=null]
09:25:18,735 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: user triggered or root overwrite snapshot encountered, trimming log up to last applied index -1
09:25:18,735 AM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1
09:25:18,745 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupport - leader: onAddServer: AddServer [newServerId=new-server, newServerAddress=akka://test/user/new-server259, votingMember=true], state: Idle
09:25:18,745 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupport - leader: Initiating AddServer [newServerId=new-server, newServerAddress=akka://test/user/new-server259, votingMember=true]
09:25:18,745 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - captureToInstall should not be called in state Persisting
09:25:18,745 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupport - leader: Snapshot already in progress - waiting for completion
09:25:18,863 AM [test-akka.actor.default-dispatcher-12] [INFO] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server (Follower): Term 1 in "AppendEntries [leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=0, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 0 - updating term
09:25:18,864 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorServerConfigurationSupportTest$MockNewFollowerRaftActor - new-server: Set currentTerm=1, votedFor=null
09:25:18,864 AM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - new-server: Last sync leader does not match current leader leader, need to catch up to -1
09:25:18,864 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for new-server updated: matchIndex: -1, nextIndex: 0
09:25:18,864 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorServerConfigurationSupportTest$MockLeaderRaftActor - leader (Leader): Checking sendAppendEntries for follower new-server: active: false, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [04/25/2024 09:25:18.865] [test-akka.actor.default-dispatcher-5] [akka://test/user/new-server259] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@754e4e28
09:25:18,962 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupport - leader: handleInstallSnapshotTimeout for new server new-server
09:25:18,962 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorServerConfigurationSupport - leader: Returning TIMEOUT for operation AddServer [newServerId=new-server, newServerAddress=akka://test/user/new-server259, votingMember=true]
09:25:18,963 AM [test-akka.actor.default-dispatcher-16] [WARN] RaftActorServerConfigurationSupport - leader: Timeout occured for new server new-server while waiting for prior snapshot to complete
09:25:18,963 AM [main] [INFO] RaftActorServerConfigurationSupportTest - testAddServerWithPriorSnapshotCompleteTimeout ending
09:25:18,963 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower257]
09:25:18,974 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/new-serverCollector258#-783792370]
09:25:18,974 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/new-server259]
09:25:18,975 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader260]
[INFO] [04/25/2024 09:25:18.976] [main] [CoordinatedShutdown(akka://test)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason]
09:25:18,976 AM [test-akka.actor.default-dispatcher-17] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason]
[WARN] [04/25/2024 09:25:18.977] [test-akka.actor.default-dispatcher-17] [akka://test/system/cluster/core/daemon] unhandled message from Actor[akka://test/deadLetters]: Leave(akka://test@10.30.170.129:25520)
[INFO] [04/25/2024 09:25:18.979] [test-akka.actor.internal-dispatcher-2] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.129:25520] - Exiting completed
[INFO] [04/25/2024 09:25:18.979] [test-akka.actor.internal-dispatcher-2] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.129:25520] - Shutting down...
09:25:18,979 AM [test-akka.actor.default-dispatcher-17] [INFO] Cluster - Cluster Node [akka://test@10.30.170.129:25520] - Exiting completed
09:25:18,979 AM [test-akka.actor.default-dispatcher-17] [INFO] Cluster - Cluster Node [akka://test@10.30.170.129:25520] - Shutting down...
09:25:18,979 AM [test-akka.actor.default-dispatcher-17] [INFO] Cluster - Cluster Node [akka://test@10.30.170.129:25520] - Successfully shut down
[INFO] [04/25/2024 09:25:18.979] [test-akka.actor.internal-dispatcher-2] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.129:25520] - Successfully shut down
[INFO] [04/25/2024 09:25:18.982] [test-akka.remote.default-remote-dispatcher-9] [akka://test@10.30.170.129:25520/system/remoting-terminator] Shutting down remote daemon.
[INFO] [04/25/2024 09:25:18.982] [test-akka.remote.default-remote-dispatcher-9] [akka://test@10.30.170.129:25520/system/remoting-terminator] Remote daemon shut down; proceeding with flushing remote transports.
09:25:18,982 AM [test-akka.actor.default-dispatcher-5] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon.
09:25:18,982 AM [test-akka.actor.default-dispatcher-5] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports.