01:16:11,177 AM [system1-akka.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started 01:16:11,973 AM [system1-akka.actor.default-dispatcher-8] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: no initial generation override, starting from 0 01:16:11,976 AM [system1-akka.actor.default-dispatcher-8] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: persisting new identifier ClientIdentifier{frontend=member-1-frontend-type-1, generation=0} 01:16:11,978 AM [system1-akka.actor.default-dispatcher-8] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.RecoveringClientActorBehavior@5703f8e1 to org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@52780d72 01:16:11,987 AM [system1-akka.actor.default-dispatcher-8] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: SaveSnapshotSuccess(SnapshotMetadata(member-1-frontend-type-1, 0, 1712970971978, None)) 01:16:11,993 AM [system1-akka.actor.default-dispatcher-8] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,1712970971977,0,0)) 01:16:12,4 AM [system1-akka.actor.default-dispatcher-5] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: recovered identifier ClientIdentifier{frontend=another-frontend-type-2, generation=0} 01:16:12,6 AM [system1-akka.actor.default-dispatcher-5] [ERROR] RecoveringClientActorBehavior - member-1-frontend-type-1: Mismatched frontend identifier, shutting down. Current: member-1-frontend-type-1 Saved: another-frontend-type-2 01:16:12,6 AM [system1-akka.actor.default-dispatcher-5] [DEBUG] AbstractClientActor - member-1-frontend-type-1: shutting down 01:16:12,85 AM [system1-akka.actor.default-dispatcher-8] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@52780d72 to org.opendaylight.controller.cluster.access.client.ClientActorBehavior$MockitoMock$eIEMY2GG@4861cca9 [INFO] [04/13/2024 01:16:12.081] [main] [CoordinatedShutdown(akka://system1)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 01:16:12,101 AM [system1-akka.actor.default-dispatcher-10] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] [ERROR] [04/13/2024 01:16:12.102] [system1-akka.actor.default-dispatcher-8] [akka://system1/user/$a] Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:117) at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:116) at org.opendaylight.controller.cluster.access.client.AbstractClientActor.postStop(AbstractClientActor.java:37) at akka.actor.Actor.aroundPostStop(Actor.scala:556) at akka.actor.Actor.aroundPostStop$(Actor.scala:556) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundPostStop(PersistentActor.scala:295) at akka.persistence.Eventsourced.aroundPostStop(Eventsourced.scala:298) at akka.persistence.Eventsourced.aroundPostStop$(Eventsourced.scala:294) at akka.persistence.AbstractPersistentActor.aroundPostStop(PersistentActor.scala:295) at akka.actor.dungeon.FaultHandling.finishTerminate(FaultHandling.scala:242) at akka.actor.dungeon.FaultHandling.terminate(FaultHandling.scala:199) at akka.actor.dungeon.FaultHandling.terminate$(FaultHandling.scala:169) at akka.actor.ActorCell.terminate(ActorCell.scala:410) at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:519) at akka.actor.ActorCell.systemInvoke(ActorCell.scala:535) at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:295) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:273) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 01:16:12,106 AM [system1-akka.actor.default-dispatcher-8] [ERROR] ActorBehaviorTest$MockedActor - Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:117) at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:116) at org.opendaylight.controller.cluster.access.client.AbstractClientActor.postStop(AbstractClientActor.java:37) at akka.actor.Actor.aroundPostStop(Actor.scala:556) at akka.actor.Actor.aroundPostStop$(Actor.scala:556) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundPostStop(PersistentActor.scala:295) at akka.persistence.Eventsourced.aroundPostStop(Eventsourced.scala:298) at akka.persistence.Eventsourced.aroundPostStop$(Eventsourced.scala:294) at akka.persistence.AbstractPersistentActor.aroundPostStop(PersistentActor.scala:295) at akka.actor.dungeon.FaultHandling.finishTerminate(FaultHandling.scala:242) at akka.actor.dungeon.FaultHandling.terminate(FaultHandling.scala:199) at akka.actor.dungeon.FaultHandling.terminate$(FaultHandling.scala:169) at akka.actor.ActorCell.terminate(ActorCell.scala:410) at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:519) at akka.actor.ActorCell.systemInvoke(ActorCell.scala:535) at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:295) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:273) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 01:16:12,185 AM [system1-akka.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started 01:16:12,238 AM [system1-akka.actor.default-dispatcher-5] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: no initial generation override, starting from 0 01:16:12,238 AM [system1-akka.actor.default-dispatcher-5] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: persisting new identifier ClientIdentifier{frontend=member-1-frontend-type-1, generation=0} 01:16:12,238 AM [system1-akka.actor.default-dispatcher-5] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.RecoveringClientActorBehavior@12ed4720 to org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@30f0db4a 01:16:12,241 AM [system1-akka.actor.default-dispatcher-5] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: SaveSnapshotSuccess(SnapshotMetadata(member-1-frontend-type-1, 0, 1712970972239, None)) [WARN] [04/13/2024 01:16:12.250] [system1-akka.actor.default-dispatcher-6] [akka://system1/user/$a] received dead letter from Actor[akka://system1/system/in-memory-snapshot-store#1499868616]: DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,1712970972238,0,0)) 01:16:12,255 AM [system1-akka.actor.default-dispatcher-7] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: no initial generation override, starting from 0 01:16:12,255 AM [system1-akka.actor.default-dispatcher-7] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: persisting new identifier ClientIdentifier{frontend=member-1-frontend-type-1, generation=0} 01:16:12,255 AM [system1-akka.actor.default-dispatcher-7] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.RecoveringClientActorBehavior@71cdd171 to org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@1e66b869 01:16:12,256 AM [system1-akka.actor.default-dispatcher-11] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: SaveSnapshotSuccess(SnapshotMetadata(member-1-frontend-type-1, 0, 1712970972255, None)) 01:16:12,259 AM [system1-akka.actor.default-dispatcher-11] [WARN] SavingClientActorBehavior - member-1-frontend-type-1: failed to delete prior snapshots java.lang.RuntimeException: delete failed at org.opendaylight.controller.cluster.access.client.ActorBehaviorTest.testRecoveryAfterRestartDeleteSnapshotsFail(ActorBehaviorTest.java:156) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:568) at org.junit.platform.commons.util.ReflectionUtils.invokeMethod(ReflectionUtils.java:728) at org.junit.jupiter.engine.execution.MethodInvocation.proceed(MethodInvocation.java:60) at org.junit.jupiter.engine.execution.InvocationInterceptorChain$ValidatingInvocation.proceed(InvocationInterceptorChain.java:131) at org.junit.jupiter.engine.extension.TimeoutExtension.intercept(TimeoutExtension.java:156) at org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestableMethod(TimeoutExtension.java:147) at org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestMethod(TimeoutExtension.java:86) at org.junit.jupiter.engine.execution.InterceptingExecutableInvoker$ReflectiveInterceptorCall.lambda$ofVoidMethod$0(InterceptingExecutableInvoker.java:103) at org.junit.jupiter.engine.execution.InterceptingExecutableInvoker.lambda$invoke$0(InterceptingExecutableInvoker.java:93) at org.junit.jupiter.engine.execution.InvocationInterceptorChain$InterceptedInvocation.proceed(InvocationInterceptorChain.java:106) at org.junit.jupiter.engine.execution.InvocationInterceptorChain.proceed(InvocationInterceptorChain.java:64) at org.junit.jupiter.engine.execution.InvocationInterceptorChain.chainAndInvoke(InvocationInterceptorChain.java:45) at org.junit.jupiter.engine.execution.InvocationInterceptorChain.invoke(InvocationInterceptorChain.java:37) at org.junit.jupiter.engine.execution.InterceptingExecutableInvoker.invoke(InterceptingExecutableInvoker.java:92) at org.junit.jupiter.engine.execution.InterceptingExecutableInvoker.invoke(InterceptingExecutableInvoker.java:86) at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.lambda$invokeTestMethod$7(TestMethodTestDescriptor.java:218) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.invokeTestMethod(TestMethodTestDescriptor.java:214) at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:139) at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:69) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeTestTask.java:151) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:141) at org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$9(NodeTestTask.java:139) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:138) at org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:95) at java.base/java.util.ArrayList.forEach(ArrayList.java:1511) at org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.invokeAll(SameThreadHierarchicalTestExecutorService.java:41) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeTestTask.java:155) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:141) at org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$9(NodeTestTask.java:139) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:138) at org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:95) at java.base/java.util.ArrayList.forEach(ArrayList.java:1511) at org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.invokeAll(SameThreadHierarchicalTestExecutorService.java:41) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeTestTask.java:155) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:141) at org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$9(NodeTestTask.java:139) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:138) at org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:95) at org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.submit(SameThreadHierarchicalTestExecutorService.java:35) at org.junit.platform.engine.support.hierarchical.HierarchicalTestExecutor.execute(HierarchicalTestExecutor.java:57) at org.junit.platform.engine.support.hierarchical.HierarchicalTestEngine.execute(HierarchicalTestEngine.java:54) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:198) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:169) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:93) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.lambda$execute$0(EngineExecutionOrchestrator.java:58) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.withInterceptedStreams(EngineExecutionOrchestrator.java:141) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:57) at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:103) at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:85) at org.junit.platform.launcher.core.DelegatingLauncher.execute(DelegatingLauncher.java:47) at org.apache.maven.surefire.junitplatform.LazyLauncher.execute(LazyLauncher.java:56) at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.execute(JUnitPlatformProvider.java:184) at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invokeAllTests(JUnitPlatformProvider.java:148) at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invoke(JUnitPlatformProvider.java:122) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:385) at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:162) at org.apache.maven.surefire.booter.ForkedBooter.run(ForkedBooter.java:507) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:495) 01:16:12,263 AM [system1-akka.actor.default-dispatcher-11] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@1e66b869 to org.opendaylight.controller.cluster.access.client.ClientActorBehavior$MockitoMock$eIEMY2GG@3fe3ebb3 [INFO] [akkaDeadLetter][04/13/2024 01:16:12.268] [system1-akka.actor.default-dispatcher-12] [akka://system1/user/$a] Message [akka.persistence.DeleteSnapshotsSuccess] from Actor[akka://system1/system/in-memory-snapshot-store#1499868616] to Actor[akka://system1/user/$a#-798418903] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://system1/user/$a#-798418903] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:16:12,273 AM [system1-akka.actor.default-dispatcher-12] [INFO] RepointableActorRef - Message [akka.persistence.DeleteSnapshotsSuccess] from Actor[akka://system1/system/in-memory-snapshot-store#1499868616] to Actor[akka://system1/user/$a#-798418903] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://system1/user/$a#-798418903] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [INFO] [04/13/2024 01:16:12.363] [main] [CoordinatedShutdown(akka://system1)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 01:16:12,365 AM [system1-akka.actor.default-dispatcher-12] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] [ERROR] [04/13/2024 01:16:12.367] [system1-akka.actor.default-dispatcher-11] [akka://system1/user/$b] Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:117) at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:116) at org.opendaylight.controller.cluster.access.client.AbstractClientActor.postStop(AbstractClientActor.java:37) at akka.actor.Actor.aroundPostStop(Actor.scala:556) at akka.actor.Actor.aroundPostStop$(Actor.scala:556) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundPostStop(PersistentActor.scala:295) at akka.persistence.Eventsourced.aroundPostStop(Eventsourced.scala:298) at akka.persistence.Eventsourced.aroundPostStop$(Eventsourced.scala:294) at akka.persistence.AbstractPersistentActor.aroundPostStop(PersistentActor.scala:295) at akka.actor.dungeon.FaultHandling.finishTerminate(FaultHandling.scala:242) at akka.actor.dungeon.FaultHandling.terminate(FaultHandling.scala:199) at akka.actor.dungeon.FaultHandling.terminate$(FaultHandling.scala:169) at akka.actor.ActorCell.terminate(ActorCell.scala:410) at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:519) at akka.actor.ActorCell.systemInvoke(ActorCell.scala:535) at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:295) at akka.dispatch.Mailbox.run(Mailbox.scala:230) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 01:16:12,367 AM [system1-akka.actor.default-dispatcher-11] [ERROR] ActorBehaviorTest$MockedActor - Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:117) at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:116) at org.opendaylight.controller.cluster.access.client.AbstractClientActor.postStop(AbstractClientActor.java:37) at akka.actor.Actor.aroundPostStop(Actor.scala:556) at akka.actor.Actor.aroundPostStop$(Actor.scala:556) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundPostStop(PersistentActor.scala:295) at akka.persistence.Eventsourced.aroundPostStop(Eventsourced.scala:298) at akka.persistence.Eventsourced.aroundPostStop$(Eventsourced.scala:294) at akka.persistence.AbstractPersistentActor.aroundPostStop(PersistentActor.scala:295) at akka.actor.dungeon.FaultHandling.finishTerminate(FaultHandling.scala:242) at akka.actor.dungeon.FaultHandling.terminate(FaultHandling.scala:199) at akka.actor.dungeon.FaultHandling.terminate$(FaultHandling.scala:169) at akka.actor.ActorCell.terminate(ActorCell.scala:410) at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:519) at akka.actor.ActorCell.systemInvoke(ActorCell.scala:535) at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:295) at akka.dispatch.Mailbox.run(Mailbox.scala:230) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 01:16:12,410 AM [system1-akka.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started 01:16:12,476 AM [system1-akka.actor.default-dispatcher-6] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: no initial generation override, starting from 0 01:16:12,476 AM [system1-akka.actor.default-dispatcher-6] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: persisting new identifier ClientIdentifier{frontend=member-1-frontend-type-1, generation=0} 01:16:12,476 AM [system1-akka.actor.default-dispatcher-6] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.RecoveringClientActorBehavior@3b93d84a to org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@ae20717 01:16:12,479 AM [system1-akka.actor.default-dispatcher-8] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: SaveSnapshotSuccess(SnapshotMetadata(member-1-frontend-type-1, 0, 1712970972478, None)) 01:16:12,481 AM [system1-akka.actor.default-dispatcher-5] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,1712970972477,0,0)) 01:16:12,482 AM [system1-akka.actor.default-dispatcher-5] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@ae20717 to org.opendaylight.controller.cluster.access.client.ClientActorBehavior$MockitoMock$eIEMY2GG@6af0407c [INFO] [04/13/2024 01:16:12.498] [main] [CoordinatedShutdown(akka://system1)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 01:16:12,501 AM [system1-akka.actor.default-dispatcher-8] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 01:16:12,503 AM [system1-akka.actor.default-dispatcher-8] [ERROR] ActorBehaviorTest$MockedActor - Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:117) at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:116) at org.opendaylight.controller.cluster.access.client.AbstractClientActor.postStop(AbstractClientActor.java:37) at akka.actor.Actor.aroundPostStop(Actor.scala:556) at akka.actor.Actor.aroundPostStop$(Actor.scala:556) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundPostStop(PersistentActor.scala:295) at akka.persistence.Eventsourced.aroundPostStop(Eventsourced.scala:298) at akka.persistence.Eventsourced.aroundPostStop$(Eventsourced.scala:294) at akka.persistence.AbstractPersistentActor.aroundPostStop(PersistentActor.scala:295) at akka.actor.dungeon.FaultHandling.finishTerminate(FaultHandling.scala:242) at akka.actor.dungeon.FaultHandling.terminate(FaultHandling.scala:199) at akka.actor.dungeon.FaultHandling.terminate$(FaultHandling.scala:169) at akka.actor.ActorCell.terminate(ActorCell.scala:410) at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:519) at akka.actor.ActorCell.systemInvoke(ActorCell.scala:535) at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:295) at akka.dispatch.Mailbox.run(Mailbox.scala:230) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) [ERROR] [04/13/2024 01:16:12.503] [system1-akka.actor.default-dispatcher-8] [akka://system1/user/$a] Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:117) at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:116) at org.opendaylight.controller.cluster.access.client.AbstractClientActor.postStop(AbstractClientActor.java:37) at akka.actor.Actor.aroundPostStop(Actor.scala:556) at akka.actor.Actor.aroundPostStop$(Actor.scala:556) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundPostStop(PersistentActor.scala:295) at akka.persistence.Eventsourced.aroundPostStop(Eventsourced.scala:298) at akka.persistence.Eventsourced.aroundPostStop$(Eventsourced.scala:294) at akka.persistence.AbstractPersistentActor.aroundPostStop(PersistentActor.scala:295) at akka.actor.dungeon.FaultHandling.finishTerminate(FaultHandling.scala:242) at akka.actor.dungeon.FaultHandling.terminate(FaultHandling.scala:199) at akka.actor.dungeon.FaultHandling.terminate$(FaultHandling.scala:169) at akka.actor.ActorCell.terminate(ActorCell.scala:410) at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:519) at akka.actor.ActorCell.systemInvoke(ActorCell.scala:535) at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:295) at akka.dispatch.Mailbox.run(Mailbox.scala:230) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 01:16:12,555 AM [system1-akka.actor.default-dispatcher-6] [INFO] Slf4jLogger - Slf4jLogger started 01:16:12,622 AM [system1-akka.actor.default-dispatcher-9] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: no initial generation override, starting from 0 01:16:12,622 AM [system1-akka.actor.default-dispatcher-9] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: persisting new identifier ClientIdentifier{frontend=member-1-frontend-type-1, generation=0} 01:16:12,622 AM [system1-akka.actor.default-dispatcher-9] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.RecoveringClientActorBehavior@6e34b067 to org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@484f596b 01:16:12,623 AM [system1-akka.actor.default-dispatcher-9] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: SaveSnapshotSuccess(SnapshotMetadata(member-1-frontend-type-1, 0, 1712970972622, None)) [WARN] [04/13/2024 01:16:12.625] [system1-akka.actor.default-dispatcher-9] [akka://system1/user/$a] received dead letter from Actor[akka://system1/system/in-memory-snapshot-store#1071624182]: DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,1712970972621,0,0)) [INFO] [akkaDeadLetter][04/13/2024 01:16:12.626] [system1-akka.actor.default-dispatcher-9] [akka://system1/user/$a] Message [akka.persistence.DeleteSnapshotsSuccess] from Actor[akka://system1/system/in-memory-snapshot-store#1071624182] to Actor[akka://system1/user/$a#-1770805694] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://system1/user/$a#-1770805694] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:16:12,629 AM [system1-akka.actor.default-dispatcher-9] [INFO] RepointableActorRef - Message [akka.persistence.DeleteSnapshotsSuccess] from Actor[akka://system1/system/in-memory-snapshot-store#1071624182] to Actor[akka://system1/user/$a#-1770805694] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://system1/user/$a#-1770805694] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:16:12,638 AM [system1-akka.actor.default-dispatcher-7] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: recovered identifier ClientIdentifier{frontend=member-1-frontend-type-1, generation=0} 01:16:12,639 AM [system1-akka.actor.default-dispatcher-7] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: persisting new identifier ClientIdentifier{frontend=member-1-frontend-type-1, generation=1} 01:16:12,639 AM [system1-akka.actor.default-dispatcher-7] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.RecoveringClientActorBehavior@45e7787b to org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@7f19d6dc 01:16:12,640 AM [system1-akka.actor.default-dispatcher-7] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: SaveSnapshotSuccess(SnapshotMetadata(member-1-frontend-type-1, 0, 1712970972640, None)) 01:16:12,649 AM [system1-akka.actor.default-dispatcher-7] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,1712970972639,0,0)) 01:16:12,650 AM [system1-akka.actor.default-dispatcher-7] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@7f19d6dc to org.opendaylight.controller.cluster.access.client.ClientActorBehavior$MockitoMock$eIEMY2GG@46aea9f7 [INFO] [04/13/2024 01:16:12.648] [main] [CoordinatedShutdown(akka://system1)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 01:16:12,651 AM [system1-akka.actor.default-dispatcher-7] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] [ERROR] [04/13/2024 01:16:12.654] [system1-akka.actor.default-dispatcher-7] [akka://system1/user/$b] Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:117) at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:116) at org.opendaylight.controller.cluster.access.client.AbstractClientActor.postStop(AbstractClientActor.java:37) at akka.actor.Actor.aroundPostStop(Actor.scala:556) at akka.actor.Actor.aroundPostStop$(Actor.scala:556) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundPostStop(PersistentActor.scala:295) at akka.persistence.Eventsourced.aroundPostStop(Eventsourced.scala:298) at akka.persistence.Eventsourced.aroundPostStop$(Eventsourced.scala:294) at akka.persistence.AbstractPersistentActor.aroundPostStop(PersistentActor.scala:295) at akka.actor.dungeon.FaultHandling.finishTerminate(FaultHandling.scala:242) at akka.actor.dungeon.FaultHandling.terminate(FaultHandling.scala:199) at akka.actor.dungeon.FaultHandling.terminate$(FaultHandling.scala:169) at akka.actor.ActorCell.terminate(ActorCell.scala:410) at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:519) at akka.actor.ActorCell.systemInvoke(ActorCell.scala:535) at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:295) at akka.dispatch.Mailbox.run(Mailbox.scala:230) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 01:16:12,654 AM [system1-akka.actor.default-dispatcher-7] [ERROR] ActorBehaviorTest$MockedActor - Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:117) at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:116) at org.opendaylight.controller.cluster.access.client.AbstractClientActor.postStop(AbstractClientActor.java:37) at akka.actor.Actor.aroundPostStop(Actor.scala:556) at akka.actor.Actor.aroundPostStop$(Actor.scala:556) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundPostStop(PersistentActor.scala:295) at akka.persistence.Eventsourced.aroundPostStop(Eventsourced.scala:298) at akka.persistence.Eventsourced.aroundPostStop$(Eventsourced.scala:294) at akka.persistence.AbstractPersistentActor.aroundPostStop(PersistentActor.scala:295) at akka.actor.dungeon.FaultHandling.finishTerminate(FaultHandling.scala:242) at akka.actor.dungeon.FaultHandling.terminate(FaultHandling.scala:199) at akka.actor.dungeon.FaultHandling.terminate$(FaultHandling.scala:169) at akka.actor.ActorCell.terminate(ActorCell.scala:410) at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:519) at akka.actor.ActorCell.systemInvoke(ActorCell.scala:535) at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:295) at akka.dispatch.Mailbox.run(Mailbox.scala:230) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 01:16:12,698 AM [system1-akka.actor.default-dispatcher-6] [INFO] Slf4jLogger - Slf4jLogger started 01:16:12,741 AM [system1-akka.actor.default-dispatcher-8] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: no initial generation override, starting from 0 01:16:12,741 AM [system1-akka.actor.default-dispatcher-8] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: persisting new identifier ClientIdentifier{frontend=member-1-frontend-type-1, generation=0} 01:16:12,742 AM [system1-akka.actor.default-dispatcher-8] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.RecoveringClientActorBehavior@4a5d1104 to org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@1bbf1ff7 01:16:12,743 AM [system1-akka.actor.default-dispatcher-9] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: SaveSnapshotSuccess(SnapshotMetadata(member-1-frontend-type-1, 0, 1712970972742, None)) 01:16:12,747 AM [system1-akka.actor.default-dispatcher-7] [INFO] RepointableActorRef - Message [akka.persistence.DeleteSnapshotsSuccess] from Actor[akka://system1/system/in-memory-snapshot-store#-474460467] to Actor[akka://system1/user/$a#1461060892] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://system1/user/$a#1461060892] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:16:12,748 AM [system1-akka.actor.default-dispatcher-8] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: no initial generation override, starting from 0 01:16:12,748 AM [system1-akka.actor.default-dispatcher-8] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: persisting new identifier ClientIdentifier{frontend=member-1-frontend-type-1, generation=0} 01:16:12,748 AM [system1-akka.actor.default-dispatcher-8] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.RecoveringClientActorBehavior@8850b6e to org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@1f808858 01:16:12,749 AM [system1-akka.actor.default-dispatcher-8] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: stashing command cmd 01:16:12,749 AM [system1-akka.actor.default-dispatcher-8] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: stashing command cmd 01:16:12,749 AM [system1-akka.actor.default-dispatcher-8] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: stashing command cmd 01:16:12,750 AM [system1-akka.actor.default-dispatcher-9] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: SaveSnapshotSuccess(SnapshotMetadata(member-1-frontend-type-1, 0, 1712970972749, None)) 01:16:12,756 AM [system1-akka.actor.default-dispatcher-9] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,1712970972748,0,0)) 01:16:12,757 AM [system1-akka.actor.default-dispatcher-9] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@1f808858 to org.opendaylight.controller.cluster.access.client.ClientActorBehavior$MockitoMock$eIEMY2GG@3b72860c [WARN] [04/13/2024 01:16:12.758] [system1-akka.actor.default-dispatcher-6] [akka://system1/user/$a] received dead letter from Actor[akka://system1/system/in-memory-snapshot-store#-474460467]: DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,1712970972741,0,0)) [INFO] [akkaDeadLetter][04/13/2024 01:16:12.746] [system1-akka.actor.default-dispatcher-7] [akka://system1/user/$a] Message [akka.persistence.DeleteSnapshotsSuccess] from Actor[akka://system1/system/in-memory-snapshot-store#-474460467] to Actor[akka://system1/user/$a#1461060892] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://system1/user/$a#1461060892] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [INFO] [04/13/2024 01:16:12.778] [main] [CoordinatedShutdown(akka://system1)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 01:16:12,779 AM [system1-akka.actor.default-dispatcher-12] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] [ERROR] [04/13/2024 01:16:12.783] [system1-akka.actor.default-dispatcher-6] [akka://system1/user/$b] Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:117) at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:116) at org.opendaylight.controller.cluster.access.client.AbstractClientActor.postStop(AbstractClientActor.java:37) at akka.actor.Actor.aroundPostStop(Actor.scala:556) at akka.actor.Actor.aroundPostStop$(Actor.scala:556) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundPostStop(PersistentActor.scala:295) at akka.persistence.Eventsourced.aroundPostStop(Eventsourced.scala:298) at akka.persistence.Eventsourced.aroundPostStop$(Eventsourced.scala:294) at akka.persistence.AbstractPersistentActor.aroundPostStop(PersistentActor.scala:295) at akka.actor.dungeon.FaultHandling.finishTerminate(FaultHandling.scala:242) at akka.actor.dungeon.FaultHandling.terminate(FaultHandling.scala:199) at akka.actor.dungeon.FaultHandling.terminate$(FaultHandling.scala:169) at akka.actor.ActorCell.terminate(ActorCell.scala:410) at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:519) at akka.actor.ActorCell.systemInvoke(ActorCell.scala:535) at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:295) at akka.dispatch.Mailbox.run(Mailbox.scala:230) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 01:16:12,783 AM [system1-akka.actor.default-dispatcher-6] [ERROR] ActorBehaviorTest$MockedActor - Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:117) at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:116) at org.opendaylight.controller.cluster.access.client.AbstractClientActor.postStop(AbstractClientActor.java:37) at akka.actor.Actor.aroundPostStop(Actor.scala:556) at akka.actor.Actor.aroundPostStop$(Actor.scala:556) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundPostStop(PersistentActor.scala:295) at akka.persistence.Eventsourced.aroundPostStop(Eventsourced.scala:298) at akka.persistence.Eventsourced.aroundPostStop$(Eventsourced.scala:294) at akka.persistence.AbstractPersistentActor.aroundPostStop(PersistentActor.scala:295) at akka.actor.dungeon.FaultHandling.finishTerminate(FaultHandling.scala:242) at akka.actor.dungeon.FaultHandling.terminate(FaultHandling.scala:199) at akka.actor.dungeon.FaultHandling.terminate$(FaultHandling.scala:169) at akka.actor.ActorCell.terminate(ActorCell.scala:410) at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:519) at akka.actor.ActorCell.systemInvoke(ActorCell.scala:535) at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:295) at akka.dispatch.Mailbox.run(Mailbox.scala:230) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 01:16:12,821 AM [system1-akka.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started 01:16:12,890 AM [system1-akka.actor.default-dispatcher-9] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: no initial generation override, starting from 0 01:16:12,890 AM [system1-akka.actor.default-dispatcher-9] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: persisting new identifier ClientIdentifier{frontend=member-1-frontend-type-1, generation=0} 01:16:12,891 AM [system1-akka.actor.default-dispatcher-9] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.RecoveringClientActorBehavior@63b40ed to org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@4ac0c2d7 01:16:12,892 AM [system1-akka.actor.default-dispatcher-6] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: SaveSnapshotSuccess(SnapshotMetadata(member-1-frontend-type-1, 0, 1712970972891, None)) [WARN] [04/13/2024 01:16:12.896] [system1-akka.actor.default-dispatcher-9] [akka://system1/user/$a] received dead letter from Actor[akka://system1/system/in-memory-snapshot-store#-2093103842]: DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,1712970972890,0,0)) [INFO] [akkaDeadLetter][04/13/2024 01:16:12.896] [system1-akka.actor.default-dispatcher-9] [akka://system1/user/$a] Message [akka.persistence.DeleteSnapshotsSuccess] from Actor[akka://system1/system/in-memory-snapshot-store#-2093103842] to Actor[akka://system1/user/$a#1428740468] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://system1/user/$a#1428740468] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:16:12,897 AM [system1-akka.actor.default-dispatcher-9] [INFO] RepointableActorRef - Message [akka.persistence.DeleteSnapshotsSuccess] from Actor[akka://system1/system/in-memory-snapshot-store#-2093103842] to Actor[akka://system1/user/$a#1428740468] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://system1/user/$a#1428740468] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:16:12,923 AM [system1-akka.actor.default-dispatcher-6] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: no initial generation override, starting from 0 01:16:12,924 AM [system1-akka.actor.default-dispatcher-6] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: persisting new identifier ClientIdentifier{frontend=member-1-frontend-type-1, generation=0} 01:16:12,924 AM [system1-akka.actor.default-dispatcher-6] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.RecoveringClientActorBehavior@3af4ac39 to org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@31968e71 01:16:12,929 AM [system1-akka.actor.default-dispatcher-9] [ERROR] SavingClientActorBehavior - member-1-frontend-type-1: failed to persist state java.lang.RuntimeException: save failed at org.opendaylight.controller.cluster.access.client.ActorBehaviorTest.testRecoveryAfterRestartSaveSnapshotFail(ActorBehaviorTest.java:141) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:568) at org.junit.platform.commons.util.ReflectionUtils.invokeMethod(ReflectionUtils.java:728) at org.junit.jupiter.engine.execution.MethodInvocation.proceed(MethodInvocation.java:60) at org.junit.jupiter.engine.execution.InvocationInterceptorChain$ValidatingInvocation.proceed(InvocationInterceptorChain.java:131) at org.junit.jupiter.engine.extension.TimeoutExtension.intercept(TimeoutExtension.java:156) at org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestableMethod(TimeoutExtension.java:147) at org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestMethod(TimeoutExtension.java:86) at org.junit.jupiter.engine.execution.InterceptingExecutableInvoker$ReflectiveInterceptorCall.lambda$ofVoidMethod$0(InterceptingExecutableInvoker.java:103) at org.junit.jupiter.engine.execution.InterceptingExecutableInvoker.lambda$invoke$0(InterceptingExecutableInvoker.java:93) at org.junit.jupiter.engine.execution.InvocationInterceptorChain$InterceptedInvocation.proceed(InvocationInterceptorChain.java:106) at org.junit.jupiter.engine.execution.InvocationInterceptorChain.proceed(InvocationInterceptorChain.java:64) at org.junit.jupiter.engine.execution.InvocationInterceptorChain.chainAndInvoke(InvocationInterceptorChain.java:45) at org.junit.jupiter.engine.execution.InvocationInterceptorChain.invoke(InvocationInterceptorChain.java:37) at org.junit.jupiter.engine.execution.InterceptingExecutableInvoker.invoke(InterceptingExecutableInvoker.java:92) at org.junit.jupiter.engine.execution.InterceptingExecutableInvoker.invoke(InterceptingExecutableInvoker.java:86) at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.lambda$invokeTestMethod$7(TestMethodTestDescriptor.java:218) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.invokeTestMethod(TestMethodTestDescriptor.java:214) at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:139) at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:69) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeTestTask.java:151) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:141) at org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$9(NodeTestTask.java:139) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:138) at org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:95) at java.base/java.util.ArrayList.forEach(ArrayList.java:1511) at org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.invokeAll(SameThreadHierarchicalTestExecutorService.java:41) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeTestTask.java:155) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:141) at org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$9(NodeTestTask.java:139) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:138) at org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:95) at java.base/java.util.ArrayList.forEach(ArrayList.java:1511) at org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.invokeAll(SameThreadHierarchicalTestExecutorService.java:41) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeTestTask.java:155) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:141) at org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$9(NodeTestTask.java:139) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:138) at org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:95) at org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.submit(SameThreadHierarchicalTestExecutorService.java:35) at org.junit.platform.engine.support.hierarchical.HierarchicalTestExecutor.execute(HierarchicalTestExecutor.java:57) at org.junit.platform.engine.support.hierarchical.HierarchicalTestEngine.execute(HierarchicalTestEngine.java:54) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:198) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:169) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:93) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.lambda$execute$0(EngineExecutionOrchestrator.java:58) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.withInterceptedStreams(EngineExecutionOrchestrator.java:141) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:57) at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:103) at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:85) at org.junit.platform.launcher.core.DelegatingLauncher.execute(DelegatingLauncher.java:47) at org.apache.maven.surefire.junitplatform.LazyLauncher.execute(LazyLauncher.java:56) at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.execute(JUnitPlatformProvider.java:184) at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invokeAllTests(JUnitPlatformProvider.java:148) at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invoke(JUnitPlatformProvider.java:122) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:385) at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:162) at org.apache.maven.surefire.booter.ForkedBooter.run(ForkedBooter.java:507) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:495) 01:16:12,931 AM [system1-akka.actor.default-dispatcher-9] [DEBUG] AbstractClientActor - member-1-frontend-type-1: shutting down 01:16:12,935 AM [system1-akka.actor.default-dispatcher-5] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] [INFO] [04/13/2024 01:16:12.934] [main] [CoordinatedShutdown(akka://system1)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason]