08:40:07,124 AM [system1-akka.actor.default-dispatcher-4] [INFO] Slf4jLogger - Slf4jLogger started 08:40:07,994 AM [system1-akka.actor.default-dispatcher-4] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: no initial generation override, starting from 0 08:40:07,999 AM [system1-akka.actor.default-dispatcher-4] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: persisting new identifier ClientIdentifier{frontend=member-1-frontend-type-1, generation=0} 08:40:08,2 AM [system1-akka.actor.default-dispatcher-4] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.RecoveringClientActorBehavior@10ada7bf to org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@38537b11 08:40:08,13 AM [system1-akka.actor.default-dispatcher-5] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: SaveSnapshotSuccess(SnapshotMetadata(member-1-frontend-type-1, 0, 1711356008004, None)) 08:40:08,17 AM [system1-akka.actor.default-dispatcher-5] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,1711356008003,0,0)) 08:40:08,47 AM [system1-akka.actor.default-dispatcher-4] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: recovered identifier ClientIdentifier{frontend=another-frontend-type-2, generation=0} 08:40:08,49 AM [system1-akka.actor.default-dispatcher-10] [ERROR] RecoveringClientActorBehavior - member-1-frontend-type-1: Mismatched frontend identifier, shutting down. Current: member-1-frontend-type-1 Saved: another-frontend-type-2 08:40:08,49 AM [system1-akka.actor.default-dispatcher-10] [DEBUG] AbstractClientActor - member-1-frontend-type-1: shutting down 08:40:08,92 AM [system1-akka.actor.default-dispatcher-5] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@38537b11 to org.opendaylight.controller.cluster.access.client.ClientActorBehavior$MockitoMock$2nSTaT35@4861cca9 [INFO] [03/25/2024 08:40:08.097] [main] [CoordinatedShutdown(akka://system1)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 08:40:08,112 AM [system1-akka.actor.default-dispatcher-5] [ERROR] ActorBehaviorTest$MockedActor - Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:117) at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:116) at org.opendaylight.controller.cluster.access.client.AbstractClientActor.postStop(AbstractClientActor.java:37) at akka.actor.Actor.aroundPostStop(Actor.scala:556) at akka.actor.Actor.aroundPostStop$(Actor.scala:556) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundPostStop(PersistentActor.scala:295) at akka.persistence.Eventsourced.aroundPostStop(Eventsourced.scala:298) at akka.persistence.Eventsourced.aroundPostStop$(Eventsourced.scala:294) at akka.persistence.AbstractPersistentActor.aroundPostStop(PersistentActor.scala:295) at akka.actor.dungeon.FaultHandling.finishTerminate(FaultHandling.scala:242) at akka.actor.dungeon.FaultHandling.terminate(FaultHandling.scala:199) at akka.actor.dungeon.FaultHandling.terminate$(FaultHandling.scala:169) [ERROR] [03/25/2024 08:40:08.101] [system1-akka.actor.default-dispatcher-5] [akka://system1/user/$a] Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:117) at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:116) at org.opendaylight.controller.cluster.access.client.AbstractClientActor.postStop(AbstractClientActor.java:37) at akka.actor.Actor.aroundPostStop(Actor.scala:556) at akka.actor.Actor.aroundPostStop$(Actor.scala:556) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundPostStop(PersistentActor.scala:295) at akka.persistence.Eventsourced.aroundPostStop(Eventsourced.scala:298) at akka.persistence.Eventsourced.aroundPostStop$(Eventsourced.scala:294) at akka.persistence.AbstractPersistentActor.aroundPostStop(PersistentActor.scala:295) at akka.actor.dungeon.FaultHandling.finishTerminate(FaultHandling.scala:242) at akka.actor.dungeon.FaultHandling.terminate(FaultHandling.scala:199) at akka.actor.dungeon.FaultHandling.terminate$(FaultHandling.scala:169) at akka.actor.ActorCell.terminate(ActorCell.scala:410) at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:519) at akka.actor.ActorCell.systemInvoke(ActorCell.scala:535) at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:295) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:273) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) at akka.actor.ActorCell.terminate(ActorCell.scala:410) at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:519) at akka.actor.ActorCell.systemInvoke(ActorCell.scala:535) at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:295) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:273) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 08:40:08,114 AM [system1-akka.actor.default-dispatcher-5] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 08:40:08,216 AM [system1-akka.actor.default-dispatcher-6] [INFO] Slf4jLogger - Slf4jLogger started 08:40:08,276 AM [system1-akka.actor.default-dispatcher-7] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: no initial generation override, starting from 0 08:40:08,277 AM [system1-akka.actor.default-dispatcher-7] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: persisting new identifier ClientIdentifier{frontend=member-1-frontend-type-1, generation=0} 08:40:08,277 AM [system1-akka.actor.default-dispatcher-7] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.RecoveringClientActorBehavior@277b47a7 to org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@4a29b25c 08:40:08,278 AM [system1-akka.actor.default-dispatcher-6] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: SaveSnapshotSuccess(SnapshotMetadata(member-1-frontend-type-1, 0, 1711356008277, None)) [WARN] [03/25/2024 08:40:08.282] [system1-akka.actor.default-dispatcher-6] [akka://system1/user/$a] received dead letter from Actor[akka://system1/system/in-memory-snapshot-store#-763571923]: DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,1711356008276,0,0)) [INFO] [akkaDeadLetter][03/25/2024 08:40:08.286] [system1-akka.actor.default-dispatcher-6] [akka://system1/user/$a] Message [akka.persistence.DeleteSnapshotsSuccess] from Actor[akka://system1/system/in-memory-snapshot-store#-763571923] to Actor[akka://system1/user/$a#-1763622478] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://system1/user/$a#-1763622478] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 08:40:08,291 AM [system1-akka.actor.default-dispatcher-7] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: no initial generation override, starting from 0 08:40:08,291 AM [system1-akka.actor.default-dispatcher-7] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: persisting new identifier ClientIdentifier{frontend=member-1-frontend-type-1, generation=0} 08:40:08,291 AM [system1-akka.actor.default-dispatcher-7] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.RecoveringClientActorBehavior@b14b867 to org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@3ad550cb 08:40:08,292 AM [system1-akka.actor.default-dispatcher-8] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: SaveSnapshotSuccess(SnapshotMetadata(member-1-frontend-type-1, 0, 1711356008291, None)) 08:40:08,296 AM [system1-akka.actor.default-dispatcher-11] [WARN] SavingClientActorBehavior - member-1-frontend-type-1: failed to delete prior snapshots java.lang.RuntimeException: delete failed at org.opendaylight.controller.cluster.access.client.ActorBehaviorTest.testRecoveryAfterRestartDeleteSnapshotsFail(ActorBehaviorTest.java:156) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:568) at org.junit.platform.commons.util.ReflectionUtils.invokeMethod(ReflectionUtils.java:728) at org.junit.jupiter.engine.execution.MethodInvocation.proceed(MethodInvocation.java:60) at org.junit.jupiter.engine.execution.InvocationInterceptorChain$ValidatingInvocation.proceed(InvocationInterceptorChain.java:131) at org.junit.jupiter.engine.extension.TimeoutExtension.intercept(TimeoutExtension.java:156) at org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestableMethod(TimeoutExtension.java:147) at org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestMethod(TimeoutExtension.java:86) at org.junit.jupiter.engine.execution.InterceptingExecutableInvoker$ReflectiveInterceptorCall.lambda$ofVoidMethod$0(InterceptingExecutableInvoker.java:103) at org.junit.jupiter.engine.execution.InterceptingExecutableInvoker.lambda$invoke$0(InterceptingExecutableInvoker.java:93) at org.junit.jupiter.engine.execution.InvocationInterceptorChain$InterceptedInvocation.proceed(InvocationInterceptorChain.java:106) at org.junit.jupiter.engine.execution.InvocationInterceptorChain.proceed(InvocationInterceptorChain.java:64) at org.junit.jupiter.engine.execution.InvocationInterceptorChain.chainAndInvoke(InvocationInterceptorChain.java:45) at org.junit.jupiter.engine.execution.InvocationInterceptorChain.invoke(InvocationInterceptorChain.java:37) at org.junit.jupiter.engine.execution.InterceptingExecutableInvoker.invoke(InterceptingExecutableInvoker.java:92) at org.junit.jupiter.engine.execution.InterceptingExecutableInvoker.invoke(InterceptingExecutableInvoker.java:86) at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.lambda$invokeTestMethod$7(TestMethodTestDescriptor.java:218) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.invokeTestMethod(TestMethodTestDescriptor.java:214) at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:139) at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:69) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeTestTask.java:151) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:141) at org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$9(NodeTestTask.java:139) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:138) at org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:95) at java.base/java.util.ArrayList.forEach(ArrayList.java:1511) at org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.invokeAll(SameThreadHierarchicalTestExecutorService.java:41) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeTestTask.java:155) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:141) at org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$9(NodeTestTask.java:139) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:138) at org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:95) at java.base/java.util.ArrayList.forEach(ArrayList.java:1511) at org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.invokeAll(SameThreadHierarchicalTestExecutorService.java:41) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeTestTask.java:155) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:141) at org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$9(NodeTestTask.java:139) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:138) at org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:95) at org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.submit(SameThreadHierarchicalTestExecutorService.java:35) at org.junit.platform.engine.support.hierarchical.HierarchicalTestExecutor.execute(HierarchicalTestExecutor.java:57) at org.junit.platform.engine.support.hierarchical.HierarchicalTestEngine.execute(HierarchicalTestEngine.java:54) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:198) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:169) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:93) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.lambda$execute$0(EngineExecutionOrchestrator.java:58) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.withInterceptedStreams(EngineExecutionOrchestrator.java:141) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:57) at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:103) at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:85) at org.junit.platform.launcher.core.DelegatingLauncher.execute(DelegatingLauncher.java:47) at org.apache.maven.surefire.junitplatform.LazyLauncher.execute(LazyLauncher.java:56) at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.execute(JUnitPlatformProvider.java:184) at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invokeAllTests(JUnitPlatformProvider.java:148) at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invoke(JUnitPlatformProvider.java:122) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:385) at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:162) at org.apache.maven.surefire.booter.ForkedBooter.run(ForkedBooter.java:507) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:495) 08:40:08,302 AM [system1-akka.actor.default-dispatcher-11] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@3ad550cb to org.opendaylight.controller.cluster.access.client.ClientActorBehavior$MockitoMock$2nSTaT35@1c24639e 08:40:08,311 AM [system1-akka.actor.default-dispatcher-6] [INFO] RepointableActorRef - Message [akka.persistence.DeleteSnapshotsSuccess] from Actor[akka://system1/system/in-memory-snapshot-store#-763571923] to Actor[akka://system1/user/$a#-1763622478] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://system1/user/$a#-1763622478] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [INFO] [03/25/2024 08:40:08.399] [main] [CoordinatedShutdown(akka://system1)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 08:40:08,401 AM [system1-akka.actor.default-dispatcher-7] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 08:40:08,403 AM [system1-akka.actor.default-dispatcher-7] [ERROR] ActorBehaviorTest$MockedActor - Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null [ERROR] [03/25/2024 08:40:08.403] [system1-akka.actor.default-dispatcher-7] [akka://system1/user/$b] Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:117) at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:116) at org.opendaylight.controller.cluster.access.client.AbstractClientActor.postStop(AbstractClientActor.java:37) at akka.actor.Actor.aroundPostStop(Actor.scala:556) at akka.actor.Actor.aroundPostStop$(Actor.scala:556) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundPostStop(PersistentActor.scala:295) at akka.persistence.Eventsourced.aroundPostStop(Eventsourced.scala:298) at akka.persistence.Eventsourced.aroundPostStop$(Eventsourced.scala:294) at akka.persistence.AbstractPersistentActor.aroundPostStop(PersistentActor.scala:295) at akka.actor.dungeon.FaultHandling.finishTerminate(FaultHandling.scala:242) at akka.actor.dungeon.FaultHandling.terminate(FaultHandling.scala:199) at akka.actor.dungeon.FaultHandling.terminate$(FaultHandling.scala:169) at akka.actor.ActorCell.terminate(ActorCell.scala:410) at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:519) at akka.actor.ActorCell.systemInvoke(ActorCell.scala:535) at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:295) at akka.dispatch.Mailbox.run(Mailbox.scala:230) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:117) at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:116) at org.opendaylight.controller.cluster.access.client.AbstractClientActor.postStop(AbstractClientActor.java:37) at akka.actor.Actor.aroundPostStop(Actor.scala:556) at akka.actor.Actor.aroundPostStop$(Actor.scala:556) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundPostStop(PersistentActor.scala:295) at akka.persistence.Eventsourced.aroundPostStop(Eventsourced.scala:298) at akka.persistence.Eventsourced.aroundPostStop$(Eventsourced.scala:294) at akka.persistence.AbstractPersistentActor.aroundPostStop(PersistentActor.scala:295) at akka.actor.dungeon.FaultHandling.finishTerminate(FaultHandling.scala:242) at akka.actor.dungeon.FaultHandling.terminate(FaultHandling.scala:199) at akka.actor.dungeon.FaultHandling.terminate$(FaultHandling.scala:169) at akka.actor.ActorCell.terminate(ActorCell.scala:410) at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:519) at akka.actor.ActorCell.systemInvoke(ActorCell.scala:535) at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:295) at akka.dispatch.Mailbox.run(Mailbox.scala:230) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 08:40:08,435 AM [system1-akka.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started 08:40:08,487 AM [system1-akka.actor.default-dispatcher-5] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: no initial generation override, starting from 0 08:40:08,487 AM [system1-akka.actor.default-dispatcher-5] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: persisting new identifier ClientIdentifier{frontend=member-1-frontend-type-1, generation=0} 08:40:08,487 AM [system1-akka.actor.default-dispatcher-5] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.RecoveringClientActorBehavior@36cf5dd5 to org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@7334b58 08:40:08,488 AM [system1-akka.actor.default-dispatcher-6] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: SaveSnapshotSuccess(SnapshotMetadata(member-1-frontend-type-1, 0, 1711356008488, None)) 08:40:08,496 AM [system1-akka.actor.default-dispatcher-6] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: stashing command cmd 08:40:08,497 AM [system1-akka.actor.default-dispatcher-6] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,1711356008487,0,0)) 08:40:08,498 AM [system1-akka.actor.default-dispatcher-6] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@7334b58 to org.opendaylight.controller.cluster.access.client.ClientActorBehavior$MockitoMock$2nSTaT35@70680f88 [INFO] [03/25/2024 08:40:08.509] [main] [CoordinatedShutdown(akka://system1)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 08:40:08,511 AM [system1-akka.actor.default-dispatcher-5] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] [ERROR] [03/25/2024 08:40:08.512] [system1-akka.actor.default-dispatcher-7] [akka://system1/user/$a] Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:117) at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:116) at org.opendaylight.controller.cluster.access.client.AbstractClientActor.postStop(AbstractClientActor.java:37) at akka.actor.Actor.aroundPostStop(Actor.scala:556) at akka.actor.Actor.aroundPostStop$(Actor.scala:556) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundPostStop(PersistentActor.scala:295) at akka.persistence.Eventsourced.aroundPostStop(Eventsourced.scala:298) at akka.persistence.Eventsourced.aroundPostStop$(Eventsourced.scala:294) at akka.persistence.AbstractPersistentActor.aroundPostStop(PersistentActor.scala:295) at akka.actor.dungeon.FaultHandling.finishTerminate(FaultHandling.scala:242) at akka.actor.dungeon.FaultHandling.terminate(FaultHandling.scala:199) at akka.actor.dungeon.FaultHandling.terminate$(FaultHandling.scala:169) at akka.actor.ActorCell.terminate(ActorCell.scala:410) at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:519) at akka.actor.ActorCell.systemInvoke(ActorCell.scala:535) at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:295) at akka.dispatch.Mailbox.run(Mailbox.scala:230) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 08:40:08,514 AM [system1-akka.actor.default-dispatcher-7] [ERROR] ActorBehaviorTest$MockedActor - Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:117) at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:116) at org.opendaylight.controller.cluster.access.client.AbstractClientActor.postStop(AbstractClientActor.java:37) at akka.actor.Actor.aroundPostStop(Actor.scala:556) at akka.actor.Actor.aroundPostStop$(Actor.scala:556) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundPostStop(PersistentActor.scala:295) at akka.persistence.Eventsourced.aroundPostStop(Eventsourced.scala:298) at akka.persistence.Eventsourced.aroundPostStop$(Eventsourced.scala:294) at akka.persistence.AbstractPersistentActor.aroundPostStop(PersistentActor.scala:295) at akka.actor.dungeon.FaultHandling.finishTerminate(FaultHandling.scala:242) at akka.actor.dungeon.FaultHandling.terminate(FaultHandling.scala:199) at akka.actor.dungeon.FaultHandling.terminate$(FaultHandling.scala:169) at akka.actor.ActorCell.terminate(ActorCell.scala:410) at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:519) at akka.actor.ActorCell.systemInvoke(ActorCell.scala:535) at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:295) at akka.dispatch.Mailbox.run(Mailbox.scala:230) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 08:40:08,565 AM [system1-akka.actor.default-dispatcher-6] [INFO] Slf4jLogger - Slf4jLogger started 08:40:08,618 AM [system1-akka.actor.default-dispatcher-9] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: no initial generation override, starting from 0 08:40:08,618 AM [system1-akka.actor.default-dispatcher-9] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: persisting new identifier ClientIdentifier{frontend=member-1-frontend-type-1, generation=0} 08:40:08,619 AM [system1-akka.actor.default-dispatcher-9] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.RecoveringClientActorBehavior@393775bd to org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@1792649d 08:40:08,621 AM [system1-akka.actor.default-dispatcher-7] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: SaveSnapshotSuccess(SnapshotMetadata(member-1-frontend-type-1, 0, 1711356008620, None)) 08:40:08,623 AM [system1-akka.actor.default-dispatcher-7] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,1711356008619,0,0)) 08:40:08,624 AM [system1-akka.actor.default-dispatcher-7] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@1792649d to org.opendaylight.controller.cluster.access.client.ClientActorBehavior$MockitoMock$2nSTaT35@74ed3be4 [ERROR] [03/25/2024 08:40:08.625] [system1-akka.actor.default-dispatcher-7] [akka://system1/user/$a] Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:117) at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:116) at org.opendaylight.controller.cluster.access.client.AbstractClientActor.postStop(AbstractClientActor.java:37) at akka.actor.Actor.aroundPostStop(Actor.scala:556) at akka.actor.Actor.aroundPostStop$(Actor.scala:556) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundPostStop(PersistentActor.scala:295) at akka.persistence.Eventsourced.aroundPostStop(Eventsourced.scala:298) at akka.persistence.Eventsourced.aroundPostStop$(Eventsourced.scala:294) at akka.persistence.AbstractPersistentActor.aroundPostStop(PersistentActor.scala:295) at akka.actor.dungeon.FaultHandling.finishTerminate(FaultHandling.scala:242) at akka.actor.dungeon.FaultHandling.terminate(FaultHandling.scala:199) at akka.actor.dungeon.FaultHandling.terminate$(FaultHandling.scala:169) at akka.actor.ActorCell.terminate(ActorCell.scala:410) at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:519) at akka.actor.ActorCell.systemInvoke(ActorCell.scala:535) at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:295) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:273) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 08:40:08,626 AM [system1-akka.actor.default-dispatcher-7] [ERROR] ActorBehaviorTest$MockedActor - Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:117) at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:116) at org.opendaylight.controller.cluster.access.client.AbstractClientActor.postStop(AbstractClientActor.java:37) at akka.actor.Actor.aroundPostStop(Actor.scala:556) at akka.actor.Actor.aroundPostStop$(Actor.scala:556) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundPostStop(PersistentActor.scala:295) at akka.persistence.Eventsourced.aroundPostStop(Eventsourced.scala:298) at akka.persistence.Eventsourced.aroundPostStop$(Eventsourced.scala:294) at akka.persistence.AbstractPersistentActor.aroundPostStop(PersistentActor.scala:295) at akka.actor.dungeon.FaultHandling.finishTerminate(FaultHandling.scala:242) at akka.actor.dungeon.FaultHandling.terminate(FaultHandling.scala:199) at akka.actor.dungeon.FaultHandling.terminate$(FaultHandling.scala:169) at akka.actor.ActorCell.terminate(ActorCell.scala:410) at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:519) at akka.actor.ActorCell.systemInvoke(ActorCell.scala:535) at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:295) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:273) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 08:40:08,630 AM [system1-akka.actor.default-dispatcher-11] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: recovered identifier ClientIdentifier{frontend=member-1-frontend-type-1, generation=0} 08:40:08,631 AM [system1-akka.actor.default-dispatcher-11] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: persisting new identifier ClientIdentifier{frontend=member-1-frontend-type-1, generation=1} 08:40:08,631 AM [system1-akka.actor.default-dispatcher-11] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.RecoveringClientActorBehavior@635f6015 to org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@1dd49925 08:40:08,632 AM [system1-akka.actor.default-dispatcher-9] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: SaveSnapshotSuccess(SnapshotMetadata(member-1-frontend-type-1, 0, 1711356008632, None)) 08:40:08,639 AM [system1-akka.actor.default-dispatcher-9] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,1711356008631,0,0)) 08:40:08,640 AM [system1-akka.actor.default-dispatcher-9] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@1dd49925 to org.opendaylight.controller.cluster.access.client.ClientActorBehavior$MockitoMock$2nSTaT35@74ed3be4 [INFO] [03/25/2024 08:40:08.647] [main] [CoordinatedShutdown(akka://system1)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 08:40:08,649 AM [system1-akka.actor.default-dispatcher-6] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] [ERROR] [03/25/2024 08:40:08.650] [system1-akka.actor.default-dispatcher-6] [akka://system1/user/$b] Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:117) at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:116) at org.opendaylight.controller.cluster.access.client.AbstractClientActor.postStop(AbstractClientActor.java:37) at akka.actor.Actor.aroundPostStop(Actor.scala:556) at akka.actor.Actor.aroundPostStop$(Actor.scala:556) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundPostStop(PersistentActor.scala:295) at akka.persistence.Eventsourced.aroundPostStop(Eventsourced.scala:298) at akka.persistence.Eventsourced.aroundPostStop$(Eventsourced.scala:294) at akka.persistence.AbstractPersistentActor.aroundPostStop(PersistentActor.scala:295) at akka.actor.dungeon.FaultHandling.finishTerminate(FaultHandling.scala:242) at akka.actor.dungeon.FaultHandling.terminate(FaultHandling.scala:199) at akka.actor.dungeon.FaultHandling.terminate$(FaultHandling.scala:169) at akka.actor.ActorCell.terminate(ActorCell.scala:410) at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:519) at akka.actor.ActorCell.systemInvoke(ActorCell.scala:535) at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:295) at akka.dispatch.Mailbox.run(Mailbox.scala:230) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 08:40:08,651 AM [system1-akka.actor.default-dispatcher-6] [ERROR] ActorBehaviorTest$MockedActor - Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:117) at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:116) at org.opendaylight.controller.cluster.access.client.AbstractClientActor.postStop(AbstractClientActor.java:37) at akka.actor.Actor.aroundPostStop(Actor.scala:556) at akka.actor.Actor.aroundPostStop$(Actor.scala:556) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundPostStop(PersistentActor.scala:295) at akka.persistence.Eventsourced.aroundPostStop(Eventsourced.scala:298) at akka.persistence.Eventsourced.aroundPostStop$(Eventsourced.scala:294) at akka.persistence.AbstractPersistentActor.aroundPostStop(PersistentActor.scala:295) at akka.actor.dungeon.FaultHandling.finishTerminate(FaultHandling.scala:242) at akka.actor.dungeon.FaultHandling.terminate(FaultHandling.scala:199) at akka.actor.dungeon.FaultHandling.terminate$(FaultHandling.scala:169) at akka.actor.ActorCell.terminate(ActorCell.scala:410) at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:519) at akka.actor.ActorCell.systemInvoke(ActorCell.scala:535) at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:295) at akka.dispatch.Mailbox.run(Mailbox.scala:230) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 08:40:08,689 AM [system1-akka.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started 08:40:08,743 AM [system1-akka.actor.default-dispatcher-9] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: no initial generation override, starting from 0 08:40:08,743 AM [system1-akka.actor.default-dispatcher-9] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: persisting new identifier ClientIdentifier{frontend=member-1-frontend-type-1, generation=0} 08:40:08,744 AM [system1-akka.actor.default-dispatcher-9] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.RecoveringClientActorBehavior@45557695 to org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@6b5b99ca 08:40:08,745 AM [system1-akka.actor.default-dispatcher-6] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: SaveSnapshotSuccess(SnapshotMetadata(member-1-frontend-type-1, 0, 1711356008744, None)) [WARN] [03/25/2024 08:40:08.748] [system1-akka.actor.default-dispatcher-5] [akka://system1/user/$a] received dead letter from Actor[akka://system1/system/in-memory-snapshot-store#1273727917]: DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,1711356008743,0,0)) 08:40:08,754 AM [system1-akka.actor.default-dispatcher-5] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: no initial generation override, starting from 0 08:40:08,754 AM [system1-akka.actor.default-dispatcher-5] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: persisting new identifier ClientIdentifier{frontend=member-1-frontend-type-1, generation=0} 08:40:08,754 AM [system1-akka.actor.default-dispatcher-5] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.RecoveringClientActorBehavior@4bf5bfef to org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@39cb551a [INFO] [akkaDeadLetter][03/25/2024 08:40:08.757] [system1-akka.actor.default-dispatcher-6] [akka://system1/user/$a] Message [akka.persistence.DeleteSnapshotsSuccess] from Actor[akka://system1/system/in-memory-snapshot-store#1273727917] to Actor[akka://system1/user/$a#142248780] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://system1/user/$a#142248780] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 08:40:08,758 AM [system1-akka.actor.default-dispatcher-6] [INFO] RepointableActorRef - Message [akka.persistence.DeleteSnapshotsSuccess] from Actor[akka://system1/system/in-memory-snapshot-store#1273727917] to Actor[akka://system1/user/$a#142248780] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://system1/user/$a#142248780] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 08:40:08,761 AM [system1-akka.actor.default-dispatcher-5] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: stashing command cmd 08:40:08,761 AM [system1-akka.actor.default-dispatcher-5] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: stashing command cmd 08:40:08,761 AM [system1-akka.actor.default-dispatcher-5] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: stashing command cmd 08:40:08,761 AM [system1-akka.actor.default-dispatcher-5] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: SaveSnapshotSuccess(SnapshotMetadata(member-1-frontend-type-1, 0, 1711356008754, None)) 08:40:08,770 AM [system1-akka.actor.default-dispatcher-11] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,1711356008753,0,0)) 08:40:08,771 AM [system1-akka.actor.default-dispatcher-11] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@39cb551a to org.opendaylight.controller.cluster.access.client.ClientActorBehavior$MockitoMock$2nSTaT35@67062a93 [INFO] [03/25/2024 08:40:08.796] [main] [CoordinatedShutdown(akka://system1)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason] [ERROR] [03/25/2024 08:40:08.801] [system1-akka.actor.default-dispatcher-10] [akka://system1/user/$b] Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:117) at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:116) at org.opendaylight.controller.cluster.access.client.AbstractClientActor.postStop(AbstractClientActor.java:37) at akka.actor.Actor.aroundPostStop(Actor.scala:556) at akka.actor.Actor.aroundPostStop$(Actor.scala:556) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundPostStop(PersistentActor.scala:295) at akka.persistence.Eventsourced.aroundPostStop(Eventsourced.scala:298) at akka.persistence.Eventsourced.aroundPostStop$(Eventsourced.scala:294) at akka.persistence.AbstractPersistentActor.aroundPostStop(PersistentActor.scala:295) at akka.actor.dungeon.FaultHandling.finishTerminate(FaultHandling.scala:242) at akka.actor.dungeon.FaultHandling.terminate(FaultHandling.scala:199) at akka.actor.dungeon.FaultHandling.terminate$(FaultHandling.scala:169) at akka.actor.ActorCell.terminate(ActorCell.scala:410) at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:519) at akka.actor.ActorCell.systemInvoke(ActorCell.scala:535) at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:295) at akka.dispatch.Mailbox.run(Mailbox.scala:230) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 08:40:08,801 AM [system1-akka.actor.default-dispatcher-10] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 08:40:08,802 AM [system1-akka.actor.default-dispatcher-10] [ERROR] ActorBehaviorTest$MockedActor - Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:117) at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:116) at org.opendaylight.controller.cluster.access.client.AbstractClientActor.postStop(AbstractClientActor.java:37) at akka.actor.Actor.aroundPostStop(Actor.scala:556) at akka.actor.Actor.aroundPostStop$(Actor.scala:556) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundPostStop(PersistentActor.scala:295) at akka.persistence.Eventsourced.aroundPostStop(Eventsourced.scala:298) at akka.persistence.Eventsourced.aroundPostStop$(Eventsourced.scala:294) at akka.persistence.AbstractPersistentActor.aroundPostStop(PersistentActor.scala:295) at akka.actor.dungeon.FaultHandling.finishTerminate(FaultHandling.scala:242) at akka.actor.dungeon.FaultHandling.terminate(FaultHandling.scala:199) at akka.actor.dungeon.FaultHandling.terminate$(FaultHandling.scala:169) at akka.actor.ActorCell.terminate(ActorCell.scala:410) at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:519) at akka.actor.ActorCell.systemInvoke(ActorCell.scala:535) at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:295) at akka.dispatch.Mailbox.run(Mailbox.scala:230) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 08:40:08,850 AM [system1-akka.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started 08:40:08,906 AM [system1-akka.actor.default-dispatcher-5] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: no initial generation override, starting from 0 08:40:08,906 AM [system1-akka.actor.default-dispatcher-5] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: persisting new identifier ClientIdentifier{frontend=member-1-frontend-type-1, generation=0} 08:40:08,907 AM [system1-akka.actor.default-dispatcher-5] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.RecoveringClientActorBehavior@78227659 to org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@28721c42 08:40:08,907 AM [system1-akka.actor.default-dispatcher-9] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: SaveSnapshotSuccess(SnapshotMetadata(member-1-frontend-type-1, 0, 1711356008907, None)) [WARN] [03/25/2024 08:40:08.914] [system1-akka.actor.default-dispatcher-6] [akka://system1/user/$a] received dead letter from Actor[akka://system1/system/in-memory-snapshot-store#-1378762676]: DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,1711356008906,0,0)) [INFO] [akkaDeadLetter][03/25/2024 08:40:08.916] [system1-akka.actor.default-dispatcher-9] [akka://system1/user/$a] Message [akka.persistence.DeleteSnapshotsSuccess] from Actor[akka://system1/system/in-memory-snapshot-store#-1378762676] to Actor[akka://system1/user/$a#1631324599] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://system1/user/$a#1631324599] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 08:40:08,917 AM [system1-akka.actor.default-dispatcher-9] [INFO] RepointableActorRef - Message [akka.persistence.DeleteSnapshotsSuccess] from Actor[akka://system1/system/in-memory-snapshot-store#-1378762676] to Actor[akka://system1/user/$a#1631324599] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://system1/user/$a#1631324599] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 08:40:08,917 AM [system1-akka.actor.default-dispatcher-6] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: no initial generation override, starting from 0 08:40:08,917 AM [system1-akka.actor.default-dispatcher-6] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: persisting new identifier ClientIdentifier{frontend=member-1-frontend-type-1, generation=0} 08:40:08,917 AM [system1-akka.actor.default-dispatcher-6] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.RecoveringClientActorBehavior@7371e854 to org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@4990cb13 08:40:08,925 AM [system1-akka.actor.default-dispatcher-6] [ERROR] SavingClientActorBehavior - member-1-frontend-type-1: failed to persist state java.lang.RuntimeException: save failed at org.opendaylight.controller.cluster.access.client.ActorBehaviorTest.testRecoveryAfterRestartSaveSnapshotFail(ActorBehaviorTest.java:141) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:568) at org.junit.platform.commons.util.ReflectionUtils.invokeMethod(ReflectionUtils.java:728) at org.junit.jupiter.engine.execution.MethodInvocation.proceed(MethodInvocation.java:60) at org.junit.jupiter.engine.execution.InvocationInterceptorChain$ValidatingInvocation.proceed(InvocationInterceptorChain.java:131) at org.junit.jupiter.engine.extension.TimeoutExtension.intercept(TimeoutExtension.java:156) at org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestableMethod(TimeoutExtension.java:147) at org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestMethod(TimeoutExtension.java:86) at org.junit.jupiter.engine.execution.InterceptingExecutableInvoker$ReflectiveInterceptorCall.lambda$ofVoidMethod$0(InterceptingExecutableInvoker.java:103) at org.junit.jupiter.engine.execution.InterceptingExecutableInvoker.lambda$invoke$0(InterceptingExecutableInvoker.java:93) at org.junit.jupiter.engine.execution.InvocationInterceptorChain$InterceptedInvocation.proceed(InvocationInterceptorChain.java:106) at org.junit.jupiter.engine.execution.InvocationInterceptorChain.proceed(InvocationInterceptorChain.java:64) at org.junit.jupiter.engine.execution.InvocationInterceptorChain.chainAndInvoke(InvocationInterceptorChain.java:45) at org.junit.jupiter.engine.execution.InvocationInterceptorChain.invoke(InvocationInterceptorChain.java:37) at org.junit.jupiter.engine.execution.InterceptingExecutableInvoker.invoke(InterceptingExecutableInvoker.java:92) at org.junit.jupiter.engine.execution.InterceptingExecutableInvoker.invoke(InterceptingExecutableInvoker.java:86) at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.lambda$invokeTestMethod$7(TestMethodTestDescriptor.java:218) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.invokeTestMethod(TestMethodTestDescriptor.java:214) at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:139) at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:69) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeTestTask.java:151) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:141) at org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$9(NodeTestTask.java:139) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:138) at org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:95) at java.base/java.util.ArrayList.forEach(ArrayList.java:1511) at org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.invokeAll(SameThreadHierarchicalTestExecutorService.java:41) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeTestTask.java:155) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:141) at org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$9(NodeTestTask.java:139) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:138) at org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:95) at java.base/java.util.ArrayList.forEach(ArrayList.java:1511) at org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.invokeAll(SameThreadHierarchicalTestExecutorService.java:41) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeTestTask.java:155) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:141) at org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$9(NodeTestTask.java:139) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:138) at org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:95) at org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.submit(SameThreadHierarchicalTestExecutorService.java:35) at org.junit.platform.engine.support.hierarchical.HierarchicalTestExecutor.execute(HierarchicalTestExecutor.java:57) at org.junit.platform.engine.support.hierarchical.HierarchicalTestEngine.execute(HierarchicalTestEngine.java:54) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:198) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:169) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:93) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.lambda$execute$0(EngineExecutionOrchestrator.java:58) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.withInterceptedStreams(EngineExecutionOrchestrator.java:141) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:57) at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:103) at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:85) at org.junit.platform.launcher.core.DelegatingLauncher.execute(DelegatingLauncher.java:47) at org.apache.maven.surefire.junitplatform.LazyLauncher.execute(LazyLauncher.java:56) at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.execute(JUnitPlatformProvider.java:184) at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invokeAllTests(JUnitPlatformProvider.java:148) at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invoke(JUnitPlatformProvider.java:122) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:385) at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:162) at org.apache.maven.surefire.booter.ForkedBooter.run(ForkedBooter.java:507) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:495) 08:40:08,928 AM [system1-akka.actor.default-dispatcher-6] [DEBUG] AbstractClientActor - member-1-frontend-type-1: shutting down [INFO] [03/25/2024 08:40:08.932] [main] [CoordinatedShutdown(akka://system1)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 08:40:08,934 AM [system1-akka.actor.default-dispatcher-6] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason]