01:45:19,487 PM [system1-akka.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started 01:45:20,369 PM [system1-akka.actor.default-dispatcher-10] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: no initial generation override, starting from 0 01:45:20,371 PM [system1-akka.actor.default-dispatcher-10] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: persisting new identifier ClientIdentifier{frontend=member-1-frontend-type-1, generation=0} 01:45:20,374 PM [system1-akka.actor.default-dispatcher-10] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.RecoveringClientActorBehavior@f1afd9c to org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@4b740927 01:45:20,393 PM [system1-akka.actor.default-dispatcher-9] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: SaveSnapshotSuccess(SnapshotMetadata(member-1-frontend-type-1, 0, 1710164720376, None)) 01:45:20,397 PM [system1-akka.actor.default-dispatcher-9] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,1710164720375,0,0)) 01:45:20,407 PM [system1-akka.actor.default-dispatcher-5] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: recovered identifier ClientIdentifier{frontend=another-frontend-type-2, generation=0} 01:45:20,409 PM [system1-akka.actor.default-dispatcher-10] [ERROR] RecoveringClientActorBehavior - member-1-frontend-type-1: Mismatched frontend identifier, shutting down. Current: member-1-frontend-type-1 Saved: another-frontend-type-2 01:45:20,409 PM [system1-akka.actor.default-dispatcher-10] [DEBUG] AbstractClientActor - member-1-frontend-type-1: shutting down 01:45:20,453 PM [system1-akka.actor.default-dispatcher-5] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] [INFO] [03/11/2024 13:45:20.438] [main] [CoordinatedShutdown(akka://system1)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 01:45:20,492 PM [system1-akka.actor.default-dispatcher-9] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@4b740927 to org.opendaylight.controller.cluster.access.client.ClientActorBehavior$MockitoMock$U95iBnQg@7661e474 01:45:20,504 PM [system1-akka.actor.default-dispatcher-9] [ERROR] ActorBehaviorTest$MockedActor - Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null [ERROR] [03/11/2024 13:45:20.501] [system1-akka.actor.default-dispatcher-9] [akka://system1/user/$a] Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:117) at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:116) at org.opendaylight.controller.cluster.access.client.AbstractClientActor.postStop(AbstractClientActor.java:37) at akka.actor.Actor.aroundPostStop(Actor.scala:556) at akka.actor.Actor.aroundPostStop$(Actor.scala:556) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundPostStop(PersistentActor.scala:295) at akka.persistence.Eventsourced.aroundPostStop(Eventsourced.scala:298) at akka.persistence.Eventsourced.aroundPostStop$(Eventsourced.scala:294) at akka.persistence.AbstractPersistentActor.aroundPostStop(PersistentActor.scala:295) at akka.actor.dungeon.FaultHandling.finishTerminate(FaultHandling.scala:242) at akka.actor.dungeon.FaultHandling.terminate(FaultHandling.scala:199) at akka.actor.dungeon.FaultHandling.terminate$(FaultHandling.scala:169) at akka.actor.ActorCell.terminate(ActorCell.scala:410) at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:519) at akka.actor.ActorCell.systemInvoke(ActorCell.scala:535) at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:295) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:273) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:117) at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:116) at org.opendaylight.controller.cluster.access.client.AbstractClientActor.postStop(AbstractClientActor.java:37) at akka.actor.Actor.aroundPostStop(Actor.scala:556) at akka.actor.Actor.aroundPostStop$(Actor.scala:556) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundPostStop(PersistentActor.scala:295) at akka.persistence.Eventsourced.aroundPostStop(Eventsourced.scala:298) at akka.persistence.Eventsourced.aroundPostStop$(Eventsourced.scala:294) at akka.persistence.AbstractPersistentActor.aroundPostStop(PersistentActor.scala:295) at akka.actor.dungeon.FaultHandling.finishTerminate(FaultHandling.scala:242) at akka.actor.dungeon.FaultHandling.terminate(FaultHandling.scala:199) at akka.actor.dungeon.FaultHandling.terminate$(FaultHandling.scala:169) at akka.actor.ActorCell.terminate(ActorCell.scala:410) at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:519) at akka.actor.ActorCell.systemInvoke(ActorCell.scala:535) at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:295) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:273) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 01:45:20,590 PM [system1-akka.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started 01:45:20,647 PM [system1-akka.actor.default-dispatcher-8] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: no initial generation override, starting from 0 01:45:20,647 PM [system1-akka.actor.default-dispatcher-8] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: persisting new identifier ClientIdentifier{frontend=member-1-frontend-type-1, generation=0} 01:45:20,647 PM [system1-akka.actor.default-dispatcher-8] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.RecoveringClientActorBehavior@22fbd078 to org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@30f0db4a 01:45:20,648 PM [system1-akka.actor.default-dispatcher-6] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: SaveSnapshotSuccess(SnapshotMetadata(member-1-frontend-type-1, 0, 1710164720647, None)) 01:45:20,650 PM [system1-akka.actor.default-dispatcher-6] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,1710164720646,0,0)) 01:45:20,651 PM [system1-akka.actor.default-dispatcher-6] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@30f0db4a to org.opendaylight.controller.cluster.access.client.ClientActorBehavior$MockitoMock$U95iBnQg@5c30decf [ERROR] [03/11/2024 13:45:20.656] [system1-akka.actor.default-dispatcher-6] [akka://system1/user/$a] Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:117) at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:116) at org.opendaylight.controller.cluster.access.client.AbstractClientActor.postStop(AbstractClientActor.java:37) at akka.actor.Actor.aroundPostStop(Actor.scala:556) at akka.actor.Actor.aroundPostStop$(Actor.scala:556) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundPostStop(PersistentActor.scala:295) at akka.persistence.Eventsourced.aroundPostStop(Eventsourced.scala:298) at akka.persistence.Eventsourced.aroundPostStop$(Eventsourced.scala:294) at akka.persistence.AbstractPersistentActor.aroundPostStop(PersistentActor.scala:295) at akka.actor.dungeon.FaultHandling.finishTerminate(FaultHandling.scala:242) at akka.actor.dungeon.FaultHandling.terminate(FaultHandling.scala:199) at akka.actor.dungeon.FaultHandling.terminate$(FaultHandling.scala:169) at akka.actor.ActorCell.terminate(ActorCell.scala:410) at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:519) at akka.actor.ActorCell.systemInvoke(ActorCell.scala:535) at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:295) at akka.dispatch.Mailbox.run(Mailbox.scala:230) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 01:45:20,661 PM [system1-akka.actor.default-dispatcher-5] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: no initial generation override, starting from 0 01:45:20,662 PM [system1-akka.actor.default-dispatcher-5] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: persisting new identifier ClientIdentifier{frontend=member-1-frontend-type-1, generation=0} 01:45:20,662 PM [system1-akka.actor.default-dispatcher-5] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.RecoveringClientActorBehavior@3e504095 to org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@6b6ec287 01:45:20,664 PM [system1-akka.actor.default-dispatcher-8] [ERROR] ActorBehaviorTest$MockedActor - Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:117) at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:116) at org.opendaylight.controller.cluster.access.client.AbstractClientActor.postStop(AbstractClientActor.java:37) at akka.actor.Actor.aroundPostStop(Actor.scala:556) at akka.actor.Actor.aroundPostStop$(Actor.scala:556) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundPostStop(PersistentActor.scala:295) at akka.persistence.Eventsourced.aroundPostStop(Eventsourced.scala:298) at akka.persistence.Eventsourced.aroundPostStop$(Eventsourced.scala:294) at akka.persistence.AbstractPersistentActor.aroundPostStop(PersistentActor.scala:295) at akka.actor.dungeon.FaultHandling.finishTerminate(FaultHandling.scala:242) at akka.actor.dungeon.FaultHandling.terminate(FaultHandling.scala:199) at akka.actor.dungeon.FaultHandling.terminate$(FaultHandling.scala:169) at akka.actor.ActorCell.terminate(ActorCell.scala:410) at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:519) at akka.actor.ActorCell.systemInvoke(ActorCell.scala:535) at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:295) at akka.dispatch.Mailbox.run(Mailbox.scala:230) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 01:45:20,668 PM [system1-akka.actor.default-dispatcher-5] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: SaveSnapshotSuccess(SnapshotMetadata(member-1-frontend-type-1, 0, 1710164720662, None)) 01:45:20,670 PM [system1-akka.actor.default-dispatcher-10] [WARN] SavingClientActorBehavior - member-1-frontend-type-1: failed to delete prior snapshots java.lang.RuntimeException: delete failed at org.opendaylight.controller.cluster.access.client.ActorBehaviorTest.testRecoveryAfterRestartDeleteSnapshotsFail(ActorBehaviorTest.java:156) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:568) at org.junit.platform.commons.util.ReflectionUtils.invokeMethod(ReflectionUtils.java:728) at org.junit.jupiter.engine.execution.MethodInvocation.proceed(MethodInvocation.java:60) at org.junit.jupiter.engine.execution.InvocationInterceptorChain$ValidatingInvocation.proceed(InvocationInterceptorChain.java:131) at org.junit.jupiter.engine.extension.TimeoutExtension.intercept(TimeoutExtension.java:156) at org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestableMethod(TimeoutExtension.java:147) at org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestMethod(TimeoutExtension.java:86) at org.junit.jupiter.engine.execution.InterceptingExecutableInvoker$ReflectiveInterceptorCall.lambda$ofVoidMethod$0(InterceptingExecutableInvoker.java:103) at org.junit.jupiter.engine.execution.InterceptingExecutableInvoker.lambda$invoke$0(InterceptingExecutableInvoker.java:93) at org.junit.jupiter.engine.execution.InvocationInterceptorChain$InterceptedInvocation.proceed(InvocationInterceptorChain.java:106) at org.junit.jupiter.engine.execution.InvocationInterceptorChain.proceed(InvocationInterceptorChain.java:64) at org.junit.jupiter.engine.execution.InvocationInterceptorChain.chainAndInvoke(InvocationInterceptorChain.java:45) at org.junit.jupiter.engine.execution.InvocationInterceptorChain.invoke(InvocationInterceptorChain.java:37) at org.junit.jupiter.engine.execution.InterceptingExecutableInvoker.invoke(InterceptingExecutableInvoker.java:92) at org.junit.jupiter.engine.execution.InterceptingExecutableInvoker.invoke(InterceptingExecutableInvoker.java:86) at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.lambda$invokeTestMethod$7(TestMethodTestDescriptor.java:218) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.invokeTestMethod(TestMethodTestDescriptor.java:214) at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:139) at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:69) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeTestTask.java:151) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:141) at org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$9(NodeTestTask.java:139) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:138) at org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:95) at java.base/java.util.ArrayList.forEach(ArrayList.java:1511) at org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.invokeAll(SameThreadHierarchicalTestExecutorService.java:41) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeTestTask.java:155) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:141) at org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$9(NodeTestTask.java:139) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:138) at org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:95) at java.base/java.util.ArrayList.forEach(ArrayList.java:1511) at org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.invokeAll(SameThreadHierarchicalTestExecutorService.java:41) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeTestTask.java:155) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:141) at org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$9(NodeTestTask.java:139) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:138) at org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:95) at org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.submit(SameThreadHierarchicalTestExecutorService.java:35) at org.junit.platform.engine.support.hierarchical.HierarchicalTestExecutor.execute(HierarchicalTestExecutor.java:57) at org.junit.platform.engine.support.hierarchical.HierarchicalTestEngine.execute(HierarchicalTestEngine.java:54) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:198) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:169) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:93) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.lambda$execute$0(EngineExecutionOrchestrator.java:58) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.withInterceptedStreams(EngineExecutionOrchestrator.java:141) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:57) at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:103) at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:85) at org.junit.platform.launcher.core.DelegatingLauncher.execute(DelegatingLauncher.java:47) at org.apache.maven.surefire.junitplatform.LazyLauncher.execute(LazyLauncher.java:56) at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.execute(JUnitPlatformProvider.java:184) at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invokeAllTests(JUnitPlatformProvider.java:148) at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invoke(JUnitPlatformProvider.java:122) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:385) at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:162) at org.apache.maven.surefire.booter.ForkedBooter.run(ForkedBooter.java:507) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:495) 01:45:20,680 PM [system1-akka.actor.default-dispatcher-10] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@6b6ec287 to org.opendaylight.controller.cluster.access.client.ClientActorBehavior$MockitoMock$U95iBnQg@5c30decf [INFO] [03/11/2024 13:45:20.775] [main] [CoordinatedShutdown(akka://system1)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 01:45:20,779 PM [system1-akka.actor.default-dispatcher-12] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 01:45:20,781 PM [system1-akka.actor.default-dispatcher-12] [ERROR] ActorBehaviorTest$MockedActor - Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:117) at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:116) at org.opendaylight.controller.cluster.access.client.AbstractClientActor.postStop(AbstractClientActor.java:37) at akka.actor.Actor.aroundPostStop(Actor.scala:556) at akka.actor.Actor.aroundPostStop$(Actor.scala:556) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundPostStop(PersistentActor.scala:295) [ERROR] [03/11/2024 13:45:20.780] [system1-akka.actor.default-dispatcher-12] [akka://system1/user/$b] Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:117) at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:116) at org.opendaylight.controller.cluster.access.client.AbstractClientActor.postStop(AbstractClientActor.java:37) at akka.actor.Actor.aroundPostStop(Actor.scala:556) at akka.actor.Actor.aroundPostStop$(Actor.scala:556) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundPostStop(PersistentActor.scala:295) at akka.persistence.Eventsourced.aroundPostStop(Eventsourced.scala:298) at akka.persistence.Eventsourced.aroundPostStop$(Eventsourced.scala:294) at akka.persistence.AbstractPersistentActor.aroundPostStop(PersistentActor.scala:295) at akka.actor.dungeon.FaultHandling.finishTerminate(FaultHandling.scala:242) at akka.actor.dungeon.FaultHandling.terminate(FaultHandling.scala:199) at akka.actor.dungeon.FaultHandling.terminate$(FaultHandling.scala:169) at akka.actor.ActorCell.terminate(ActorCell.scala:410) at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:519) at akka.actor.ActorCell.systemInvoke(ActorCell.scala:535) at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:295) at akka.dispatch.Mailbox.run(Mailbox.scala:230) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) at akka.persistence.Eventsourced.aroundPostStop(Eventsourced.scala:298) at akka.persistence.Eventsourced.aroundPostStop$(Eventsourced.scala:294) at akka.persistence.AbstractPersistentActor.aroundPostStop(PersistentActor.scala:295) at akka.actor.dungeon.FaultHandling.finishTerminate(FaultHandling.scala:242) at akka.actor.dungeon.FaultHandling.terminate(FaultHandling.scala:199) at akka.actor.dungeon.FaultHandling.terminate$(FaultHandling.scala:169) at akka.actor.ActorCell.terminate(ActorCell.scala:410) at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:519) at akka.actor.ActorCell.systemInvoke(ActorCell.scala:535) at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:295) at akka.dispatch.Mailbox.run(Mailbox.scala:230) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 01:45:20,841 PM [system1-akka.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started 01:45:20,891 PM [system1-akka.actor.default-dispatcher-6] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: no initial generation override, starting from 0 01:45:20,891 PM [system1-akka.actor.default-dispatcher-6] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: persisting new identifier ClientIdentifier{frontend=member-1-frontend-type-1, generation=0} 01:45:20,891 PM [system1-akka.actor.default-dispatcher-6] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.RecoveringClientActorBehavior@65b7f691 to org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@4feffa70 01:45:20,892 PM [system1-akka.actor.default-dispatcher-6] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: SaveSnapshotSuccess(SnapshotMetadata(member-1-frontend-type-1, 0, 1710164720892, None)) 01:45:20,899 PM [system1-akka.actor.default-dispatcher-6] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: stashing command cmd 01:45:20,900 PM [system1-akka.actor.default-dispatcher-6] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,1710164720891,0,0)) 01:45:20,901 PM [system1-akka.actor.default-dispatcher-6] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@4feffa70 to org.opendaylight.controller.cluster.access.client.ClientActorBehavior$MockitoMock$U95iBnQg@470ad01c [INFO] [03/11/2024 13:45:20.912] [main] [CoordinatedShutdown(akka://system1)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 01:45:20,913 PM [system1-akka.actor.default-dispatcher-10] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] [ERROR] [03/11/2024 13:45:20.915] [system1-akka.actor.default-dispatcher-10] [akka://system1/user/$a] Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:117) at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:116) at org.opendaylight.controller.cluster.access.client.AbstractClientActor.postStop(AbstractClientActor.java:37) at akka.actor.Actor.aroundPostStop(Actor.scala:556) at akka.actor.Actor.aroundPostStop$(Actor.scala:556) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundPostStop(PersistentActor.scala:295) at akka.persistence.Eventsourced.aroundPostStop(Eventsourced.scala:298) at akka.persistence.Eventsourced.aroundPostStop$(Eventsourced.scala:294) at akka.persistence.AbstractPersistentActor.aroundPostStop(PersistentActor.scala:295) at akka.actor.dungeon.FaultHandling.finishTerminate(FaultHandling.scala:242) at akka.actor.dungeon.FaultHandling.terminate(FaultHandling.scala:199) at akka.actor.dungeon.FaultHandling.terminate$(FaultHandling.scala:169) at akka.actor.ActorCell.terminate(ActorCell.scala:410) at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:519) at akka.actor.ActorCell.systemInvoke(ActorCell.scala:535) at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:295) at akka.dispatch.Mailbox.run(Mailbox.scala:230) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 01:45:20,916 PM [system1-akka.actor.default-dispatcher-6] [ERROR] ActorBehaviorTest$MockedActor - Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:117) at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:116) at org.opendaylight.controller.cluster.access.client.AbstractClientActor.postStop(AbstractClientActor.java:37) at akka.actor.Actor.aroundPostStop(Actor.scala:556) at akka.actor.Actor.aroundPostStop$(Actor.scala:556) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundPostStop(PersistentActor.scala:295) at akka.persistence.Eventsourced.aroundPostStop(Eventsourced.scala:298) at akka.persistence.Eventsourced.aroundPostStop$(Eventsourced.scala:294) at akka.persistence.AbstractPersistentActor.aroundPostStop(PersistentActor.scala:295) at akka.actor.dungeon.FaultHandling.finishTerminate(FaultHandling.scala:242) at akka.actor.dungeon.FaultHandling.terminate(FaultHandling.scala:199) at akka.actor.dungeon.FaultHandling.terminate$(FaultHandling.scala:169) at akka.actor.ActorCell.terminate(ActorCell.scala:410) at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:519) at akka.actor.ActorCell.systemInvoke(ActorCell.scala:535) at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:295) at akka.dispatch.Mailbox.run(Mailbox.scala:230) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 01:45:20,957 PM [system1-akka.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started 01:45:21,11 PM [system1-akka.actor.default-dispatcher-8] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: no initial generation override, starting from 0 01:45:21,11 PM [system1-akka.actor.default-dispatcher-8] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: persisting new identifier ClientIdentifier{frontend=member-1-frontend-type-1, generation=0} 01:45:21,12 PM [system1-akka.actor.default-dispatcher-8] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.RecoveringClientActorBehavior@44382a34 to org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@2740bf9b 01:45:21,13 PM [system1-akka.actor.default-dispatcher-8] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: SaveSnapshotSuccess(SnapshotMetadata(member-1-frontend-type-1, 0, 1710164721012, None)) [WARN] [03/11/2024 13:45:21.017] [system1-akka.actor.default-dispatcher-8] [akka://system1/user/$a] received dead letter from Actor[akka://system1/system/in-memory-snapshot-store#-278499765]: DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,1710164721011,0,0)) [INFO] [akkaDeadLetter][03/11/2024 13:45:21.021] [system1-akka.actor.default-dispatcher-6] [akka://system1/user/$a] Message [akka.persistence.DeleteSnapshotsSuccess] from Actor[akka://system1/system/in-memory-snapshot-store#-278499765] to Actor[akka://system1/user/$a#720392122] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://system1/user/$a#720392122] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:45:21,23 PM [system1-akka.actor.default-dispatcher-5] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: recovered identifier ClientIdentifier{frontend=member-1-frontend-type-1, generation=0} 01:45:21,24 PM [system1-akka.actor.default-dispatcher-5] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: persisting new identifier ClientIdentifier{frontend=member-1-frontend-type-1, generation=1} 01:45:21,24 PM [system1-akka.actor.default-dispatcher-5] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.RecoveringClientActorBehavior@58b6c85b to org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@3a44e24f 01:45:21,25 PM [system1-akka.actor.default-dispatcher-8] [INFO] RepointableActorRef - Message [akka.persistence.DeleteSnapshotsSuccess] from Actor[akka://system1/system/in-memory-snapshot-store#-278499765] to Actor[akka://system1/user/$a#720392122] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://system1/user/$a#720392122] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:45:21,27 PM [system1-akka.actor.default-dispatcher-5] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: SaveSnapshotSuccess(SnapshotMetadata(member-1-frontend-type-1, 0, 1710164721024, None)) [INFO] [03/11/2024 13:45:21.036] [main] [CoordinatedShutdown(akka://system1)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 01:45:21,37 PM [system1-akka.actor.default-dispatcher-5] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 01:45:21,88 PM [system1-akka.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started 01:45:21,140 PM [system1-akka.actor.default-dispatcher-8] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: no initial generation override, starting from 0 01:45:21,140 PM [system1-akka.actor.default-dispatcher-8] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: persisting new identifier ClientIdentifier{frontend=member-1-frontend-type-1, generation=0} 01:45:21,140 PM [system1-akka.actor.default-dispatcher-8] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.RecoveringClientActorBehavior@6bf1bdb2 to org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@b601b3f 01:45:21,141 PM [system1-akka.actor.default-dispatcher-6] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: SaveSnapshotSuccess(SnapshotMetadata(member-1-frontend-type-1, 0, 1710164721141, None)) [WARN] [03/11/2024 13:45:21.144] [system1-akka.actor.default-dispatcher-6] [akka://system1/user/$a] received dead letter from Actor[akka://system1/system/in-memory-snapshot-store#1492753067]: DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,1710164721140,0,0)) [INFO] [akkaDeadLetter][03/11/2024 13:45:21.144] [system1-akka.actor.default-dispatcher-6] [akka://system1/user/$a] Message [akka.persistence.DeleteSnapshotsSuccess] from Actor[akka://system1/system/in-memory-snapshot-store#1492753067] to Actor[akka://system1/user/$a#1864756939] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://system1/user/$a#1864756939] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:45:21,145 PM [system1-akka.actor.default-dispatcher-6] [INFO] RepointableActorRef - Message [akka.persistence.DeleteSnapshotsSuccess] from Actor[akka://system1/system/in-memory-snapshot-store#1492753067] to Actor[akka://system1/user/$a#1864756939] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://system1/user/$a#1864756939] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:45:21,150 PM [system1-akka.actor.default-dispatcher-12] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: no initial generation override, starting from 0 01:45:21,150 PM [system1-akka.actor.default-dispatcher-12] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: persisting new identifier ClientIdentifier{frontend=member-1-frontend-type-1, generation=0} 01:45:21,150 PM [system1-akka.actor.default-dispatcher-12] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.RecoveringClientActorBehavior@6da47ed6 to org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@576400ec 01:45:21,151 PM [system1-akka.actor.default-dispatcher-12] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: stashing command cmd 01:45:21,151 PM [system1-akka.actor.default-dispatcher-12] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: stashing command cmd 01:45:21,151 PM [system1-akka.actor.default-dispatcher-12] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: stashing command cmd 01:45:21,152 PM [system1-akka.actor.default-dispatcher-12] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: SaveSnapshotSuccess(SnapshotMetadata(member-1-frontend-type-1, 0, 1710164721152, None)) 01:45:21,162 PM [system1-akka.actor.default-dispatcher-12] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,1710164721151,0,0)) 01:45:21,163 PM [system1-akka.actor.default-dispatcher-12] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@576400ec to org.opendaylight.controller.cluster.access.client.ClientActorBehavior$MockitoMock$U95iBnQg@37922937 [INFO] [03/11/2024 13:45:21.182] [main] [CoordinatedShutdown(akka://system1)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 01:45:21,185 PM [system1-akka.actor.default-dispatcher-8] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 01:45:21,188 PM [system1-akka.actor.default-dispatcher-5] [ERROR] ActorBehaviorTest$MockedActor - Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:117) at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:116) at org.opendaylight.controller.cluster.access.client.AbstractClientActor.postStop(AbstractClientActor.java:37) at akka.actor.Actor.aroundPostStop(Actor.scala:556) [ERROR] [03/11/2024 13:45:21.188] [system1-akka.actor.default-dispatcher-8] [akka://system1/user/$b] Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.messaging.MessageAssembler.close()" because ".responseMessageAssembler" is null at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:117) at org.opendaylight.controller.cluster.access.client.ClientActorBehavior.close(ClientActorBehavior.java:116) at org.opendaylight.controller.cluster.access.client.AbstractClientActor.postStop(AbstractClientActor.java:37) at akka.actor.Actor.aroundPostStop(Actor.scala:556) at akka.actor.Actor.aroundPostStop$(Actor.scala:556) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundPostStop(PersistentActor.scala:295) at akka.persistence.Eventsourced.aroundPostStop(Eventsourced.scala:298) at akka.persistence.Eventsourced.aroundPostStop$(Eventsourced.scala:294) at akka.persistence.AbstractPersistentActor.aroundPostStop(PersistentActor.scala:295) at akka.actor.dungeon.FaultHandling.finishTerminate(FaultHandling.scala:242) at akka.actor.dungeon.FaultHandling.terminate(FaultHandling.scala:199) at akka.actor.dungeon.FaultHandling.terminate$(FaultHandling.scala:169) at akka.actor.ActorCell.terminate(ActorCell.scala:410) at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:519) at akka.actor.ActorCell.systemInvoke(ActorCell.scala:535) at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:295) at akka.dispatch.Mailbox.run(Mailbox.scala:230) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) at akka.actor.Actor.aroundPostStop$(Actor.scala:556) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundPostStop(PersistentActor.scala:295) at akka.persistence.Eventsourced.aroundPostStop(Eventsourced.scala:298) at akka.persistence.Eventsourced.aroundPostStop$(Eventsourced.scala:294) at akka.persistence.AbstractPersistentActor.aroundPostStop(PersistentActor.scala:295) at akka.actor.dungeon.FaultHandling.finishTerminate(FaultHandling.scala:242) at akka.actor.dungeon.FaultHandling.terminate(FaultHandling.scala:199) at akka.actor.dungeon.FaultHandling.terminate$(FaultHandling.scala:169) at akka.actor.ActorCell.terminate(ActorCell.scala:410) at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:519) at akka.actor.ActorCell.systemInvoke(ActorCell.scala:535) at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:295) at akka.dispatch.Mailbox.run(Mailbox.scala:230) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 01:45:21,225 PM [system1-akka.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started 01:45:21,273 PM [system1-akka.actor.default-dispatcher-8] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: no initial generation override, starting from 0 01:45:21,274 PM [system1-akka.actor.default-dispatcher-8] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: persisting new identifier ClientIdentifier{frontend=member-1-frontend-type-1, generation=0} 01:45:21,274 PM [system1-akka.actor.default-dispatcher-8] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.RecoveringClientActorBehavior@77cdb0a5 to org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@79b56e6c 01:45:21,276 PM [system1-akka.actor.default-dispatcher-5] [DEBUG] SavingClientActorBehavior - member-1-frontend-type-1: got command: SaveSnapshotSuccess(SnapshotMetadata(member-1-frontend-type-1, 0, 1710164721275, None)) [WARN] [03/11/2024 13:45:21.278] [system1-akka.actor.default-dispatcher-10] [akka://system1/user/$a] received dead letter from Actor[akka://system1/system/in-memory-snapshot-store#-339128466]: DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,1710164721274,0,0)) [INFO] [akkaDeadLetter][03/11/2024 13:45:21.279] [system1-akka.actor.default-dispatcher-10] [akka://system1/user/$a] Message [akka.persistence.DeleteSnapshotsSuccess] from Actor[akka://system1/system/in-memory-snapshot-store#-339128466] to Actor[akka://system1/user/$a#1780758876] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://system1/user/$a#1780758876] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:45:21,282 PM [system1-akka.actor.default-dispatcher-8] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: no initial generation override, starting from 0 01:45:21,282 PM [system1-akka.actor.default-dispatcher-8] [DEBUG] RecoveringClientActorBehavior - member-1-frontend-type-1: persisting new identifier ClientIdentifier{frontend=member-1-frontend-type-1, generation=0} 01:45:21,283 PM [system1-akka.actor.default-dispatcher-8] [DEBUG] AbstractClientActor - member-1-frontend-type-1: switched from org.opendaylight.controller.cluster.access.client.RecoveringClientActorBehavior@db08e61 to org.opendaylight.controller.cluster.access.client.SavingClientActorBehavior@7d8af582 01:45:21,285 PM [system1-akka.actor.default-dispatcher-8] [ERROR] SavingClientActorBehavior - member-1-frontend-type-1: failed to persist state java.lang.RuntimeException: save failed at org.opendaylight.controller.cluster.access.client.ActorBehaviorTest.testRecoveryAfterRestartSaveSnapshotFail(ActorBehaviorTest.java:141) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:568) at org.junit.platform.commons.util.ReflectionUtils.invokeMethod(ReflectionUtils.java:728) at org.junit.jupiter.engine.execution.MethodInvocation.proceed(MethodInvocation.java:60) at org.junit.jupiter.engine.execution.InvocationInterceptorChain$ValidatingInvocation.proceed(InvocationInterceptorChain.java:131) at org.junit.jupiter.engine.extension.TimeoutExtension.intercept(TimeoutExtension.java:156) at org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestableMethod(TimeoutExtension.java:147) at org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestMethod(TimeoutExtension.java:86) at org.junit.jupiter.engine.execution.InterceptingExecutableInvoker$ReflectiveInterceptorCall.lambda$ofVoidMethod$0(InterceptingExecutableInvoker.java:103) at org.junit.jupiter.engine.execution.InterceptingExecutableInvoker.lambda$invoke$0(InterceptingExecutableInvoker.java:93) at org.junit.jupiter.engine.execution.InvocationInterceptorChain$InterceptedInvocation.proceed(InvocationInterceptorChain.java:106) at org.junit.jupiter.engine.execution.InvocationInterceptorChain.proceed(InvocationInterceptorChain.java:64) at org.junit.jupiter.engine.execution.InvocationInterceptorChain.chainAndInvoke(InvocationInterceptorChain.java:45) at org.junit.jupiter.engine.execution.InvocationInterceptorChain.invoke(InvocationInterceptorChain.java:37) at org.junit.jupiter.engine.execution.InterceptingExecutableInvoker.invoke(InterceptingExecutableInvoker.java:92) at org.junit.jupiter.engine.execution.InterceptingExecutableInvoker.invoke(InterceptingExecutableInvoker.java:86) at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.lambda$invokeTestMethod$7(TestMethodTestDescriptor.java:218) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.invokeTestMethod(TestMethodTestDescriptor.java:214) at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:139) at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:69) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeTestTask.java:151) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:141) at org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$9(NodeTestTask.java:139) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:138) at org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:95) at java.base/java.util.ArrayList.forEach(ArrayList.java:1511) at org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.invokeAll(SameThreadHierarchicalTestExecutorService.java:41) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeTestTask.java:155) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:141) at org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$9(NodeTestTask.java:139) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:138) at org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:95) at java.base/java.util.ArrayList.forEach(ArrayList.java:1511) at org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.invokeAll(SameThreadHierarchicalTestExecutorService.java:41) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeTestTask.java:155) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:141) at org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137) at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$9(NodeTestTask.java:139) at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) at org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:138) at org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:95) at org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.submit(SameThreadHierarchicalTestExecutorService.java:35) at org.junit.platform.engine.support.hierarchical.HierarchicalTestExecutor.execute(HierarchicalTestExecutor.java:57) at org.junit.platform.engine.support.hierarchical.HierarchicalTestEngine.execute(HierarchicalTestEngine.java:54) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:198) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:169) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:93) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.lambda$execute$0(EngineExecutionOrchestrator.java:58) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.withInterceptedStreams(EngineExecutionOrchestrator.java:141) at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:57) at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:103) at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:85) at org.junit.platform.launcher.core.DelegatingLauncher.execute(DelegatingLauncher.java:47) at org.apache.maven.surefire.junitplatform.LazyLauncher.execute(LazyLauncher.java:56) at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.execute(JUnitPlatformProvider.java:184) at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invokeAllTests(JUnitPlatformProvider.java:148) at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invoke(JUnitPlatformProvider.java:122) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:385) at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:162) at org.apache.maven.surefire.booter.ForkedBooter.run(ForkedBooter.java:507) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:495) 01:45:21,287 PM [system1-akka.actor.default-dispatcher-8] [DEBUG] AbstractClientActor - member-1-frontend-type-1: shutting down [INFO] [03/11/2024 13:45:21.290] [main] [CoordinatedShutdown(akka://system1)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 01:45:21,291 PM [system1-akka.actor.default-dispatcher-8] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 01:45:21,293 PM [system1-akka.actor.default-dispatcher-10] [INFO] RepointableActorRef - Message [akka.persistence.DeleteSnapshotsSuccess] from Actor[akka://system1/system/in-memory-snapshot-store#-339128466] to Actor[akka://system1/user/$a#1780758876] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://system1/user/$a#1780758876] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.