Test Statistics

Total Statistics
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
All Tests
16211151005:19:10
Statistics by Tag
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
carpeople
85085000:00:00
clustering
85085000:00:00
critical
16211151005:19:10
Statistics by Suite
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
controller-clustering-tell.txt
16211151005:42:56
controller-clustering-tell . txt . Restart Odl With Tell Based True
312000:13:53
controller-clustering-tell . txt . Ddb-Sanity-Module-Based
909000:28:59
controller-clustering-tell . txt . Restart Odl With Tell Based True
312000:14:39
controller-clustering-tell . txt . Clean Leader Shutdown
303000:15:31
controller-clustering-tell . txt . Restart Odl With Tell Based True
312000:14:37
controller-clustering-tell . txt . Explicit Leader Movement
505000:18:57
controller-clustering-tell . txt . Restart Odl With Tell Based True
312000:14:37
controller-clustering-tell . txt . Leader Isolation
303000:11:30
controller-clustering-tell . txt . Restart Odl With Tell Based True
312000:14:37
controller-clustering-tell . txt . Client Isolation
707001:16:33
controller-clustering-tell . txt . Restart Odl With Tell Based True
312000:14:39
controller-clustering-tell . txt . Listener Stability
505000:19:04
controller-clustering-tell . txt . Restart Odl With Tell Based True
312000:14:41
controller-clustering-tell . txt . Master Stability
606000:09:11
controller-clustering-tell . txt . Restart Odl With Tell Based True
312000:14:37
controller-clustering-tell . txt . Partition And Heal
606000:09:09
controller-clustering-tell . txt . Restart Odl With Tell Based True
312000:13:21
controller-clustering-tell . txt . Chasing The Leader
312000:03:55
controller-clustering-tell . txt . Restart Odl With Tell Based True
312000:13:22
controller-clustering-tell . txt . Carpeople Crud
13013000:00:54
controller-clustering-tell . txt . Car Failover Crud
16016000:00:52
controller-clustering-tell . txt . Car Persistence Recovery
707000:00:53
controller-clustering-tell . txt . Buycar Failover
10010000:00:53
controller-clustering-tell . txt . Entity Isolate
505000:00:54
controller-clustering-tell . txt . Buycar Failover Isolation
10010000:00:53
controller-clustering-tell . txt . Car Failover Crud Isolation
16016000:00:53
controller-clustering-tell . txt . Car Outage Corners
808000:00:53

Test Execution Log

05:42:56.452 SUITE controller-clustering-tell.txt
Full Name: controller-clustering-tell.txt
Start / End / Elapsed: 20250316 23:08:33.055 / 20250317 04:51:29.507 / 05:42:56.452
Status: 162 tests total, 11 passed, 151 failed, 0 skipped
00:13:53.377 SUITE Restart Odl With Tell Based True
Full Name: controller-clustering-tell.txt.Restart Odl With Tell Based True
Documentation:

Set tell-based protocol usage

Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

Suite stops all odl nodes, un-comment usage of tell-based protocol in config file (means make it true) and starts all nodes again.
Source: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
Start / End / Elapsed: 20250316 23:08:33.077 / 20250316 23:22:26.454 / 00:13:53.377
Status: 3 tests total, 1 passed, 2 failed, 0 skipped
00:00:06.084 SETUP SetupUtils . Setup_Utils_For_Setup_And_Teardown   http_timeout=125
Documentation:

Prepare both FailFast and Karaf logging, log that the caller suite has started. This keyword is to be used in suite setup, and without it the other keywords may not work properly.
Start / End / Elapsed: 20250316 23:08:33.616 / 20250316 23:08:39.700 / 00:00:06.084
00:00:00.000 TEARDOWN SSHLibrary . Close All Connections  
Documentation:

Closes all open connections.
Start / End / Elapsed: 20250316 23:22:26.454 / 20250316 23:22:26.454 / 00:00:00.000
00:06:13.762 TEST Stop_All_Members
Full Name: controller-clustering-tell.txt.Restart Odl With Tell Based True.Stop_All_Members
Documentation:

Stop every odl node.
Tags: critical
Start / End / Elapsed: 20250316 23:08:39.700 / 20250316 23:14:53.462 / 00:06:13.762
Status: FAIL
Message: Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
00:06:13.761 KEYWORD ClusterManagement . Stop_Members_From_List_Or_All  
Documentation:

If the list is empty, stops all ODL instances. Otherwise stop members based on ${stop_index_list} If ${confirm} is True, verify stopped instances are not there anymore. The KW will return a list of available members: ${updated index_list}=${original_index_list}-${member_index_list}
Start / End / Elapsed: 20250316 23:08:39.701 / 20250316 23:14:53.462 / 00:06:13.761
00:00:10.862 TEST Set_Tell_Based_Protocol_Usage
Full Name: controller-clustering-tell.txt.Restart Odl With Tell Based True.Set_Tell_Based_Protocol_Usage
Documentation:

Un-comment the flag usage in config file. Also clean most data except data/log/.
Tags: critical
Start / End / Elapsed: 20250316 23:14:53.462 / 20250316 23:15:04.324 / 00:00:10.862
Status: PASS
00:07:22.129 TEST Start_All_And_Sync
Full Name: controller-clustering-tell.txt.Restart Odl With Tell Based True.Start_All_And_Sync
Documentation:

Start each member and wait for sync.
Tags: critical
Start / End / Elapsed: 20250316 23:15:04.324 / 20250316 23:22:26.453 / 00:07:22.129
Status: FAIL
Message: Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.26', port=8181): Read timed out. (read timeout=125.0)
00:28:58.633 SUITE Ddb-Sanity-Module-Based
Full Name: controller-clustering-tell.txt.Ddb-Sanity-Module-Based
Documentation:

DOMDataBroker testing: Module based shards sanity suite

Copyright (c) 2017 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

The goal is to call several basic rpc form ClusterAdmin.robot and MdsalLowlevel.robot to ensute that those rpcs can be safely used in other suites. It also verify the ability of the odl-controller-test-app to perform several activities.
Source: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot
Start / End / Elapsed: 20250316 23:22:26.455 / 20250316 23:51:25.088 / 00:28:58.633
Status: 9 tests total, 0 passed, 9 failed, 0 skipped
00:14:38.943 SUITE Restart Odl With Tell Based True
Full Name: controller-clustering-tell.txt.Restart Odl With Tell Based True
Documentation:

Set tell-based protocol usage

Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

Suite stops all odl nodes, un-comment usage of tell-based protocol in config file (means make it true) and starts all nodes again.
Source: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
Start / End / Elapsed: 20250316 23:51:25.089 / 20250317 00:06:04.032 / 00:14:38.943
Status: 3 tests total, 1 passed, 2 failed, 0 skipped
00:15:30.539 SUITE Clean Leader Shutdown
Full Name: controller-clustering-tell.txt.Clean Leader Shutdown
Documentation:

DOMDataBroker testing: Clean Leader Shutdown

Copyright (c) 2017 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

The goal is to ensure that applications do not observe disruption when a shard leader is shut down cleanly. This is performed by having a steady-stream producer execute operations against the shard and then initiate leader shard shutdown, then the producer is shut down cleanly.
Source: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot
Start / End / Elapsed: 20250317 00:06:04.033 / 20250317 00:21:34.572 / 00:15:30.539
Status: 3 tests total, 0 passed, 3 failed, 0 skipped
00:14:36.746 SUITE Restart Odl With Tell Based True
Full Name: controller-clustering-tell.txt.Restart Odl With Tell Based True
Documentation:

Set tell-based protocol usage

Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

Suite stops all odl nodes, un-comment usage of tell-based protocol in config file (means make it true) and starts all nodes again.
Source: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
Start / End / Elapsed: 20250317 00:21:34.573 / 20250317 00:36:11.319 / 00:14:36.746
Status: 3 tests total, 1 passed, 2 failed, 0 skipped
00:18:56.993 SUITE Explicit Leader Movement
Full Name: controller-clustering-tell.txt.Explicit Leader Movement
Documentation:

DOMDataBroker testing: Explicit Leader Movement

Copyright (c) 2017 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

The goal is to ensure that applications do not observe disruption when a shard leader is moved as the result of explicit application request. This is performed by having a steady-stream producer execute operations against the shard and then initiate shard leader shutdown, then the producer is shut down cleanly.
Source: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot
Start / End / Elapsed: 20250317 00:36:11.320 / 20250317 00:55:08.313 / 00:18:56.993
Status: 5 tests total, 0 passed, 5 failed, 0 skipped
00:14:37.450 SUITE Restart Odl With Tell Based True
Full Name: controller-clustering-tell.txt.Restart Odl With Tell Based True
Documentation:

Set tell-based protocol usage

Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

Suite stops all odl nodes, un-comment usage of tell-based protocol in config file (means make it true) and starts all nodes again.
Source: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
Start / End / Elapsed: 20250317 00:55:08.313 / 20250317 01:09:45.763 / 00:14:37.450
Status: 3 tests total, 1 passed, 2 failed, 0 skipped
00:11:29.919 SUITE Leader Isolation
Full Name: controller-clustering-tell.txt.Leader Isolation
Documentation:

DOMDataBroker testing: Leader Isolation

Copyright (c) 2017 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

The goal is to ensure the datastore succeeds in basic isolation/rejoin scenario, simulating either a network partition, or a prolonged GC pause.
Source: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot
Start / End / Elapsed: 20250317 01:09:45.764 / 20250317 01:21:15.683 / 00:11:29.919
Status: 3 tests total, 0 passed, 3 failed, 0 skipped
00:14:37.329 SUITE Restart Odl With Tell Based True
Full Name: controller-clustering-tell.txt.Restart Odl With Tell Based True
Documentation:

Set tell-based protocol usage

Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

Suite stops all odl nodes, un-comment usage of tell-based protocol in config file (means make it true) and starts all nodes again.
Source: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
Start / End / Elapsed: 20250317 01:21:15.683 / 20250317 01:35:53.012 / 00:14:37.329
Status: 3 tests total, 1 passed, 2 failed, 0 skipped
01:16:32.766 SUITE Client Isolation
Full Name: controller-clustering-tell.txt.Client Isolation
Documentation:

DOMDataBroker testing: Client Isolation

Copyright (c) 2017 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

The purpose of this test is to ascertain that the failure modes of cds-access-client work as expected. This is performed by having a steady stream of transactions flowing from the frontend and isolating the node hosting the frontend from the rest of the cluster.
Source: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/client_isolation.robot
Start / End / Elapsed: 20250317 01:35:53.013 / 20250317 02:52:25.779 / 01:16:32.766
Status: 7 tests total, 0 passed, 7 failed, 0 skipped
00:14:39.429 SUITE Restart Odl With Tell Based True
Full Name: controller-clustering-tell.txt.Restart Odl With Tell Based True
Documentation:

Set tell-based protocol usage

Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

Suite stops all odl nodes, un-comment usage of tell-based protocol in config file (means make it true) and starts all nodes again.
Source: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
Start / End / Elapsed: 20250317 02:52:25.779 / 20250317 03:07:05.208 / 00:14:39.429
Status: 3 tests total, 1 passed, 2 failed, 0 skipped
00:19:03.777 SUITE Listener Stability
Full Name: controller-clustering-tell.txt.Listener Stability
Documentation:

DOMDataBroker testing: Listener Stability for module-based shards

Copyright (c) 2017 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

The goal is to ensure listeners do no observe disruption when the leader moves. This is performed by having a steady stream of transactions being observed by the listeners and having the leader move.
Source: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/listener_stability.robot
Start / End / Elapsed: 20250317 03:07:05.209 / 20250317 03:26:08.986 / 00:19:03.777
Status: 5 tests total, 0 passed, 5 failed, 0 skipped
00:14:40.514 SUITE Restart Odl With Tell Based True
Full Name: controller-clustering-tell.txt.Restart Odl With Tell Based True
Documentation:

Set tell-based protocol usage

Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

Suite stops all odl nodes, un-comment usage of tell-based protocol in config file (means make it true) and starts all nodes again.
Source: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
Start / End / Elapsed: 20250317 03:26:08.986 / 20250317 03:40:49.500 / 00:14:40.514
Status: 3 tests total, 1 passed, 2 failed, 0 skipped
00:09:11.329 SUITE Master Stability
Full Name: controller-clustering-tell.txt.Master Stability
Documentation:

Cluster Singleton testing: Master Stability

Copyright (c) 2017 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

Cluster Singleton service is designed to ensure that only one instance of an application is registered globally in the cluster. The goal is to establish the service operates correctly in face of application registration changing without moving the active instance.
Source: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/master_stability.robot
Start / End / Elapsed: 20250317 03:40:49.501 / 20250317 03:50:00.830 / 00:09:11.329
Status: 6 tests total, 0 passed, 6 failed, 0 skipped
00:14:36.687 SUITE Restart Odl With Tell Based True
Full Name: controller-clustering-tell.txt.Restart Odl With Tell Based True
Documentation:

Set tell-based protocol usage

Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

Suite stops all odl nodes, un-comment usage of tell-based protocol in config file (means make it true) and starts all nodes again.
Source: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
Start / End / Elapsed: 20250317 03:50:00.831 / 20250317 04:04:37.518 / 00:14:36.687
Status: 3 tests total, 1 passed, 2 failed, 0 skipped
00:09:09.100 SUITE Partition And Heal
Full Name: controller-clustering-tell.txt.Partition And Heal
Documentation:

Cluster Singleton testing: Partition And Heal

Copyright (c) 2017 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

Cluster Singleton service is designed to ensure that only one instance of an application is registered globally in the cluster. The goal is to establish the service operates correctly in face of node failures.
Source: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot
Start / End / Elapsed: 20250317 04:04:37.519 / 20250317 04:13:46.619 / 00:09:09.100
Status: 6 tests total, 0 passed, 6 failed, 0 skipped
00:13:21.341 SUITE Restart Odl With Tell Based True
Full Name: controller-clustering-tell.txt.Restart Odl With Tell Based True
Documentation:

Set tell-based protocol usage

Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

Suite stops all odl nodes, un-comment usage of tell-based protocol in config file (means make it true) and starts all nodes again.
Source: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
Start / End / Elapsed: 20250317 04:13:46.619 / 20250317 04:27:07.960 / 00:13:21.341
Status: 3 tests total, 1 passed, 2 failed, 0 skipped
00:03:55.002 SUITE Chasing The Leader
Full Name: controller-clustering-tell.txt.Chasing The Leader
Documentation:

Cluster Singleton testing: Chasing the Leader

Copyright (c) 2017 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

This test aims to establish the service operates correctly when faced with rapid application transitions without having a stabilized application.
Source: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot
Start / End / Elapsed: 20250317 04:27:07.961 / 20250317 04:31:02.963 / 00:03:55.002
Status: 3 tests total, 1 passed, 2 failed, 0 skipped
00:13:21.624 SUITE Restart Odl With Tell Based True
Full Name: controller-clustering-tell.txt.Restart Odl With Tell Based True
Documentation:

Set tell-based protocol usage

Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

Suite stops all odl nodes, un-comment usage of tell-based protocol in config file (means make it true) and starts all nodes again.
Source: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
Start / End / Elapsed: 20250317 04:31:02.964 / 20250317 04:44:24.588 / 00:13:21.624
Status: 3 tests total, 1 passed, 2 failed, 0 skipped
00:00:53.940 SUITE Carpeople Crud
Full Name: controller-clustering-tell.txt.Carpeople Crud
Documentation:

Suite for performing basic car/people CRUD operations on leaders and followers.

Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

More precisely, Update operation is not executed, but some operations are using specific RPCs which goes beyond "basic CRUD".

Cars are added by one big PUT to datastore on car Leader. People are added in a loop with add-person RPC on a people Follower. Cars are bought by chunks on each member, by loop with buy-car RPC.

All data is deleted at the end of the suite. This suite expects car, people and car-people modules to have separate Shards.
Source: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot
Start / End / Elapsed: 20250317 04:44:24.588 / 20250317 04:45:18.528 / 00:00:53.940
Status: 13 tests total, 0 passed, 13 failed, 0 skipped
Message: Suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.129:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
00:00:52.342 SUITE Car Failover Crud
Full Name: controller-clustering-tell.txt.Car Failover Crud
Documentation:

Suite mixing basic operations with restart of car Leader.

Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

This test stops the current leader of the "car" shard and then executes CRD operations on the new leader and a new follower. The stopped member is brought back. This suite uses 3 different car sets, same size but different starting ID.

Other models and shards (people, car-people) are not accessed by this suite.

All data is deleted at the end of the suite. This suite expects car module to have a separate Shard.
Source: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot
Start / End / Elapsed: 20250317 04:45:18.529 / 20250317 04:46:10.871 / 00:00:52.342
Status: 16 tests total, 0 passed, 16 failed, 0 skipped
Message: Suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.129:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
00:00:53.387 SUITE Car Persistence Recovery
Full Name: controller-clustering-tell.txt.Car Persistence Recovery
Documentation:

This test restarts all controllers to verify recovery of car data from persistence.

Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

Other models and shards (people, car-people) are not accessed by this suite.

All data is deleted at the end of the suite. This suite expects car module to have a separate Shard.
Source: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot
Start / End / Elapsed: 20250317 04:46:10.872 / 20250317 04:47:04.259 / 00:00:53.387
Status: 7 tests total, 0 passed, 7 failed, 0 skipped
Message: Suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.166:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
00:00:52.640 SUITE Buycar Failover
Full Name: controller-clustering-tell.txt.Buycar Failover
Documentation:

This test focuses on testing buy-car RPC over 3 Leader reboots.

Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

All purchases are against the same node, which is the first one to get rebooted.

All data is deleted at the end of the suite. This suite expects car, people and car-people modules to have separate Shards.
Source: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot
Start / End / Elapsed: 20250317 04:47:04.260 / 20250317 04:47:56.900 / 00:00:52.640
Status: 10 tests total, 0 passed, 10 failed, 0 skipped
Message: Suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.166:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
00:00:54.357 SUITE Entity Isolate
Full Name: controller-clustering-tell.txt.Entity Isolate
Documentation:

Suite for performing member isolation and rejoin, we do with entity-ownership leader.
Source: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot
Start / End / Elapsed: 20250317 04:47:56.900 / 20250317 04:48:51.257 / 00:00:54.357
Status: 5 tests total, 0 passed, 5 failed, 0 skipped
Message: Suite setup failed: Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f... [ Message content over the limit has been removed. ] ...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
00:00:52.535 SUITE Buycar Failover Isolation
Full Name: controller-clustering-tell.txt.Buycar Failover Isolation
Documentation:

This test focuses on testing buy-car RPC over the Leader isolation.

Copyright (c) 2017 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

All purchases are against the same node, which is the first one to get isolated.

All data is deleted at the end of the suite. This suite expects car, people and car-people modules to have separate Shards.
Source: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot
Start / End / Elapsed: 20250317 04:48:51.258 / 20250317 04:49:43.793 / 00:00:52.535
Status: 10 tests total, 0 passed, 10 failed, 0 skipped
Message: Suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.166:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
00:00:53.176 SUITE Car Failover Crud Isolation
Full Name: controller-clustering-tell.txt.Car Failover Crud Isolation
Documentation:

Suite mixing basic operations with isolation of car Leader.

Copyright (c) 2017 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

This test isolates the current leader of the "car" shard and then executes CRD operations on the new leader and a new follower. The isolated member is brought back. This suite uses 3 different car sets, same size but different starting ID.

Other models and shards (people, car-people) are not accessed by this suite.

All data is deleted at the end of the suite. This suite expects car module to have a separate Shard.
Source: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot
Start / End / Elapsed: 20250317 04:49:43.793 / 20250317 04:50:36.969 / 00:00:53.176
Status: 16 tests total, 0 passed, 16 failed, 0 skipped
Message: Suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.166:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
00:00:52.537 SUITE Car Outage Corners
Full Name: controller-clustering-tell.txt.Car Outage Corners
Documentation:

Cluster suite for testing minimal and sum-minimal member population behavior.

Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

This test stops majority of the followers and verifies car addition is not possible, then resumes single follower (first from original list) and checks that addition works. Then remaining members are brought up. Leader member is always up and assumed to remain Leading during the whole suite run.

TODO: Use initial data to check more operations. TODO: Perhaps merge with car_failover_crud suite.

Other modules and Shards (people, car-people) are not accessed by this suite.

All data is deleted at the end of the suite. This suite expects car module to have a separate Shard.
Source: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot
Start / End / Elapsed: 20250317 04:50:36.969 / 20250317 04:51:29.506 / 00:00:52.537
Status: 8 tests total, 0 passed, 8 failed, 0 skipped
Message: Suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.166:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig