Test Statistics

Total Statistics
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
All Tests
16463101000:10:34
Statistics by Tag
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
No Tags
Statistics by Suite
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
ovsdb-upstream-clustering.txt
16463101000:10:48
ovsdb-upstream-clustering . txt . Southbound Cluster
825032000:06:35
ovsdb-upstream-clustering . txt . Southbound Cluster . Ovsdb Southbound Cluster
442717000:03:34
ovsdb-upstream-clustering . txt . Southbound Cluster . Southbound Cluster Extension
382315000:03:01
ovsdb-upstream-clustering . txt . Southbound Cluster
821369000:04:13
ovsdb-upstream-clustering . txt . Southbound Cluster . Ovsdb Southbound Cluster
44836000:02:16
ovsdb-upstream-clustering . txt . Southbound Cluster . Southbound Cluster Extension
38533000:01:57

Test Execution Log

00:10:48.003 SUITE ovsdb-upstream-clustering.txt
Full Name: ovsdb-upstream-clustering.txt
Start / End / Elapsed: 20250225 01:28:45.117 / 20250225 01:39:33.120 / 00:10:48.003
Status: 164 tests total, 63 passed, 101 failed, 0 skipped
00:06:35.317 SUITE Southbound Cluster
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster
Source: /w/workspace/ovsdb-csit-3node-upstream-clustering-only-scandium/test/csit/suites/ovsdb/Southbound_Cluster
Start / End / Elapsed: 20250225 01:28:45.140 / 20250225 01:35:20.457 / 00:06:35.317
Status: 82 tests total, 50 passed, 32 failed, 0 skipped
00:03:34.121 SUITE Ovsdb Southbound Cluster
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster
Documentation:

Test suite for Ovsdb Southbound Cluster - Owner failover and recover
Source: /w/workspace/ovsdb-csit-3node-upstream-clustering-only-scandium/test/csit/suites/ovsdb/Southbound_Cluster/010__Ovsdb_Southbound_Cluster.robot
Start / End / Elapsed: 20250225 01:28:45.141 / 20250225 01:32:19.262 / 00:03:34.121
Status: 44 tests total, 27 passed, 17 failed, 0 skipped
00:00:04.521 SETUP Suite Setup  
Start / End / Elapsed: 20250225 01:28:45.636 / 20250225 01:28:50.157 / 00:00:04.521
00:00:00.000 TEARDOWN RequestsLibrary . Delete All Sessions  
Documentation:

Removes all the session objects
Start / End / Elapsed: 20250225 01:32:19.262 / 20250225 01:32:19.262 / 00:00:00.000
00:00:05.943 TEST Check Shards Status Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Check Shards Status Before Fail
Documentation:

Check Status for all shards in Ovsdb application.
Start / End / Elapsed: 20250225 01:28:50.157 / 20250225 01:28:56.100 / 00:00:05.943
Status: PASS
00:00:03.885 TEST Start OVS Multiple Connections
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Start OVS Multiple Connections
Documentation:

Connect OVS to all cluster instances.
Start / End / Elapsed: 20250225 01:28:56.101 / 20250225 01:28:59.986 / 00:00:03.885
Status: PASS
00:00:00.660 TEST Check Entity Owner Status And Find Owner and Candidate Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Check Entity Owner Status And Find Owner and Candidate Before Fail
Documentation:

Check Entity Owner Status and identify owner and candidate.
Start / End / Elapsed: 20250225 01:28:59.986 / 20250225 01:29:00.646 / 00:00:00.660
Status: PASS
00:00:01.325 TEST Create Bridge Manually and Verify Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Bridge Manually and Verify Before Fail
Documentation:

Create bridge with OVS command and verify it gets applied from all instances.
Start / End / Elapsed: 20250225 01:29:00.646 / 20250225 01:29:01.971 / 00:00:01.325
Status: PASS
00:00:01.223 TEST Add Port Manually and Verify Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Add Port Manually and Verify Before Fail
Documentation:

Add port with OVS command and verify it gets applied from all instances.
Start / End / Elapsed: 20250225 01:29:01.972 / 20250225 01:29:03.195 / 00:00:01.223
Status: PASS
00:00:01.804 TEST Create Tap Device Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Tap Device Before Fail
Documentation:

Create tap devices to add to the bridge in ovs
Start / End / Elapsed: 20250225 01:29:03.195 / 20250225 01:29:04.999 / 00:00:01.804
Status: PASS
00:00:02.779 TEST Add Tap Device Manually and Verify Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Add Tap Device Manually and Verify Before Fail
Documentation:

Add tap devices to the bridge with OVS command and verify it gets applied from all instances.
Start / End / Elapsed: 20250225 01:29:04.999 / 20250225 01:29:07.778 / 00:00:02.779
Status: PASS
00:00:01.055 TEST Delete the Bridge Manually and Verify Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Delete the Bridge Manually and Verify Before Fail
Documentation:

Delete bridge with OVS command and verify it gets deleted from all instances.
Start / End / Elapsed: 20250225 01:29:07.778 / 20250225 01:29:08.833 / 00:00:01.055
Status: PASS
00:00:11.030 TEST Create Bridge In Owner and Verify Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Bridge In Owner and Verify Before Fail
Documentation:

Create Bridge in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250225 01:29:08.833 / 20250225 01:29:19.863 / 00:00:11.030
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 10 seconds. The last error was: '{"network-topology:node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":49968,"local-ip":"10.30.170.59","remote-ip":"10.30.170.92"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.59:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.95:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.158:6640","number_of_connections":1,"connected":true}]}]}' contains 'br01' 0 times, not 1 time.
00:00:00.402 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing  
Documentation:

Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden.
Start / End / Elapsed: 20250225 01:29:08.833 / 20250225 01:29:09.235 / 00:00:00.402
00:00:10.620 KEYWORD ClusterOvsdb . Create Sample Bridge And Verify   ${original_owner}
Documentation:

Create bridge br01 in controller ${controller_index} and verify it gets created in all instances in ${controller_index_list}.
Start / End / Elapsed: 20250225 01:29:09.243 / 20250225 01:29:19.863 / 00:00:10.620
00:00:10.950 TEST Create Port In Owner and Verify Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Port In Owner and Verify Before Fail
Documentation:

Create Port in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250225 01:29:19.863 / 20250225 01:29:30.813 / 00:00:10.950
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 10 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.170.59:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01/termination-point=vx2?content=nonconfig
00:00:00.649 TEST Modify the destination IP of Port In Owner Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Modify the destination IP of Port In Owner Before Fail
Documentation:

Modify the dst ip of existing port in Owner.
Start / End / Elapsed: 20250225 01:29:30.814 / 20250225 01:29:31.463 / 00:00:00.649
Status: PASS
00:00:05.641 TEST Verify Port Is Modified Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Verify Port Is Modified Before Fail
Documentation:

Verify port is modified in all instances.
Start / End / Elapsed: 20250225 01:29:31.462 / 20250225 01:29:37.103 / 00:00:05.641
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.170.59:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig
00:00:00.653 TEST Delete Port In Owner Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Delete Port In Owner Before Fail
Documentation:

Delete port in Owner and verify it gets deleted from all instances.
Start / End / Elapsed: 20250225 01:29:37.104 / 20250225 01:29:37.757 / 00:00:00.653
Status: PASS
00:00:00.646 TEST Delete Bridge In Owner And Verify Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Delete Bridge In Owner And Verify Before Fail
Documentation:

Delete bridge in Owner and verify it gets deleted from all instances.
Start / End / Elapsed: 20250225 01:29:37.757 / 20250225 01:29:38.403 / 00:00:00.646
Status: PASS
00:00:03.892 TEST Kill Owner Instance
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Kill Owner Instance
Documentation:

Kill Owner Instance and verify it is dead
Start / End / Elapsed: 20250225 01:29:38.403 / 20250225 01:29:42.295 / 00:00:03.892
Status: PASS
00:00:11.820 TEST Check Shards Status After Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Check Shards Status After Fail
Documentation:

Create original cluster list and check Status for all shards in Ovsdb application.
Start / End / Elapsed: 20250225 01:29:42.296 / 20250225 01:29:54.116 / 00:00:11.820
Status: PASS
00:00:06.621 TEST Check Entity Owner Status And Find Owner and Candidate After Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Check Entity Owner Status And Find Owner and Candidate After Fail
Documentation:

Check Entity Owner Status and identify owner and candidate.
Start / End / Elapsed: 20250225 01:29:54.116 / 20250225 01:30:00.737 / 00:00:06.621
Status: PASS
00:00:06.658 TEST Create Bridge Manually and Verify After Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Bridge Manually and Verify After Fail
Documentation:

Create bridge with OVS command and verify it gets applied from all instances.
Start / End / Elapsed: 20250225 01:30:00.737 / 20250225 01:30:07.395 / 00:00:06.658
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":49968,"local-ip":"10.30.170.59","remote-ip":"10.30.170.92"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.59:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.95:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.158:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'br-s1' 0 times, not 5 times.
00:00:06.196 TEST Add Port Manually and Verify After Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Add Port Manually and Verify After Fail
Documentation:

Add port with OVS command and verify it gets applied from all instances.
Start / End / Elapsed: 20250225 01:30:07.395 / 20250225 01:30:13.591 / 00:00:06.196
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":49968,"local-ip":"10.30.170.59","remote-ip":"10.30.170.92"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.59:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.95:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.158:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'vx1' 0 times, not 2 times.
00:00:01.703 TEST Create Tap Device After Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Tap Device After Fail
Documentation:

Create tap devices to add to the bridge in ovs
Start / End / Elapsed: 20250225 01:30:13.591 / 20250225 01:30:15.294 / 00:00:01.703
Status: PASS
00:00:06.155 TEST Add Tap Device Manually and Verify After Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Add Tap Device Manually and Verify After Fail
Documentation:

Add tap devices to the bridge with OVS command and verify it gets applied from all instances.
Start / End / Elapsed: 20250225 01:30:15.297 / 20250225 01:30:21.452 / 00:00:06.155
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":49968,"local-ip":"10.30.170.59","remote-ip":"10.30.170.92"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.59:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.95:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.158:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'vport1' 0 times, not 2 times.
00:00:00.818 TEST Delete the Bridge Manually and Verify After Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Delete the Bridge Manually and Verify After Fail
Documentation:

Delete bridge with OVS command and verify it gets deleted from all instances.
Start / End / Elapsed: 20250225 01:30:21.452 / 20250225 01:30:22.270 / 00:00:00.818
Status: PASS
00:00:10.844 TEST Create Bridge In Owner and Verify After Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Bridge In Owner and Verify After Fail
Documentation:

Create Bridge in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250225 01:30:22.271 / 20250225 01:30:33.115 / 00:00:10.844
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 10 seconds. The last error was: '{"network-topology:node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":49968,"local-ip":"10.30.170.59","remote-ip":"10.30.170.92"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.59:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.95:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.158:6640","number_of_connections":1,"connected":true}]}]}' contains 'br01' 0 times, not 1 time.
00:00:10.777 TEST Create Port In Owner and Verify After Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Port In Owner and Verify After Fail
Documentation:

Create Port in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250225 01:30:33.115 / 20250225 01:30:43.892 / 00:00:10.777
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 10 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.170.95:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01/termination-point=vx2?content=nonconfig
00:00:00.517 TEST Modify the destination IP of Port In Owner After Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Modify the destination IP of Port In Owner After Fail
Documentation:

Modify the dst ip of existing port in Owner.
Start / End / Elapsed: 20250225 01:30:43.892 / 20250225 01:30:44.409 / 00:00:00.517
Status: PASS
00:00:05.555 TEST Verify Port Is Modified After Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Verify Port Is Modified After Fail
Documentation:

Verify port is modified in all instances.
Start / End / Elapsed: 20250225 01:30:44.409 / 20250225 01:30:49.964 / 00:00:05.555
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.170.95:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig
00:00:14.244 TEST Start Old Owner Instance
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Start Old Owner Instance
Documentation:

Start Owner Instance and verify it is active
Start / End / Elapsed: 20250225 01:30:49.965 / 20250225 01:31:04.209 / 00:00:14.244
Status: PASS
00:00:03.436 TEST Check Shards Status After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Check Shards Status After Recover
Documentation:

Create original cluster list and check Status for all shards in Ovsdb application.
Start / End / Elapsed: 20250225 01:31:04.209 / 20250225 01:31:07.645 / 00:00:03.436
Status: PASS
00:00:00.585 TEST Check Entity Owner Status After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Check Entity Owner Status After Recover
Documentation:

Check Entity Owner Status and identify owner and candidate.
Start / End / Elapsed: 20250225 01:31:07.645 / 20250225 01:31:08.230 / 00:00:00.585
Status: PASS
00:00:06.771 TEST Create Bridge Manually and Verify After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Bridge Manually and Verify After Recover
Documentation:

Create bridge with OVS command and verify it gets applied from all instances.
Start / End / Elapsed: 20250225 01:31:08.229 / 20250225 01:31:15.000 / 00:00:06.771
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":49968,"local-ip":"10.30.170.59","remote-ip":"10.30.170.92"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.59:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.95:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.158:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'br-s1' 0 times, not 5 times.
00:00:06.278 TEST Add Port Manually and Verify After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Add Port Manually and Verify After Recover
Documentation:

Add port with OVS command and verify it gets applied from all instances.
Start / End / Elapsed: 20250225 01:31:15.001 / 20250225 01:31:21.279 / 00:00:06.278
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":49968,"local-ip":"10.30.170.59","remote-ip":"10.30.170.92"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.59:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.95:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.158:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'vx1' 0 times, not 2 times.
00:00:01.794 TEST Create Tap Device After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Tap Device After Recover
Documentation:

Create tap devices to add to the bridge in ovs
Start / End / Elapsed: 20250225 01:31:21.279 / 20250225 01:31:23.073 / 00:00:01.794
Status: PASS
00:00:06.303 TEST Add Tap Device Manually and Verify After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Add Tap Device Manually and Verify After Recover
Documentation:

Add tap devices to the bridge with OVS command and verify it gets applied from all instances.
Start / End / Elapsed: 20250225 01:31:23.073 / 20250225 01:31:29.376 / 00:00:06.303
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":49968,"local-ip":"10.30.170.59","remote-ip":"10.30.170.92"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.59:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.95:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.158:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'vport1' 0 times, not 2 times.
00:00:01.024 TEST Delete the Bridge Manually and Verify After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Delete the Bridge Manually and Verify After Recover
Documentation:

Delete bridge with OVS command and verify it gets deleted from all instances.
Start / End / Elapsed: 20250225 01:31:29.376 / 20250225 01:31:30.400 / 00:00:01.024
Status: PASS
00:00:05.647 TEST Verify Modified Port After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Verify Modified Port After Recover
Documentation:

Verify modified port exists in all instances.
Start / End / Elapsed: 20250225 01:31:30.400 / 20250225 01:31:36.047 / 00:00:05.647
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.170.59:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig
00:00:02.560 TEST Delete Port In New Owner After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Delete Port In New Owner After Recover
Documentation:

Delete port in Owner and verify it gets deleted from all instances.
Start / End / Elapsed: 20250225 01:31:36.048 / 20250225 01:31:38.608 / 00:00:02.560
Status: PASS
00:00:00.685 TEST Delete Bridge In New Owner And Verify After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Delete Bridge In New Owner And Verify After Recover
Documentation:

Delete bridge in Owner and verify it gets deleted from all instances.
Start / End / Elapsed: 20250225 01:31:38.608 / 20250225 01:31:39.293 / 00:00:00.685
Status: PASS
00:00:11.476 TEST Create Bridge In Old Owner and Verify After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Bridge In Old Owner and Verify After Recover
Documentation:

Create Bridge in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250225 01:31:39.293 / 20250225 01:31:50.769 / 00:00:11.476
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 10 seconds. The last error was: '{"network-topology:node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":49968,"local-ip":"10.30.170.59","remote-ip":"10.30.170.92"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.59:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.95:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.158:6640","number_of_connections":1,"connected":true}]}]}' contains 'br01' 0 times, not 1 time.
00:00:10.965 TEST Create Port In Old Owner and Verify After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Port In Old Owner and Verify After Recover
Documentation:

Create Port in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250225 01:31:50.769 / 20250225 01:32:01.734 / 00:00:10.965
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 10 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.170.59:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01/termination-point=vx2?content=nonconfig
00:00:00.684 TEST Modify the destination IP of Port In Old Owner After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Modify the destination IP of Port In Old Owner After Recover
Documentation:

Modify the dst ip of existing port in Owner.
Start / End / Elapsed: 20250225 01:32:01.734 / 20250225 01:32:02.418 / 00:00:00.684
Status: PASS
00:00:05.656 TEST Verify Port Is Modified After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Verify Port Is Modified After Recover
Documentation:

Verify port is modified in all instances.
Start / End / Elapsed: 20250225 01:32:02.418 / 20250225 01:32:08.074 / 00:00:05.656
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.170.59:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig
00:00:00.653 TEST Delete Port In Old Owner After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Delete Port In Old Owner After Recover
Documentation:

Delete port in Owner and verify it gets deleted from all instances.
Start / End / Elapsed: 20250225 01:32:08.075 / 20250225 01:32:08.728 / 00:00:00.653
Status: PASS
00:00:00.653 TEST Delete Bridge In Old Owner And Verify After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Delete Bridge In Old Owner And Verify After Recover
Documentation:

Delete bridge in Owner and verify it gets deleted from all instances.
Start / End / Elapsed: 20250225 01:32:08.729 / 20250225 01:32:09.382 / 00:00:00.653
Status: PASS
00:00:09.879 TEST Cleans Up Test Environment For Next Suite
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Cleans Up Test Environment For Next Suite
Documentation:

Cleans up test environment, close existing sessions in teardown.
Start / End / Elapsed: 20250225 01:32:09.382 / 20250225 01:32:19.261 / 00:00:09.879
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":49968,"local-ip":"10.30.170.59","remote-ip":"10.30.170.92"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.59:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.95:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.158:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'ovsdb://uuid' 1 time, not 0 times.
00:03:01.193 SUITE Southbound Cluster Extension
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Southbound Cluster Extension
Documentation:

Test suite for Ovsdb Southbound Cluster - Candidate failover and recover
Source: /w/workspace/ovsdb-csit-3node-upstream-clustering-only-scandium/test/csit/suites/ovsdb/Southbound_Cluster/020__Southbound_Cluster_Extension.robot
Start / End / Elapsed: 20250225 01:32:19.263 / 20250225 01:35:20.456 / 00:03:01.193
Status: 38 tests total, 23 passed, 15 failed, 0 skipped
00:04:12.661 SUITE Southbound Cluster
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster
Source: /w/workspace/ovsdb-csit-3node-upstream-clustering-only-scandium/test/csit/suites/ovsdb/Southbound_Cluster
Start / End / Elapsed: 20250225 01:35:20.458 / 20250225 01:39:33.119 / 00:04:12.661
Status: 82 tests total, 13 passed, 69 failed, 0 skipped