Test Statistics

Total Statistics
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
All Tests
16445119000:09:31
Statistics by Tag
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
No Tags
Statistics by Suite
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
ovsdb-upstream-clustering.txt
16445119000:09:47
ovsdb-upstream-clustering . txt . Southbound Cluster
823250000:05:34
ovsdb-upstream-clustering . txt . Southbound Cluster . Ovsdb Southbound Cluster
442717000:03:37
ovsdb-upstream-clustering . txt . Southbound Cluster . Southbound Cluster Extension
38533000:01:58
ovsdb-upstream-clustering . txt . Southbound Cluster
821369000:04:12
ovsdb-upstream-clustering . txt . Southbound Cluster . Ovsdb Southbound Cluster
44836000:02:15
ovsdb-upstream-clustering . txt . Southbound Cluster . Southbound Cluster Extension
38533000:01:57

Test Execution Log

00:09:46.864 SUITE ovsdb-upstream-clustering.txt
Full Name: ovsdb-upstream-clustering.txt
Start / End / Elapsed: 20250209 02:43:13.378 / 20250209 02:53:00.242 / 00:09:46.864
Status: 164 tests total, 45 passed, 119 failed, 0 skipped
00:05:34.432 SUITE Southbound Cluster
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster
Source: /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/test/csit/suites/ovsdb/Southbound_Cluster
Start / End / Elapsed: 20250209 02:43:13.402 / 20250209 02:48:47.834 / 00:05:34.432
Status: 82 tests total, 32 passed, 50 failed, 0 skipped
00:03:36.800 SUITE Ovsdb Southbound Cluster
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster
Documentation:

Test suite for Ovsdb Southbound Cluster - Owner failover and recover
Source: /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/test/csit/suites/ovsdb/Southbound_Cluster/010__Ovsdb_Southbound_Cluster.robot
Start / End / Elapsed: 20250209 02:43:13.404 / 20250209 02:46:50.204 / 00:03:36.800
Status: 44 tests total, 27 passed, 17 failed, 0 skipped
00:00:05.360 SETUP Suite Setup  
Start / End / Elapsed: 20250209 02:43:13.897 / 20250209 02:43:19.257 / 00:00:05.360
00:00:00.000 TEARDOWN RequestsLibrary . Delete All Sessions  
Documentation:

Removes all the session objects
Start / End / Elapsed: 20250209 02:46:50.204 / 20250209 02:46:50.204 / 00:00:00.000
00:00:08.129 TEST Check Shards Status Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Check Shards Status Before Fail
Documentation:

Check Status for all shards in Ovsdb application.
Start / End / Elapsed: 20250209 02:43:19.257 / 20250209 02:43:27.386 / 00:00:08.129
Status: PASS
00:00:05.395 TEST Start OVS Multiple Connections
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Start OVS Multiple Connections
Documentation:

Connect OVS to all cluster instances.
Start / End / Elapsed: 20250209 02:43:27.387 / 20250209 02:43:32.782 / 00:00:05.395
Status: PASS
00:00:00.623 TEST Check Entity Owner Status And Find Owner and Candidate Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Check Entity Owner Status And Find Owner and Candidate Before Fail
Documentation:

Check Entity Owner Status and identify owner and candidate.
Start / End / Elapsed: 20250209 02:43:32.782 / 20250209 02:43:33.405 / 00:00:00.623
Status: PASS
00:00:01.162 TEST Create Bridge Manually and Verify Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Bridge Manually and Verify Before Fail
Documentation:

Create bridge with OVS command and verify it gets applied from all instances.
Start / End / Elapsed: 20250209 02:43:33.405 / 20250209 02:43:34.567 / 00:00:01.162
Status: PASS
00:00:01.155 TEST Add Port Manually and Verify Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Add Port Manually and Verify Before Fail
Documentation:

Add port with OVS command and verify it gets applied from all instances.
Start / End / Elapsed: 20250209 02:43:34.567 / 20250209 02:43:35.722 / 00:00:01.155
Status: PASS
00:00:01.853 TEST Create Tap Device Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Tap Device Before Fail
Documentation:

Create tap devices to add to the bridge in ovs
Start / End / Elapsed: 20250209 02:43:35.722 / 20250209 02:43:37.575 / 00:00:01.853
Status: PASS
00:00:01.227 TEST Add Tap Device Manually and Verify Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Add Tap Device Manually and Verify Before Fail
Documentation:

Add tap devices to the bridge with OVS command and verify it gets applied from all instances.
Start / End / Elapsed: 20250209 02:43:37.576 / 20250209 02:43:38.803 / 00:00:01.227
Status: PASS
00:00:02.071 TEST Delete the Bridge Manually and Verify Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Delete the Bridge Manually and Verify Before Fail
Documentation:

Delete bridge with OVS command and verify it gets deleted from all instances.
Start / End / Elapsed: 20250209 02:43:38.803 / 20250209 02:43:40.874 / 00:00:02.071
Status: PASS
00:00:11.022 TEST Create Bridge In Owner and Verify Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Bridge In Owner and Verify Before Fail
Documentation:

Create Bridge in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250209 02:43:40.874 / 20250209 02:43:51.896 / 00:00:11.022
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 10 seconds. The last error was: '{"network-topology:node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":46702,"local-ip":"10.30.170.177","remote-ip":"10.30.171.117"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.177:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.234:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.236:6640","number_of_connections":1,"connected":true}]}]}' contains 'br01' 0 times, not 1 time.
00:00:00.395 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing  
Documentation:

Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden.
Start / End / Elapsed: 20250209 02:43:40.875 / 20250209 02:43:41.270 / 00:00:00.395
00:00:10.619 KEYWORD ClusterOvsdb . Create Sample Bridge And Verify   ${original_owner}
Documentation:

Create bridge br01 in controller ${controller_index} and verify it gets created in all instances in ${controller_index_list}.
Start / End / Elapsed: 20250209 02:43:41.277 / 20250209 02:43:51.896 / 00:00:10.619
00:00:00.000 KEYWORD ${body} = OperatingSystem . Get File   /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/test/csit/libraries/../variables/ovsdb/create_bridge_3node.json
Documentation:

Returns the contents of a specified file.
Start / End / Elapsed: 20250209 02:43:41.279 / 20250209 02:43:41.279 / 00:00:00.000
00:00:00.000 KEYWORD ${body} = String . Replace String   ${body} ovsdb://127.0.0.1:61644 ovsdb://uuid/${ovsdb_uuid}
Documentation:

Replaces search_for in the given string with replace_with.
Start / End / Elapsed: 20250209 02:43:41.280 / 20250209 02:43:41.280 / 00:00:00.000
00:00:00.000 KEYWORD ${body} = String . Replace String   ${body} tcp:controller1:6633 tcp:${ODL_SYSTEM_1_IP}:6633
Documentation:

Replaces search_for in the given string with replace_with.
Start / End / Elapsed: 20250209 02:43:41.280 / 20250209 02:43:41.280 / 00:00:00.000
00:00:00.000 KEYWORD ${body} = String . Replace String   ${body} tcp:controller2:6633 tcp:${ODL_SYSTEM_2_IP}:6633
Documentation:

Replaces search_for in the given string with replace_with.
Start / End / Elapsed: 20250209 02:43:41.281 / 20250209 02:43:41.281 / 00:00:00.000
00:00:00.000 KEYWORD ${body} = String . Replace String   ${body} tcp:controller3:6633 tcp:${ODL_SYSTEM_3_IP}:6633
Documentation:

Replaces search_for in the given string with replace_with.
Start / End / Elapsed: 20250209 02:43:41.281 / 20250209 02:43:41.281 / 00:00:00.000
00:00:00.000 KEYWORD ${body} = String . Replace String   ${body} 127.0.0.1 ${TOOLS_SYSTEM_IP}
Documentation:

Replaces search_for in the given string with replace_with.
Start / End / Elapsed: 20250209 02:43:41.281 / 20250209 02:43:41.281 / 00:00:00.000
00:00:00.000 KEYWORD ${body} = String . Replace String   ${body} br01 ${BRIDGE}
Documentation:

Replaces search_for in the given string with replace_with.
Start / End / Elapsed: 20250209 02:43:41.282 / 20250209 02:43:41.282 / 00:00:00.000
00:00:00.000 KEYWORD ${body} = String . Replace String   ${body} 61644 ${OVSDB_PORT}
Documentation:

Replaces search_for in the given string with replace_with.
Start / End / Elapsed: 20250209 02:43:41.282 / 20250209 02:43:41.282 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Log   ${body}
Documentation:

Logs the given message with the given level.
Start / End / Elapsed: 20250209 02:43:41.283 / 20250209 02:43:41.283 / 00:00:00.000
00:00:00.000 KEYWORD ${TOOLS_SYSTEM_IP1} = String . Replace String   ${TOOLS_SYSTEM_IP} ${TOOLS_SYSTEM_IP} "${TOOLS_SYSTEM_IP}"
Documentation:

Replaces search_for in the given string with replace_with.
Start / End / Elapsed: 20250209 02:43:41.283 / 20250209 02:43:41.283 / 00:00:00.000
00:00:00.000 KEYWORD ${dictionary} = BuiltIn . Create Dictionary   ${TOOLS_SYSTEM_IP1}=1 ${OVSDBPORT}=4 ${BRIDGE}=1
Documentation:

Creates and returns a dictionary based on the given items.
Start / End / Elapsed: 20250209 02:43:41.283 / 20250209 02:43:41.283 / 00:00:00.000
00:00:00.228 KEYWORD BuiltIn . Wait Until Keyword Succeeds   5s 1s ClusterManagement.Put_As_Json_And_Check_Member_List_Or_All ${RFC8040_SOUTHBOUND_NODE_API}uuid%2F${ovsdb_uuid}%2Fbridge%2F${BRIDGE} ${body} ${controller_index} ${controller_index_list}
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20250209 02:43:41.284 / 20250209 02:43:41.512 / 00:00:00.228
00:00:10.384 KEYWORD BuiltIn . Wait Until Keyword Succeeds   10s 2s ClusterManagement.Check_Item_Occurrence_Member_List_Or_All uri=${RFC8040_SOUTHBOUND_NODE_API}uuid%2F${ovsdb_uuid}?${RFC8040_OPERATIONAL_CONTENT} dictionary=${dictionary} member_index_list=${controller_index_list}
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20250209 02:43:41.512 / 20250209 02:43:51.896 / 00:00:10.384
Message: 5 failing items removed using the --remove-keywords option.
00:00:00.054 KEYWORD ClusterManagement . Check_Item_Occurrence_Member_List_Or_All   uri=${RFC8040_SOUTHBOUND_NODE_API}uuid%2F${ovsdb_uuid}?${RFC8040_OPERATIONAL_CONTENT} dictionary=${dictionary} member_index_list=${controller_index_list}
Documentation:

Send a GET with the supplied uri to all or some members defined in ${member_index_list}. Then check received for occurrences of items expressed in a dictionary {'"10.30.171.117"': '1', '6640': '4', 'br01': '1'}.
Start / End / Elapsed: 20250209 02:43:51.842 / 20250209 02:43:51.896 / 00:00:00.054
00:00:00.002 KEYWORD ${index_list} = ClusterManagement . List_Indices_Or_All   given_list=${member_index_list}
Documentation:

Utility to allow ${EMPTY} as default argument value, as the internal list is computed at runtime. This keyword always returns a (shallow) copy of given or default list, so operations with the returned list should not affect other lists. Also note that this keyword does not consider empty list to be ${EMPTY}.
Start / End / Elapsed: 20250209 02:43:51.843 / 20250209 02:43:51.845 / 00:00:00.002
00:00:00.051 FOR ${index} IN @{index_list}  
Start / End / Elapsed: 20250209 02:43:51.845 / 20250209 02:43:51.896 / 00:00:00.051
00:00:00.051 ITERATION ${index} = 1  
Start / End / Elapsed: 20250209 02:43:51.845 / 20250209 02:43:51.896 / 00:00:00.051
00:00:00.044 KEYWORD ${data} = ClusterManagement . Get_From_Member   uri=${uri} member_index=${index}
Documentation:

Send a GET with the supplied uri to member ${member_index}.
Start / End / Elapsed: 20250209 02:43:51.849 / 20250209 02:43:51.893 / 00:00:00.044
00:00:00.002 KEYWORD Utils . Check Item Occurrence   ${data} ${dictionary}
Documentation:

Check string for occurrences of items expressed in a list of dictionaries {item=occurrences}. 0 occurences means item is not present.
Start / End / Elapsed: 20250209 02:43:51.893 / 20250209 02:43:51.895 / 00:00:00.002
00:00:00.002 FOR ${item} IN @{dictionary_item_occurrence}  
Start / End / Elapsed: 20250209 02:43:51.894 / 20250209 02:43:51.896 / 00:00:00.002
00:00:00.000 ITERATION ${item} = "10.30.171.117"  
Start / End / Elapsed: 20250209 02:43:51.894 / 20250209 02:43:51.894 / 00:00:00.000
00:00:00.000 ITERATION ${item} = 6640  
Start / End / Elapsed: 20250209 02:43:51.894 / 20250209 02:43:51.894 / 00:00:00.000
00:00:00.001 ITERATION ${item} = br01  
Start / End / Elapsed: 20250209 02:43:51.895 / 20250209 02:43:51.896 / 00:00:00.001
00:00:00.000 KEYWORD BuiltIn . Should Contain X Times   ${string} ${item} ${dictionary_item_occurrence}[${item}]
Documentation:

Fails if container does not contain item count times.
Start / End / Elapsed: 20250209 02:43:51.895 / 20250209 02:43:51.895 / 00:00:00.000
02:43:51.895 INFO Item found from container 0 times.
02:43:51.895 FAIL '{"network-topology:node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":46702,"local-ip":"10.30.170.177","remote-ip":"10.30.171.117"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.177:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.234:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.236:6640","number_of_connections":1,"connected":true}]}]}' contains 'br01' 0 times, not 1 time.
02:43:51.896 FAIL Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 10 seconds. The last error was: '{"network-topology:node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":46702,"local-ip":"10.30.170.177","remote-ip":"10.30.171.117"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.177:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.234:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.236:6640","number_of_connections":1,"connected":true}]}]}' contains 'br01' 0 times, not 1 time.
00:00:10.894 TEST Create Port In Owner and Verify Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Port In Owner and Verify Before Fail
Documentation:

Create Port in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250209 02:43:51.897 / 20250209 02:44:02.791 / 00:00:10.894
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 10 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.170.177:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01/termination-point=vx2?content=nonconfig
00:00:00.374 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing  
Documentation:

Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden.
Start / End / Elapsed: 20250209 02:43:51.897 / 20250209 02:43:52.271 / 00:00:00.374
00:00:10.511 KEYWORD ClusterOvsdb . Create Sample Port And Verify   ${original_owner}
Documentation:

Add Port vx2 to bridge br01 in controller ${controller_index} and verify it gets added in all instances in ${controller_index_list}.
Start / End / Elapsed: 20250209 02:43:52.278 / 20250209 02:44:02.789 / 00:00:10.511
00:00:00.000 KEYWORD ${sample} = OperatingSystem . Get File   ${OVSDB_CONFIG_DIR}/create_port_3node.json
Documentation:

Returns the contents of a specified file.
Start / End / Elapsed: 20250209 02:43:52.280 / 20250209 02:43:52.280 / 00:00:00.000
00:00:00.000 KEYWORD ${body} = String . Replace String   ${sample} 192.168.1.10 ${TOOLS_SYSTEM_IP}
Documentation:

Replaces search_for in the given string with replace_with.
Start / End / Elapsed: 20250209 02:43:52.281 / 20250209 02:43:52.281 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Log   ${body}
Documentation:

Logs the given message with the given level.
Start / End / Elapsed: 20250209 02:43:52.281 / 20250209 02:43:52.281 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Log   URL is ${RFC8040_SOUTHBOUND_NODE_API}uuid%2F${ovsdb_uuid}%2Fbridge%2F${BRIDGE}/termination-point=vx2
Documentation:

Logs the given message with the given level.
Start / End / Elapsed: 20250209 02:43:52.282 / 20250209 02:43:52.282 / 00:00:00.000
00:00:00.000 KEYWORD ${port_dictionary} = BuiltIn . Create Dictionary   ${BRIDGE}=1 vx2=3
Documentation:

Creates and returns a dictionary based on the given items.
Start / End / Elapsed: 20250209 02:43:52.282 / 20250209 02:43:52.282 / 00:00:00.000
00:00:00.216 KEYWORD ClusterManagement . Put_As_Json_And_Check_Member_List_Or_All   ${RFC8040_SOUTHBOUND_NODE_API}uuid%2F${ovsdb_uuid}%2Fbridge%2F${BRIDGE}/termination-point=vx2 ${body} ${controller_index} ${controller_index_list}
Documentation:

Send a PUT with the supplied uri ${uri} and body ${data} to member ${member_index}. Then check data is replicated in all or some members defined in ${member_index_list}.
Start / End / Elapsed: 20250209 02:43:52.295 / 20250209 02:43:52.511 / 00:00:00.216
00:00:10.278 KEYWORD BuiltIn . Wait Until Keyword Succeeds   10s 2s ClusterManagement.Check_Item_Occurrence_Member_List_Or_All uri=${RFC8040_SOUTHBOUND_NODE_API}uuid%2F${ovsdb_uuid}%2Fbridge%2F${BRIDGE}/termination-point=vx2?${RFC8040_OPERATIONAL_CONTENT} dictionary=${port_dictionary} member_index_list=${controller_index_list}
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20250209 02:43:52.512 / 20250209 02:44:02.790 / 00:00:10.278
Message: 5 failing items removed using the --remove-keywords option.
00:00:00.035 KEYWORD ClusterManagement . Check_Item_Occurrence_Member_List_Or_All   uri=${RFC8040_SOUTHBOUND_NODE_API}uuid%2F${ovsdb_uuid}%2Fbridge%2F${BRIDGE}/termination-point=vx2?${RFC8040_OPERATIONAL_CONTENT} dictionary=${port_dictionary} member_index_list=${controller_index_list}
Documentation:

Send a GET with the supplied uri to all or some members defined in ${member_index_list}. Then check received for occurrences of items expressed in a dictionary ${dictionary}.
Start / End / Elapsed: 20250209 02:44:02.754 / 20250209 02:44:02.789 / 00:00:00.035
00:00:00.001 KEYWORD ${index_list} = ClusterManagement . List_Indices_Or_All   given_list=${member_index_list}
Documentation:

Utility to allow ${EMPTY} as default argument value, as the internal list is computed at runtime. This keyword always returns a (shallow) copy of given or default list, so operations with the returned list should not affect other lists. Also note that this keyword does not consider empty list to be ${EMPTY}.
Start / End / Elapsed: 20250209 02:44:02.755 / 20250209 02:44:02.756 / 00:00:00.001
00:00:00.033 FOR ${index} IN @{index_list}  
Start / End / Elapsed: 20250209 02:44:02.756 / 20250209 02:44:02.789 / 00:00:00.033
00:00:00.032 ITERATION ${index} = 1  
Start / End / Elapsed: 20250209 02:44:02.756 / 20250209 02:44:02.788 / 00:00:00.032
02:44:02.789 FAIL Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 10 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.170.177:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01/termination-point=vx2?content=nonconfig
00:00:00.713 TEST Modify the destination IP of Port In Owner Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Modify the destination IP of Port In Owner Before Fail
Documentation:

Modify the dst ip of existing port in Owner.
Start / End / Elapsed: 20250209 02:44:02.791 / 20250209 02:44:03.504 / 00:00:00.713
Status: PASS
00:00:05.658 TEST Verify Port Is Modified Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Verify Port Is Modified Before Fail
Documentation:

Verify port is modified in all instances.
Start / End / Elapsed: 20250209 02:44:03.503 / 20250209 02:44:09.161 / 00:00:05.658
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.170.177:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig
00:00:00.704 TEST Delete Port In Owner Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Delete Port In Owner Before Fail
Documentation:

Delete port in Owner and verify it gets deleted from all instances.
Start / End / Elapsed: 20250209 02:44:09.161 / 20250209 02:44:09.865 / 00:00:00.704
Status: PASS
00:00:00.672 TEST Delete Bridge In Owner And Verify Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Delete Bridge In Owner And Verify Before Fail
Documentation:

Delete bridge in Owner and verify it gets deleted from all instances.
Start / End / Elapsed: 20250209 02:44:09.865 / 20250209 02:44:10.537 / 00:00:00.672
Status: PASS
00:00:04.587 TEST Kill Owner Instance
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Kill Owner Instance
Documentation:

Kill Owner Instance and verify it is dead
Start / End / Elapsed: 20250209 02:44:10.538 / 20250209 02:44:15.125 / 00:00:04.587
Status: PASS
00:00:11.832 TEST Check Shards Status After Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Check Shards Status After Fail
Documentation:

Create original cluster list and check Status for all shards in Ovsdb application.
Start / End / Elapsed: 20250209 02:44:15.125 / 20250209 02:44:26.957 / 00:00:11.832
Status: PASS
00:00:04.999 TEST Check Entity Owner Status And Find Owner and Candidate After Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Check Entity Owner Status And Find Owner and Candidate After Fail
Documentation:

Check Entity Owner Status and identify owner and candidate.
Start / End / Elapsed: 20250209 02:44:26.958 / 20250209 02:44:31.957 / 00:00:04.999
Status: PASS
00:00:06.814 TEST Create Bridge Manually and Verify After Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Bridge Manually and Verify After Fail
Documentation:

Create bridge with OVS command and verify it gets applied from all instances.
Start / End / Elapsed: 20250209 02:44:31.957 / 20250209 02:44:38.771 / 00:00:06.814
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":46702,"local-ip":"10.30.170.177","remote-ip":"10.30.171.117"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.177:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.234:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.236:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'br-s1' 0 times, not 5 times.
00:00:06.255 TEST Add Port Manually and Verify After Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Add Port Manually and Verify After Fail
Documentation:

Add port with OVS command and verify it gets applied from all instances.
Start / End / Elapsed: 20250209 02:44:38.771 / 20250209 02:44:45.026 / 00:00:06.255
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":46702,"local-ip":"10.30.170.177","remote-ip":"10.30.171.117"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.177:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.234:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.236:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'vx1' 0 times, not 2 times.
00:00:01.815 TEST Create Tap Device After Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Tap Device After Fail
Documentation:

Create tap devices to add to the bridge in ovs
Start / End / Elapsed: 20250209 02:44:45.026 / 20250209 02:44:46.841 / 00:00:01.815
Status: PASS
00:00:06.177 TEST Add Tap Device Manually and Verify After Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Add Tap Device Manually and Verify After Fail
Documentation:

Add tap devices to the bridge with OVS command and verify it gets applied from all instances.
Start / End / Elapsed: 20250209 02:44:46.842 / 20250209 02:44:53.019 / 00:00:06.177
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":46702,"local-ip":"10.30.170.177","remote-ip":"10.30.171.117"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.177:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.234:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.236:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'vport1' 0 times, not 2 times.
00:00:00.861 TEST Delete the Bridge Manually and Verify After Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Delete the Bridge Manually and Verify After Fail
Documentation:

Delete bridge with OVS command and verify it gets deleted from all instances.
Start / End / Elapsed: 20250209 02:44:53.019 / 20250209 02:44:53.880 / 00:00:00.861
Status: PASS
00:00:10.869 TEST Create Bridge In Owner and Verify After Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Bridge In Owner and Verify After Fail
Documentation:

Create Bridge in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250209 02:44:53.880 / 20250209 02:45:04.749 / 00:00:10.869
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 10 seconds. The last error was: '{"network-topology:node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":46702,"local-ip":"10.30.170.177","remote-ip":"10.30.171.117"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.177:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.234:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.236:6640","number_of_connections":1,"connected":true}]}]}' contains 'br01' 0 times, not 1 time.
00:00:10.778 TEST Create Port In Owner and Verify After Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Port In Owner and Verify After Fail
Documentation:

Create Port in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250209 02:45:04.750 / 20250209 02:45:15.528 / 00:00:10.778
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 10 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.170.234:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01/termination-point=vx2?content=nonconfig
00:00:00.469 TEST Modify the destination IP of Port In Owner After Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Modify the destination IP of Port In Owner After Fail
Documentation:

Modify the dst ip of existing port in Owner.
Start / End / Elapsed: 20250209 02:45:15.528 / 20250209 02:45:15.997 / 00:00:00.469
Status: PASS
00:00:05.562 TEST Verify Port Is Modified After Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Verify Port Is Modified After Fail
Documentation:

Verify port is modified in all instances.
Start / End / Elapsed: 20250209 02:45:15.997 / 20250209 02:45:21.559 / 00:00:05.562
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.170.234:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig
00:00:15.054 TEST Start Old Owner Instance
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Start Old Owner Instance
Documentation:

Start Owner Instance and verify it is active
Start / End / Elapsed: 20250209 02:45:21.560 / 20250209 02:45:36.614 / 00:00:15.054
Status: PASS
00:00:04.241 TEST Check Shards Status After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Check Shards Status After Recover
Documentation:

Create original cluster list and check Status for all shards in Ovsdb application.
Start / End / Elapsed: 20250209 02:45:36.614 / 20250209 02:45:40.855 / 00:00:04.241
Status: PASS
00:00:00.694 TEST Check Entity Owner Status After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Check Entity Owner Status After Recover
Documentation:

Check Entity Owner Status and identify owner and candidate.
Start / End / Elapsed: 20250209 02:45:40.856 / 20250209 02:45:41.550 / 00:00:00.694
Status: PASS
00:00:06.796 TEST Create Bridge Manually and Verify After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Bridge Manually and Verify After Recover
Documentation:

Create bridge with OVS command and verify it gets applied from all instances.
Start / End / Elapsed: 20250209 02:45:41.550 / 20250209 02:45:48.346 / 00:00:06.796
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":46702,"local-ip":"10.30.170.177","remote-ip":"10.30.171.117"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.177:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.234:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.236:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'br-s1' 0 times, not 5 times.
00:00:06.372 TEST Add Port Manually and Verify After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Add Port Manually and Verify After Recover
Documentation:

Add port with OVS command and verify it gets applied from all instances.
Start / End / Elapsed: 20250209 02:45:48.346 / 20250209 02:45:54.718 / 00:00:06.372
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":46702,"local-ip":"10.30.170.177","remote-ip":"10.30.171.117"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.177:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.234:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.236:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'vx1' 0 times, not 2 times.
00:00:01.809 TEST Create Tap Device After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Tap Device After Recover
Documentation:

Create tap devices to add to the bridge in ovs
Start / End / Elapsed: 20250209 02:45:54.719 / 20250209 02:45:56.528 / 00:00:01.809
Status: PASS
00:00:06.385 TEST Add Tap Device Manually and Verify After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Add Tap Device Manually and Verify After Recover
Documentation:

Add tap devices to the bridge with OVS command and verify it gets applied from all instances.
Start / End / Elapsed: 20250209 02:45:56.528 / 20250209 02:46:02.913 / 00:00:06.385
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":46702,"local-ip":"10.30.170.177","remote-ip":"10.30.171.117"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.177:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.234:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.236:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'vport1' 0 times, not 2 times.
00:00:00.926 TEST Delete the Bridge Manually and Verify After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Delete the Bridge Manually and Verify After Recover
Documentation:

Delete bridge with OVS command and verify it gets deleted from all instances.
Start / End / Elapsed: 20250209 02:46:02.913 / 20250209 02:46:03.839 / 00:00:00.926
Status: PASS
00:00:05.624 TEST Verify Modified Port After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Verify Modified Port After Recover
Documentation:

Verify modified port exists in all instances.
Start / End / Elapsed: 20250209 02:46:03.839 / 20250209 02:46:09.463 / 00:00:05.624
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.170.177:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig
00:00:00.681 TEST Delete Port In New Owner After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Delete Port In New Owner After Recover
Documentation:

Delete port in Owner and verify it gets deleted from all instances.
Start / End / Elapsed: 20250209 02:46:09.463 / 20250209 02:46:10.144 / 00:00:00.681
Status: PASS
00:00:00.630 TEST Delete Bridge In New Owner And Verify After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Delete Bridge In New Owner And Verify After Recover
Documentation:

Delete bridge in Owner and verify it gets deleted from all instances.
Start / End / Elapsed: 20250209 02:46:10.144 / 20250209 02:46:10.774 / 00:00:00.630
Status: PASS
00:00:11.035 TEST Create Bridge In Old Owner and Verify After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Bridge In Old Owner and Verify After Recover
Documentation:

Create Bridge in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250209 02:46:10.774 / 20250209 02:46:21.809 / 00:00:11.035
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 10 seconds. The last error was: '{"network-topology:node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":46702,"local-ip":"10.30.170.177","remote-ip":"10.30.171.117"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.177:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.234:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.236:6640","number_of_connections":1,"connected":true}]}]}' contains 'br01' 0 times, not 1 time.
00:00:10.878 TEST Create Port In Old Owner and Verify After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Port In Old Owner and Verify After Recover
Documentation:

Create Port in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250209 02:46:21.809 / 20250209 02:46:32.687 / 00:00:10.878
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 10 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.170.177:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01/termination-point=vx2?content=nonconfig
00:00:00.666 TEST Modify the destination IP of Port In Old Owner After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Modify the destination IP of Port In Old Owner After Recover
Documentation:

Modify the dst ip of existing port in Owner.
Start / End / Elapsed: 20250209 02:46:32.688 / 20250209 02:46:33.354 / 00:00:00.666
Status: PASS
00:00:05.624 TEST Verify Port Is Modified After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Verify Port Is Modified After Recover
Documentation:

Verify port is modified in all instances.
Start / End / Elapsed: 20250209 02:46:33.354 / 20250209 02:46:38.978 / 00:00:05.624
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.170.177:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig
00:00:00.604 TEST Delete Port In Old Owner After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Delete Port In Old Owner After Recover
Documentation:

Delete port in Owner and verify it gets deleted from all instances.
Start / End / Elapsed: 20250209 02:46:38.978 / 20250209 02:46:39.582 / 00:00:00.604
Status: PASS
00:00:00.670 TEST Delete Bridge In Old Owner And Verify After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Delete Bridge In Old Owner And Verify After Recover
Documentation:

Delete bridge in Owner and verify it gets deleted from all instances.
Start / End / Elapsed: 20250209 02:46:39.582 / 20250209 02:46:40.252 / 00:00:00.670
Status: PASS
00:00:09.950 TEST Cleans Up Test Environment For Next Suite
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Cleans Up Test Environment For Next Suite
Documentation:

Cleans up test environment, close existing sessions in teardown.
Start / End / Elapsed: 20250209 02:46:40.252 / 20250209 02:46:50.202 / 00:00:09.950
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":46702,"local-ip":"10.30.170.177","remote-ip":"10.30.171.117"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.177:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.234:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.236:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'ovsdb://uuid' 1 time, not 0 times.
00:01:57.628 SUITE Southbound Cluster Extension
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Southbound Cluster Extension
Documentation:

Test suite for Ovsdb Southbound Cluster - Candidate failover and recover
Source: /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/test/csit/suites/ovsdb/Southbound_Cluster/020__Southbound_Cluster_Extension.robot
Start / End / Elapsed: 20250209 02:46:50.205 / 20250209 02:48:47.833 / 00:01:57.628
Status: 38 tests total, 5 passed, 33 failed, 0 skipped
00:04:12.406 SUITE Southbound Cluster
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster
Source: /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/test/csit/suites/ovsdb/Southbound_Cluster
Start / End / Elapsed: 20250209 02:48:47.835 / 20250209 02:53:00.241 / 00:04:12.406
Status: 82 tests total, 13 passed, 69 failed, 0 skipped