Test Statistics

Total Statistics
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
All Tests
16445119000:09:25
Statistics by Tag
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
No Tags
Statistics by Suite
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
16445119000:09:41
823250000:05:28
442717000:03:30
38533000:01:58
821369000:04:13
44836000:02:16
38533000:01:57

Test Execution Log

00:09:40.753 SUITE ovsdb-upstream-clustering.txt
00:05:28.062 SUITE Southbound Cluster
00:03:29.733 SUITE Ovsdb Southbound Cluster
00:00:05.253 SETUP Suite Setup  
00:00:00.000 TEARDOWN RequestsLibrary . Delete All Sessions  
00:00:05.756 TEST Check Shards Status Before Fail
00:00:05.258 TEST Start OVS Multiple Connections
00:00:00.759 TEST Check Entity Owner Status And Find Owner and Candidate Before Fail
00:00:01.260 TEST Create Bridge Manually and Verify Before Fail
00:00:01.160 TEST Add Port Manually and Verify Before Fail
00:00:01.802 TEST Create Tap Device Before Fail
00:00:01.092 TEST Add Tap Device Manually and Verify Before Fail
00:00:01.029 TEST Delete the Bridge Manually and Verify Before Fail
00:00:11.000 TEST Create Bridge In Owner and Verify Before Fail
00:00:00.397 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing  
00:00:10.594 KEYWORD ClusterOvsdb . Create Sample Bridge And Verify   ${original_owner}
00:00:00.000 KEYWORD ${body} = OperatingSystem . Get File   /w/workspace/ovsdb-csit-3node-upstream-clustering-only-scandium/test/csit/libraries/../variables/ovsdb/create_bridge_3node.json
00:00:00.000 KEYWORD ${body} = String . Replace String   ${body} ovsdb://127.0.0.1:61644 ovsdb://uuid/${ovsdb_uuid}
00:00:00.000 KEYWORD ${body} = String . Replace String   ${body} tcp:controller1:6633 tcp:${ODL_SYSTEM_1_IP}:6633
00:00:00.000 KEYWORD ${body} = String . Replace String   ${body} tcp:controller2:6633 tcp:${ODL_SYSTEM_2_IP}:6633
00:00:00.000 KEYWORD ${body} = String . Replace String   ${body} tcp:controller3:6633 tcp:${ODL_SYSTEM_3_IP}:6633
00:00:00.000 KEYWORD ${body} = String . Replace String   ${body} 127.0.0.1 ${TOOLS_SYSTEM_IP}
00:00:00.000 KEYWORD ${body} = String . Replace String   ${body} br01 ${BRIDGE}
00:00:00.000 KEYWORD ${body} = String . Replace String   ${body} 61644 ${OVSDB_PORT}
00:00:00.000 KEYWORD BuiltIn . Log   ${body}
00:00:00.000 KEYWORD ${TOOLS_SYSTEM_IP1} = String . Replace String   ${TOOLS_SYSTEM_IP} ${TOOLS_SYSTEM_IP} "${TOOLS_SYSTEM_IP}"
00:00:00.000 KEYWORD ${dictionary} = BuiltIn . Create Dictionary   ${TOOLS_SYSTEM_IP1}=1 ${OVSDBPORT}=4 ${BRIDGE}=1
00:00:00.236 KEYWORD BuiltIn . Wait Until Keyword Succeeds   5s 1s ClusterManagement.Put_As_Json_And_Check_Member_List_Or_All ${RFC8040_SOUTHBOUND_NODE_API}uuid%2F${ovsdb_uuid}%2Fbridge%2F${BRIDGE} ${body} ${controller_index} ${controller_index_list}
00:00:10.351 KEYWORD BuiltIn . Wait Until Keyword Succeeds   10s 2s ClusterManagement.Check_Item_Occurrence_Member_List_Or_All uri=${RFC8040_SOUTHBOUND_NODE_API}uuid%2F${ovsdb_uuid}?${RFC8040_OPERATIONAL_CONTENT} dictionary=${dictionary} member_index_list=${controller_index_list}
00:00:00.052 KEYWORD ClusterManagement . Check_Item_Occurrence_Member_List_Or_All   uri=${RFC8040_SOUTHBOUND_NODE_API}uuid%2F${ovsdb_uuid}?${RFC8040_OPERATIONAL_CONTENT} dictionary=${dictionary} member_index_list=${controller_index_list}
00:00:00.002 KEYWORD ${index_list} = ClusterManagement . List_Indices_Or_All   given_list=${member_index_list}
00:00:00.049 FOR ${index} IN @{index_list}  
00:00:00.048 ITERATION ${index} = 1  
00:00:00.042 KEYWORD ${data} = ClusterManagement . Get_From_Member   uri=${uri} member_index=${index}
00:00:00.002 KEYWORD Utils . Check Item Occurrence   ${data} ${dictionary}
00:00:00.002 FOR ${item} IN @{dictionary_item_occurrence}  
00:00:00.000 ITERATION ${item} = "10.30.171.142"  
00:00:00.000 ITERATION ${item} = 6640  
00:00:00.001 ITERATION ${item} = br01  
00:00:00.000 KEYWORD BuiltIn . Should Contain X Times   ${string} ${item} ${dictionary_item_occurrence}[${item}]
01:18:45.426 INFO Item found from container 0 times.
01:18:45.426 FAIL '{"network-topology:node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":40372,"local-ip":"10.30.170.78","remote-ip":"10.30.171.142"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.200:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.132:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.78:6640","number_of_connections":1,"connected":true}]}]}' contains 'br01' 0 times, not 1 time.
01:18:45.426 FAIL Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 10 seconds. The last error was: '{"network-topology:node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":40372,"local-ip":"10.30.170.78","remote-ip":"10.30.171.142"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.200:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.132:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.78:6640","number_of_connections":1,"connected":true}]}]}' contains 'br01' 0 times, not 1 time.
00:00:10.899 TEST Create Port In Owner and Verify Before Fail
00:00:00.390 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing  
00:00:10.501 KEYWORD ClusterOvsdb . Create Sample Port And Verify   ${original_owner}
00:00:00.000 KEYWORD ${sample} = OperatingSystem . Get File   ${OVSDB_CONFIG_DIR}/create_port_3node.json
00:00:00.000 KEYWORD ${body} = String . Replace String   ${sample} 192.168.1.10 ${TOOLS_SYSTEM_IP}
00:00:00.000 KEYWORD BuiltIn . Log   ${body}
00:00:00.000 KEYWORD BuiltIn . Log   URL is ${RFC8040_SOUTHBOUND_NODE_API}uuid%2F${ovsdb_uuid}%2Fbridge%2F${BRIDGE}/termination-point=vx2
00:00:00.000 KEYWORD ${port_dictionary} = BuiltIn . Create Dictionary   ${BRIDGE}=1 vx2=3
00:00:00.211 KEYWORD ClusterManagement . Put_As_Json_And_Check_Member_List_Or_All   ${RFC8040_SOUTHBOUND_NODE_API}uuid%2F${ovsdb_uuid}%2Fbridge%2F${BRIDGE}/termination-point=vx2 ${body} ${controller_index} ${controller_index_list}
00:00:10.272 KEYWORD BuiltIn . Wait Until Keyword Succeeds   10s 2s ClusterManagement.Check_Item_Occurrence_Member_List_Or_All uri=${RFC8040_SOUTHBOUND_NODE_API}uuid%2F${ovsdb_uuid}%2Fbridge%2F${BRIDGE}/termination-point=vx2?${RFC8040_OPERATIONAL_CONTENT} dictionary=${port_dictionary} member_index_list=${controller_index_list}
00:00:00.030 KEYWORD ClusterManagement . Check_Item_Occurrence_Member_List_Or_All   uri=${RFC8040_SOUTHBOUND_NODE_API}uuid%2F${ovsdb_uuid}%2Fbridge%2F${BRIDGE}/termination-point=vx2?${RFC8040_OPERATIONAL_CONTENT} dictionary=${port_dictionary} member_index_list=${controller_index_list}
00:00:00.002 KEYWORD ${index_list} = ClusterManagement . List_Indices_Or_All   given_list=${member_index_list}
00:00:00.027 FOR ${index} IN @{index_list}  
00:00:00.027 ITERATION ${index} = 1  
00:00:00.023 KEYWORD ${data} = ClusterManagement . Get_From_Member   uri=${uri} member_index=${index}
00:00:00.001 KEYWORD ${session} = ClusterManagement . Resolve_Http_Session_For_Member   member_index=${member_index}
00:00:00.021 KEYWORD ${response_text} = TemplatedRequests . Get_From_Uri   uri=${uri} accept=${access} session=${session}
00:00:00.000 KEYWORD BuiltIn . Log   ${uri}
00:00:00.000 KEYWORD BuiltIn . Log   ${accept}
00:00:00.014 IF """${http_timeout}""" == """${EMPTY}"""  
00:00:00.012 KEYWORD ${response} = RequestsLibrary . GET On Session   ${session} url=${uri} headers=${accept}
01:18:56.323 INFO GET Request : url=http://10.30.170.78:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01/termination-point=vx2?content=nonconfig path_url=/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01/termination-point=vx2?content=nonconfig headers={'User-Agent': 'python-requests/2.32.3', 'Accept-Encoding': 'gzip, deflate', 'Accept': '*/*', 'Connection': 'keep-alive', 'Cookie': 'JSESSIONID=node01dsxqpupnccdduxm4k3xf6v2c0.node0', 'Authorization': 'Basic YWRtaW46YWRtaW4='} body=None
01:18:56.324 INFO GET Response : url=http://10.30.170.78:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01/termination-point=vx2?content=nonconfig status=409, reason=Conflict headers={'Content-Type': 'application/yang-data+json', 'Content-Length': '242'} body={ "errors": { "error": [ { "error-tag": "data-missing", "error-message": "Request could not be completed because the relevant data model content does not exist", "error-type": "protocol" } ] } }
01:18:56.324 FAIL HTTPError: 409 Client Error: Conflict for url: http://10.30.170.78:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01/termination-point=vx2?content=nonconfig
00:00:00.000 ELSE  
00:00:00.000 KEYWORD TemplatedRequests . Check_Status_Code   ${response} log_response=${log_response}
00:00:00.000 IF not ${normalize_json}  
00:00:00.000 KEYWORD ${text_normalized} = norm_json . Normalize Json Text   ${response.text} jmes_path=${jmes_path} keys_with_volatiles=${keys_with_volatiles}
00:00:00.000 RETURN   ${text_normalized}
00:00:00.000 RETURN   ${response_text}
00:00:00.000 KEYWORD Utils . Check Item Occurrence   ${data} ${dictionary}
01:18:56.326 FAIL Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 10 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.170.78:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01/termination-point=vx2?content=nonconfig
00:00:00.650 TEST Modify the destination IP of Port In Owner Before Fail
00:00:05.617 TEST Verify Port Is Modified Before Fail
00:00:00.344 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing  
00:00:05.269 KEYWORD ClusterOvsdb . Verify Sample Port Is Modified  
00:00:00.000 KEYWORD ${port_dictionary} = BuiltIn . Create Dictionary   br01=6 vx2=3 10.0.0.19=1
00:00:05.266 KEYWORD BuiltIn . Wait Until Keyword Succeeds   5s 1s ClusterManagement.Check_Item_Occurrence_Member_List_Or_All uri=${RFC8040_SOUTHBOUND_NODE_API}uuid%2F${ovsdb_uuid}%2Fbridge%2F${BRIDGE}?${RFC8040_OPERATIONAL_CONTENT} dictionary=${port_dictionary} member_index_list=${controller_index_list}
00:00:00.030 KEYWORD ClusterManagement . Check_Item_Occurrence_Member_List_Or_All   uri=${RFC8040_SOUTHBOUND_NODE_API}uuid%2F${ovsdb_uuid}%2Fbridge%2F${BRIDGE}?${RFC8040_OPERATIONAL_CONTENT} dictionary=${port_dictionary} member_index_list=${controller_index_list}
00:00:00.002 KEYWORD ${index_list} = ClusterManagement . List_Indices_Or_All   given_list=${member_index_list}
00:00:00.027 FOR ${index} IN @{index_list}  
00:00:00.027 ITERATION ${index} = 1  
00:00:00.022 KEYWORD ${data} = ClusterManagement . Get_From_Member   uri=${uri} member_index=${index}
00:00:00.001 KEYWORD ${session} = ClusterManagement . Resolve_Http_Session_For_Member   member_index=${member_index}
00:00:00.021 KEYWORD ${response_text} = TemplatedRequests . Get_From_Uri   uri=${uri} accept=${access} session=${session}
00:00:00.000 KEYWORD BuiltIn . Log   ${uri}
00:00:00.000 KEYWORD BuiltIn . Log   ${accept}
00:00:00.013 IF """${http_timeout}""" == """${EMPTY}"""  
00:00:00.011 KEYWORD ${response} = RequestsLibrary . GET On Session   ${session} url=${uri} headers=${accept}
01:19:02.590 INFO GET Request : url=http://10.30.170.78:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig path_url=/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig headers={'User-Agent': 'python-requests/2.32.3', 'Accept-Encoding': 'gzip, deflate', 'Accept': '*/*', 'Connection': 'keep-alive', 'Cookie': 'JSESSIONID=node01dsxqpupnccdduxm4k3xf6v2c0.node0', 'Authorization': 'Basic YWRtaW46YWRtaW4='} body=None
01:19:02.590 INFO GET Response : url=http://10.30.170.78:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig status=409, reason=Conflict headers={'Content-Type': 'application/yang-data+json', 'Content-Length': '242'} body={ "errors": { "error": [ { "error-tag": "data-missing", "error-message": "Request could not be completed because the relevant data model content does not exist", "error-type": "protocol" } ] } }
01:19:02.590 FAIL HTTPError: 409 Client Error: Conflict for url: http://10.30.170.78:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig
00:00:00.000 ELSE  
00:00:00.000 KEYWORD TemplatedRequests . Check_Status_Code   ${response} log_response=${log_response}
00:00:00.000 IF not ${normalize_json}  
00:00:00.000 KEYWORD ${text_normalized} = norm_json . Normalize Json Text   ${response.text} jmes_path=${jmes_path} keys_with_volatiles=${keys_with_volatiles}
00:00:00.000 RETURN   ${text_normalized}
00:00:00.000 RETURN   ${response_text}
00:00:00.000 KEYWORD Utils . Check Item Occurrence   ${data} ${dictionary}
01:19:02.594 FAIL Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.170.78:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig
00:00:00.675 TEST Delete Port In Owner Before Fail
00:00:00.633 TEST Delete Bridge In Owner And Verify Before Fail
00:00:03.792 TEST Kill Owner Instance
00:00:11.835 TEST Check Shards Status After Fail
00:00:04.607 TEST Check Entity Owner Status And Find Owner and Candidate After Fail
00:00:06.495 TEST Create Bridge Manually and Verify After Fail
00:00:00.273 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing  
00:00:06.217 KEYWORD ClusterOvsdb . Create Sample Bridge Manually And Verify   controller_index_list=${new_cluster_list}
00:00:00.763 KEYWORD Utils . Run Command On Mininet   ${ovs_system_ip} sudo ovs-vsctl add-br br-s1
00:00:00.000 KEYWORD ${dictionary_operational} = BuiltIn . Create Dictionary   br-s1=5
00:00:00.000 KEYWORD ${dictionary_config} = BuiltIn . Create Dictionary   br-s1=0
00:00:00.097 KEYWORD BuiltIn . Wait Until Keyword Succeeds   5s 1s ClusterManagement.Check_Item_Occurrence_Member_List_Or_All uri=${RFC8040_CONFIG_TOPO_API} dictionary=${dictionary_config} member_index_list=${controller_index_list}
00:00:05.356 KEYWORD BuiltIn . Wait Until Keyword Succeeds   5s 1s ClusterManagement.Check_Item_Occurrence_Member_List_Or_All uri=${RFC8040_OPERATIONAL_TOPO_API} dictionary=${dictionary_operational} member_index_list=${controller_index_list}
00:00:00.049 KEYWORD ClusterManagement . Check_Item_Occurrence_Member_List_Or_All   uri=${RFC8040_OPERATIONAL_TOPO_API} dictionary=${dictionary_operational} member_index_list=${controller_index_list}
00:00:00.002 KEYWORD ${index_list} = ClusterManagement . List_Indices_Or_All   given_list=${member_index_list}
00:00:00.045 FOR ${index} IN @{index_list}  
00:00:00.045 ITERATION ${index} = 2  
00:00:00.038 KEYWORD ${data} = ClusterManagement . Get_From_Member   uri=${uri} member_index=${index}
00:00:00.001 KEYWORD Utils . Check Item Occurrence   ${data} ${dictionary}
00:00:00.001 FOR ${item} IN @{dictionary_item_occurrence}  
00:00:00.001 ITERATION ${item} = br-s1  
00:00:00.000 KEYWORD BuiltIn . Should Contain X Times   ${string} ${item} ${dictionary_item_occurrence}[${item}]
01:19:30.632 INFO Item found from container 0 times.
01:19:30.632 FAIL '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":40372,"local-ip":"10.30.170.78","remote-ip":"10.30.171.142"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.200:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.132:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.78:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'br-s1' 0 times, not 5 times.
01:19:30.633 FAIL Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":40372,"local-ip":"10.30.170.78","remote-ip":"10.30.171.142"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.200:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.132:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.78:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'br-s1' 0 times, not 5 times.
00:00:06.105 TEST Add Port Manually and Verify After Fail
00:00:00.289 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing  
00:00:05.811 KEYWORD ClusterOvsdb . Add Sample Port To The Manual Bridge And Verify   controller_index_list=${new_cluster_list}
00:00:00.361 KEYWORD Utils . Run Command On Mininet   ${ovs_system_ip} sudo ovs-vsctl add-port br-s1 vx1 -- set Interface vx1 type=vxlan
00:00:00.000 KEYWORD ${dictionary_operational} = BuiltIn . Create Dictionary   vx1=2
00:00:00.000 KEYWORD ${dictionary_config} = BuiltIn . Create Dictionary   vx1=0
00:00:00.109 KEYWORD BuiltIn . Wait Until Keyword Succeeds   5s 1s ClusterManagement.Check_Item_Occurrence_Member_List_Or_All uri=${RFC8040_CONFIG_TOPO_API} dictionary=${dictionary_config} member_index_list=${controller_index_list}
00:00:05.340 KEYWORD BuiltIn . Wait Until Keyword Succeeds   5s 1s ClusterManagement.Check_Item_Occurrence_Member_List_Or_All uri=${RFC8040_OPERATIONAL_TOPO_API} dictionary=${dictionary_operational} member_index_list=${controller_index_list}
00:00:00.044 KEYWORD ClusterManagement . Check_Item_Occurrence_Member_List_Or_All   uri=${RFC8040_OPERATIONAL_TOPO_API} dictionary=${dictionary_operational} member_index_list=${controller_index_list}
00:00:00.001 KEYWORD ${index_list} = ClusterManagement . List_Indices_Or_All   given_list=${member_index_list}
00:00:00.042 FOR ${index} IN @{index_list}  
00:00:00.041 ITERATION ${index} = 2  
00:00:00.036 KEYWORD ${data} = ClusterManagement . Get_From_Member   uri=${uri} member_index=${index}
00:00:00.001 KEYWORD Utils . Check Item Occurrence   ${data} ${dictionary}
00:00:00.001 FOR ${item} IN @{dictionary_item_occurrence}  
00:00:00.001 ITERATION ${item} = vx1  
01:19:36.738 FAIL Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":40372,"local-ip":"10.30.170.78","remote-ip":"10.30.171.142"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.200:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.132:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.78:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'vx1' 0 times, not 2 times.
00:00:01.643 TEST Create Tap Device After Fail
00:00:06.097 TEST Add Tap Device Manually and Verify After Fail
00:00:00.768 TEST Delete the Bridge Manually and Verify After Fail
00:00:10.784 TEST Create Bridge In Owner and Verify After Fail
00:00:10.708 TEST Create Port In Owner and Verify After Fail
00:00:00.491 TEST Modify the destination IP of Port In Owner After Fail
00:00:05.512 TEST Verify Port Is Modified After Fail
00:00:14.172 TEST Start Old Owner Instance
00:00:03.368 TEST Check Shards Status After Recover
00:00:00.697 TEST Check Entity Owner Status After Recover
00:00:07.431 TEST Create Bridge Manually and Verify After Recover
00:00:06.210 TEST Add Port Manually and Verify After Recover
00:00:01.820 TEST Create Tap Device After Recover
00:00:06.325 TEST Add Tap Device Manually and Verify After Recover
00:00:00.961 TEST Delete the Bridge Manually and Verify After Recover
00:00:05.637 TEST Verify Modified Port After Recover
00:00:00.713 TEST Delete Port In New Owner After Recover
00:00:00.659 TEST Delete Bridge In New Owner And Verify After Recover
00:00:11.034 TEST Create Bridge In Old Owner and Verify After Recover
00:00:10.925 TEST Create Port In Old Owner and Verify After Recover
00:00:00.695 TEST Modify the destination IP of Port In Old Owner After Recover
00:00:05.631 TEST Verify Port Is Modified After Recover
00:00:00.676 TEST Delete Port In Old Owner After Recover
00:00:00.685 TEST Delete Bridge In Old Owner And Verify After Recover
00:00:09.827 TEST Cleans Up Test Environment For Next Suite
00:01:58.326 SUITE Southbound Cluster Extension
00:04:12.665 SUITE Southbound Cluster