Test Statistics

Total Statistics
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
All Tests
18117000:12:24
Statistics by Tag
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
critical
918000:12:24
Statistics by Suite
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
controller-rest-clust-cars-perf-tell.txt
18117000:12:42
controller-rest-clust-cars-perf-tell . txt . Restart Odl With Tell Based True
312000:12:30
controller-rest-clust-cars-perf-tell . txt . 010 Crud Mdsal Perf
909000:00:07
controller-rest-clust-cars-perf-tell . txt . Puts During Isolation
606000:00:06

Test Execution Log

00:12:42.473 SUITE controller-rest-clust-cars-perf-tell.txt
Full Name: controller-rest-clust-cars-perf-tell.txt
Start / End / Elapsed: 20250309 23:38:15.183 / 20250309 23:50:57.656 / 00:12:42.473
Status: 18 tests total, 1 passed, 17 failed, 0 skipped
00:12:29.567 SUITE Restart Odl With Tell Based True
Full Name: controller-rest-clust-cars-perf-tell.txt.Restart Odl With Tell Based True
Documentation:

Set tell-based protocol usage

Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

Suite stops all odl nodes, un-comment usage of tell-based protocol in config file (means make it true) and starts all nodes again.
Source: /w/workspace/controller-csit-3node-rest-clust-cars-perf-tell-only-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
Start / End / Elapsed: 20250309 23:38:15.207 / 20250309 23:50:44.774 / 00:12:29.567
Status: 3 tests total, 1 passed, 2 failed, 0 skipped
00:00:05.148 SETUP SetupUtils . Setup_Utils_For_Setup_And_Teardown   http_timeout=125
Documentation:

Prepare both FailFast and Karaf logging, log that the caller suite has started. This keyword is to be used in suite setup, and without it the other keywords may not work properly.
Start / End / Elapsed: 20250309 23:38:15.751 / 20250309 23:38:20.899 / 00:00:05.148
00:00:00.000 TEARDOWN SSHLibrary . Close All Connections  
Documentation:

Closes all open connections.
Start / End / Elapsed: 20250309 23:50:44.773 / 20250309 23:50:44.773 / 00:00:00.000
00:06:08.509 TEST Stop_All_Members
Full Name: controller-rest-clust-cars-perf-tell.txt.Restart Odl With Tell Based True.Stop_All_Members
Documentation:

Stop every odl node.
Tags: critical
Start / End / Elapsed: 20250309 23:38:20.899 / 20250309 23:44:29.408 / 00:06:08.509
Status: FAIL
Message: Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
00:06:08.508 KEYWORD ClusterManagement . Stop_Members_From_List_Or_All  
Documentation:

If the list is empty, stops all ODL instances. Otherwise stop members based on ${stop_index_list} If ${confirm} is True, verify stopped instances are not there anymore. The KW will return a list of available members: ${updated index_list}=${original_index_list}-${member_index_list}
Start / End / Elapsed: 20250309 23:38:20.899 / 20250309 23:44:29.407 / 00:06:08.508
00:00:00.001 KEYWORD ${stop_index_list} = ClusterManagement . List_Indices_Or_All   given_list=${member_index_list}
Documentation:

Utility to allow ${EMPTY} as default argument value, as the internal list is computed at runtime. This keyword always returns a (shallow) copy of given or default list, so operations with the returned list should not affect other lists. Also note that this keyword does not consider empty list to be ${EMPTY}.
Start / End / Elapsed: 20250309 23:38:20.904 / 20250309 23:38:20.905 / 00:00:00.001
00:00:00.001 KEYWORD ${index_list} = ClusterManagement . List_Indices_Or_All   given_list=${original_index_list}
Documentation:

Utility to allow ${EMPTY} as default argument value, as the internal list is computed at runtime. This keyword always returns a (shallow) copy of given or default list, so operations with the returned list should not affect other lists. Also note that this keyword does not consider empty list to be ${EMPTY}.
Start / End / Elapsed: 20250309 23:38:20.905 / 20250309 23:38:20.906 / 00:00:00.001
00:00:03.173 KEYWORD ClusterManagement . Run_Bash_Command_On_List_Or_All   command=${NODE_STOP_COMMAND} member_index_list=${member_index_list}
Documentation:

Cycle through indices (or all), run command on each.
Start / End / Elapsed: 20250309 23:38:20.906 / 20250309 23:38:24.079 / 00:00:03.173
00:00:00.000 KEYWORD ${updated_index_list} = BuiltIn . Create List   @{index_list}
Documentation:

Returns a list containing given items.
Start / End / Elapsed: 20250309 23:38:24.079 / 20250309 23:38:24.079 / 00:00:00.000
00:00:00.000 KEYWORD Collections . Remove Values From List   ${updated_index_list} @{stop_index_list}
Documentation:

Removes all occurrences of given values from list.
Start / End / Elapsed: 20250309 23:38:24.080 / 20250309 23:38:24.080 / 00:00:00.000
00:00:00.000 IF not ${confirm}  
Start / End / Elapsed: 20250309 23:38:24.080 / 20250309 23:38:24.080 / 00:00:00.000
00:06:05.327 FOR ${index} IN @{stop_index_list}  
Start / End / Elapsed: 20250309 23:38:24.080 / 20250309 23:44:29.407 / 00:06:05.327
00:00:03.067 ITERATION ${index} = 1  
Start / End / Elapsed: 20250309 23:38:24.080 / 20250309 23:38:27.147 / 00:00:03.067
00:06:02.259 ITERATION ${index} = 2  
Start / End / Elapsed: 20250309 23:38:27.148 / 20250309 23:44:29.407 / 00:06:02.259
00:06:02.259 KEYWORD BuiltIn . Wait Until Keyword Succeeds   ${timeout} 2s Verify_Karaf_Is_Not_Running_On_Member member_index=${index}
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20250309 23:38:27.148 / 20250309 23:44:29.407 / 00:06:02.259
Message: 146 failing items removed using the --remove-keywords option.
00:00:00.441 KEYWORD ClusterManagement . Verify_Karaf_Is_Not_Running_On_Member   member_index=${index}
Documentation:

Fail if non-zero karaf instances are counted on member of given index.
Start / End / Elapsed: 20250309 23:44:28.966 / 20250309 23:44:29.407 / 00:00:00.441
00:00:00.440 KEYWORD ${count} = ClusterManagement . Count_Running_Karafs_On_Member   member_index=${member_index}
Documentation:

Remotely execute grep for karaf process, return count as string.
Start / End / Elapsed: 20250309 23:44:28.966 / 20250309 23:44:29.406 / 00:00:00.440
00:00:00.000 KEYWORD BuiltIn . Should Be Equal   0 ${count} Found running Karaf count: ${count}
Documentation:

Fails if the given objects are unequal.
Start / End / Elapsed: 20250309 23:44:29.406 / 20250309 23:44:29.406 / 00:00:00.000
23:44:29.407 FAIL Found running Karaf count: 1: 0 != 1
23:44:29.407 FAIL Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
00:00:00.000 KEYWORD ClusterManagement . Run_Bash_Command_On_List_Or_All   command=netstat -pnatu | grep 2550
Documentation:

Cycle through indices (or all), run command on each.
Start / End / Elapsed: 20250309 23:44:29.407 / 20250309 23:44:29.407 / 00:00:00.000
00:00:00.000 RETURN   ${updated_index_list}
Start / End / Elapsed: 20250309 23:44:29.408 / 20250309 23:44:29.408 / 00:00:00.000
00:00:10.546 TEST Set_Tell_Based_Protocol_Usage
Full Name: controller-rest-clust-cars-perf-tell.txt.Restart Odl With Tell Based True.Set_Tell_Based_Protocol_Usage
Documentation:

Un-comment the flag usage in config file. Also clean most data except data/log/.
Tags: critical
Start / End / Elapsed: 20250309 23:44:29.408 / 20250309 23:44:39.954 / 00:00:10.546
Status: PASS
00:06:04.818 TEST Start_All_And_Sync
Full Name: controller-rest-clust-cars-perf-tell.txt.Restart Odl With Tell Based True.Start_All_And_Sync
Documentation:

Start each member and wait for sync.
Tags: critical
Start / End / Elapsed: 20250309 23:44:39.954 / 20250309 23:50:44.772 / 00:06:04.818
Status: FAIL
Message: Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.210:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore
00:06:04.813 KEYWORD ClusterManagement . Start_Members_From_List_Or_All  
Documentation:

If the list is empty, start all cluster members. Otherwise, start members based on present indices. If ${wait_for_sync}, wait for cluster sync on listed members. Optionally karaf_home can be overriden. Optionally specific JAVA_HOME is used for starting. Garbage collection is unconditionally logged to files. TODO: Make that reasonable conditional?
Start / End / Elapsed: 20250309 23:44:39.959 / 20250309 23:50:44.772 / 00:06:04.813
00:00:00.000 KEYWORD ${base_command} = BuiltIn . Set Variable If   """${karaf_home}""" != "" ${karaf_home}/bin/start ${NODE_START_COMMAND}
Documentation:

Sets variable based on the given condition.
Start / End / Elapsed: 20250309 23:44:39.966 / 20250309 23:44:39.966 / 00:00:00.000
00:00:00.000 KEYWORD ${command} = BuiltIn . Set Variable If   """${export_java_home}""" != "" export JAVA_HOME="${export_java_home}"; ${base_command} ${base_command}
Documentation:

Sets variable based on the given condition.
Start / End / Elapsed: 20250309 23:44:39.967 / 20250309 23:44:39.967 / 00:00:00.000
00:00:00.000 KEYWORD ${epoch} = DateTime . Get Current Date   time_zone=UTC result_format=epoch exclude_millis=False
Documentation:

Returns current local or UTC time with an optional increment.
Start / End / Elapsed: 20250309 23:44:39.967 / 20250309 23:44:39.967 / 00:00:00.000
00:00:00.000 KEYWORD ${gc_filepath} = BuiltIn . Set Variable If   """${karaf_home}""" != "" ${karaf_home}/data/log/gc_${epoch}.log ${GC_LOG_PATH}/gc_${epoch}.log
Documentation:

Sets variable based on the given condition.
Start / End / Elapsed: 20250309 23:44:39.967 / 20250309 23:44:39.967 / 00:00:00.000
00:00:00.000 KEYWORD ${gc_options} = BuiltIn . Set Variable If   "docker" not in """${node_start_command}""" -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:${gc_filepath} ${EMPTY}
Documentation:

Sets variable based on the given condition.
Start / End / Elapsed: 20250309 23:44:39.968 / 20250309 23:44:39.968 / 00:00:00.000
00:00:01.397 KEYWORD ClusterManagement . Run_Bash_Command_On_List_Or_All   command=${command} ${gc_options} member_index_list=${member_index_list}
Documentation:

Cycle through indices (or all), run command on each.
Start / End / Elapsed: 20250309 23:44:39.968 / 20250309 23:44:41.365 / 00:00:01.397
00:06:01.333 KEYWORD BuiltIn . Wait Until Keyword Succeeds   ${timeout} 10s Verify_Members_Are_Ready ${member_index_list} ${wait_for_sync} ${verify_restconf} ${check_system_status} ${service_list}
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20250309 23:44:41.365 / 20250309 23:50:42.698 / 00:06:01.333
Message: 11 failing items removed using the --remove-keywords option.
00:00:00.032 KEYWORD ClusterManagement . Verify_Members_Are_Ready   ${member_index_list} ${wait_for_sync} ${verify_restconf} ${check_system_status} ${service_list}
Documentation:

Verifies the specified readiness conditions for the given listed members after startup. If ${verify_cluster_sync}, verifies the datastores have synced with the rest of the cluster. If True, verifies RESTCONF is available. If ${verify_system_status}, verifies the system services are OPERATIONAL.
Start / End / Elapsed: 20250309 23:50:42.666 / 20250309 23:50:42.698 / 00:00:00.032
00:00:00.030 IF ${verify_cluster_sync}  
Start / End / Elapsed: 20250309 23:50:42.666 / 20250309 23:50:42.696 / 00:00:00.030
00:00:00.029 KEYWORD ClusterManagement . Check_Cluster_Is_In_Sync   ${member_index_list}
Documentation:

Fail if no-sync is detected on a member from list (or any).
Start / End / Elapsed: 20250309 23:50:42.667 / 20250309 23:50:42.696 / 00:00:00.029
00:00:00.002 KEYWORD ${index_list} = ClusterManagement . List_Indices_Or_All   given_list=${member_index_list}
Documentation:

Utility to allow ${EMPTY} as default argument value, as the internal list is computed at runtime. This keyword always returns a (shallow) copy of given or default list, so operations with the returned list should not affect other lists. Also note that this keyword does not consider empty list to be ${EMPTY}.
Start / End / Elapsed: 20250309 23:50:42.667 / 20250309 23:50:42.669 / 00:00:00.002
00:00:00.027 FOR ${index} IN @{index_list}  
Start / End / Elapsed: 20250309 23:50:42.669 / 20250309 23:50:42.696 / 00:00:00.027
00:00:00.026 ITERATION ${index} = 1  
Start / End / Elapsed: 20250309 23:50:42.669 / 20250309 23:50:42.695 / 00:00:00.026
00:00:00.026 KEYWORD ${status} = ClusterManagement . Get_Sync_Status_Of_Member   member_index=${index}
Documentation:

Obtain IP, two GETs from jolokia URIs, return combined sync status as string.
Start / End / Elapsed: 20250309 23:50:42.670 / 20250309 23:50:42.696 / 00:00:00.026
00:00:00.001 KEYWORD ${session} = ClusterManagement . Resolve_Http_Session_For_Member   member_index=${member_index}
Documentation:

Return RequestsLibrary session alias pointing to node of given index.
Start / End / Elapsed: 20250309 23:50:42.670 / 20250309 23:50:42.671 / 00:00:00.001
00:00:00.023 KEYWORD ${conf_text} = TemplatedRequests . Get_As_Json_From_Uri   uri=${JOLOKIA_CONF_SHARD_MANAGER_URI} session=${session}
Documentation:

Specify JSON headers and return Get_From_Uri normalized response text.
Start / End / Elapsed: 20250309 23:50:42.671 / 20250309 23:50:42.694 / 00:00:00.023
00:00:00.020 KEYWORD ${response_text} = TemplatedRequests . Get_From_Uri   uri=${uri} accept=${ACCEPT_EMPTY} session=${session} normalize_json=True http_timeout=${http_timeout} log_response=${log_response}
Documentation:

GET data from given URI, check status code and return response text. ${accept} is a Python object with headers to use. If ${normalize_json}, normalize as JSON text before returning.
Start / End / Elapsed: 20250309 23:50:42.673 / 20250309 23:50:42.693 / 00:00:00.020
00:00:00.000 KEYWORD BuiltIn . Log   ${uri}
Documentation:

Logs the given message with the given level.
Start / End / Elapsed: 20250309 23:50:42.678 / 20250309 23:50:42.678 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Log   ${accept}
Documentation:

Logs the given message with the given level.
Start / End / Elapsed: 20250309 23:50:42.678 / 20250309 23:50:42.678 / 00:00:00.000
00:00:00.013 IF """${http_timeout}""" == """${EMPTY}"""  
Start / End / Elapsed: 20250309 23:50:42.678 / 20250309 23:50:42.691 / 00:00:00.013
00:00:00.011 KEYWORD ${response} = RequestsLibrary . GET On Session   ${session} url=${uri} headers=${accept}
Documentation:

Sends a GET request on a previously created HTTP Session.
Start / End / Elapsed: 20250309 23:50:42.680 / 20250309 23:50:42.691 / 00:00:00.011
23:50:42.691 INFO GET Request : url=http://10.30.171.210:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore path_url=/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore headers={'User-Agent': 'python-requests/2.32.3', 'Accept-Encoding': 'gzip, deflate', 'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic YWRtaW46YWRtaW4='} body=None
23:50:42.691 INFO GET Response : url=http://10.30.171.210:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore status=401, reason=Unauthorized headers={'Cache-Control': 'must-revalidate,no-cache,no-store', 'Content-Type': 'text/html;charset=iso-8859-1', 'Content-Length': '524'} body=<html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 401 Unauthorized</title> </head> <body><h2>HTTP ERROR 401 Unauthorized</h2> <table> <tr><th>URI:</th><td>/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore</td></tr> <tr><th>STATUS:</th><td>401</td></tr> <tr><th>MESSAGE:</th><td>Unauthorized</td></tr> <tr><th>SERVLET:</th><td>org.jolokia.osgi.servlet.JolokiaServlet</td></tr> </table> </body> </html>
23:50:42.691 FAIL HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.210:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore
00:00:00.000 ELSE  
Start / End / Elapsed: 20250309 23:50:42.692 / 20250309 23:50:42.692 / 00:00:00.000
00:00:00.000 KEYWORD TemplatedRequests . Check_Status_Code   ${response} log_response=${log_response}
Documentation:

Log response text, check status_code is one of allowed ones. In cases where this keyword is called in a WUKS it could end up logging tons of data and it may be desired to skip the logging by passing log_response=False, but by default it remains True.
Start / End / Elapsed: 20250309 23:50:42.693 / 20250309 23:50:42.693 / 00:00:00.000
00:00:00.000 IF not ${normalize_json}  
Start / End / Elapsed: 20250309 23:50:42.693 / 20250309 23:50:42.693 / 00:00:00.000
00:00:00.000 KEYWORD ${text_normalized} = norm_json . Normalize Json Text   ${response.text} jmes_path=${jmes_path} keys_with_volatiles=${keys_with_volatiles}
Documentation:

Attempt to return sorted indented JSON string.
Start / End / Elapsed: 20250309 23:50:42.693 / 20250309 23:50:42.693 / 00:00:00.000
00:00:00.000 RETURN   ${text_normalized}
Start / End / Elapsed: 20250309 23:50:42.693 / 20250309 23:50:42.693 / 00:00:00.000
00:00:00.000 RETURN   ${response_text}
Start / End / Elapsed: 20250309 23:50:42.694 / 20250309 23:50:42.694 / 00:00:00.000
00:00:00.000 KEYWORD ${conf_status} = ClusterManagement . ClusterManagement__Parse_Sync_Status   shard_manager_text=${conf_text}
Documentation:

Return sync status parsed out of given text. Called twice by Get_Sync_Status_Of_Member.
Start / End / Elapsed: 20250309 23:50:42.694 / 20250309 23:50:42.694 / 00:00:00.000
00:00:00.000 IF 'False' == ${conf_status}  
Start / End / Elapsed: 20250309 23:50:42.694 / 20250309 23:50:42.694 / 00:00:00.000
00:00:00.000 KEYWORD ${oper_text} = TemplatedRequests . Get_As_Json_From_Uri   uri=${JOLOKIA_OPER_SHARD_MANAGER_URI} session=${session}
Documentation:

Specify JSON headers and return Get_From_Uri normalized response text.
Start / End / Elapsed: 20250309 23:50:42.695 / 20250309 23:50:42.695 / 00:00:00.000
00:00:00.000 KEYWORD ${oper_status} = ClusterManagement . ClusterManagement__Parse_Sync_Status   shard_manager_text=${oper_text}
Documentation:

Return sync status parsed out of given text. Called twice by Get_Sync_Status_Of_Member.
Start / End / Elapsed: 20250309 23:50:42.695 / 20250309 23:50:42.695 / 00:00:00.000
00:00:00.000 RETURN   ${oper_status}
Start / End / Elapsed: 20250309 23:50:42.695 / 20250309 23:50:42.695 / 00:00:00.000
00:00:00.000 IF 'True' == '${status}'  
Start / End / Elapsed: 20250309 23:50:42.695 / 20250309 23:50:42.695 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Fail   Index ${index} has incorrect status: ${status}
Documentation:

Fails the test with the given message and optionally alters its tags.
Start / End / Elapsed: 20250309 23:50:42.696 / 20250309 23:50:42.696 / 00:00:00.000
00:00:00.000 IF ${verify_restconf}  
Start / End / Elapsed: 20250309 23:50:42.696 / 20250309 23:50:42.696 / 00:00:00.000
00:00:00.000 IF ${verify_system_status} and ("${service_list}" != "[[]]")  
Start / End / Elapsed: 20250309 23:50:42.697 / 20250309 23:50:42.697 / 00:00:00.000
23:50:42.698 FAIL Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.210:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore
00:00:02.072 TEARDOWN ClusterManagement . Run_Bash_Command_On_List_Or_All   command=netstat -pnatu | grep 2550
Documentation:

Cycle through indices (or all), run command on each.
Start / End / Elapsed: 20250309 23:50:42.699 / 20250309 23:50:44.771 / 00:00:02.072
00:00:00.000 KEYWORD BuiltIn . Wait Until Keyword Succeeds   300s 10s ShardStability.Shards_Stability_Get_Details ${DEFAULT_SHARD_LIST} verify_restconf=True
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20250309 23:50:44.772 / 20250309 23:50:44.772 / 00:00:00.000
00:00:00.000 KEYWORD ClusterManagement . Run_Bash_Command_On_List_Or_All   ps -ef | grep java
Documentation:

Cycle through indices (or all), run command on each.
Start / End / Elapsed: 20250309 23:50:44.772 / 20250309 23:50:44.772 / 00:00:00.000
00:00:06.996 SUITE 010 Crud Mdsal Perf
Full Name: controller-rest-clust-cars-perf-tell.txt.010 Crud Mdsal Perf
Documentation:

Test for measuring execution time of MD-SAL DataStore operations in cluster.

Copyright (c) 2015 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

This test suite requires odl-restconf and odl-clustering-test-app modules. The script cluster_rest_script.py is used for generating requests for operations on people, car and car-people DataStore test models. (see the https://wiki.opendaylight.org/view/MD-SAL_Clustering_Test_Plan)

Reported bugs: https://bugs.opendaylight.org/show_bug.cgi?id=4220
Source: /w/workspace/controller-csit-3node-rest-clust-cars-perf-tell-only-scandium/test/csit/suites/controller/ThreeNodes_Datastore/010_crud_mdsal_perf.robot
Start / End / Elapsed: 20250309 23:50:44.774 / 20250309 23:50:51.770 / 00:00:06.996
Status: 9 tests total, 0 passed, 9 failed, 0 skipped
Message: Suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.210:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
00:00:06.913 SETUP Start Suite  
Documentation:

Suite setup keyword
Start / End / Elapsed: 20250309 23:50:44.851 / 20250309 23:50:51.764 / 00:00:06.913
00:00:06.714 KEYWORD SetupUtils . Setup_Utils_For_Setup_And_Teardown  
Documentation:

Prepare both FailFast and Karaf logging, log that the caller suite has started. This keyword is to be used in suite setup, and without it the other keywords may not work properly.
Start / End / Elapsed: 20250309 23:50:44.852 / 20250309 23:50:51.566 / 00:00:06.714
00:00:00.002 KEYWORD ClusterManagement . ClusterManagement_Setup  
Documentation:

Detect repeated call, or detect number of members and initialize derived suite variables. Http sessions are created with parameters to not waste time when ODL is no accepting connections properly.
Start / End / Elapsed: 20250309 23:50:51.566 / 20250309 23:50:51.568 / 00:00:00.002
00:00:00.195 KEYWORD CarPeople . Set_Variables_For_Shard   shard_name=car
Documentation:

Get leader and followers for given shard name and set several suite variables related to member indices and sessions. ClusterManagement Resource is assumed to be initialized. TODO: car-people shard name causes dash in variable names. Should we convert to underscores?
Start / End / Elapsed: 20250309 23:50:51.568 / 20250309 23:50:51.763 / 00:00:00.195
00:00:00.192 KEYWORD ${leader} ${follower_list} = ClusterManagement . Get_Leader_And_Followers_For_Shard   shard_name=${shard_name} shard_type=${shard_type}
Documentation:

Get role lists, validate there is one leader, return the leader and list of followers. Optionally, issue GET to a simple restconf URL to make sure subsequent operations will not encounter 503.
Start / End / Elapsed: 20250309 23:50:51.568 / 20250309 23:50:51.760 / 00:00:00.192
00:00:00.188 KEYWORD ${leader_list} ${follower_list} = ClusterManagement . Get_State_Info_For_Shard   shard_name=${shard_name} shard_type=${shard_type} validate=True member_index_list=${member_index_list} verify_restconf=${verify_restconf} http_timeout=${http_timeout}
Documentation:

Return lists of Leader and Follower member indices from a given member index list (or from the full list if empty). If ${shard_type} is not 'config', 'operational' is assumed. If ${validate}, Fail if raft state is not Leader or Follower (for example on Candidate). The biggest difference from Get_Leader_And_Followers_For_Shard is that no check on number of Leaders is performed.
Start / End / Elapsed: 20250309 23:50:51.572 / 20250309 23:50:51.760 / 00:00:00.188
00:00:00.001 KEYWORD ${index_list} = ClusterManagement . List_Indices_Or_All   given_list=${member_index_list}
Documentation:

Utility to allow ${EMPTY} as default argument value, as the internal list is computed at runtime. This keyword always returns a (shallow) copy of given or default list, so operations with the returned list should not affect other lists. Also note that this keyword does not consider empty list to be ${EMPTY}.
Start / End / Elapsed: 20250309 23:50:51.572 / 20250309 23:50:51.573 / 00:00:00.001
00:00:00.000 KEYWORD Collections . Sort List   ${index_list}
Documentation:

Sorts the given list in place.
Start / End / Elapsed: 20250309 23:50:51.573 / 20250309 23:50:51.573 / 00:00:00.000
00:00:00.000 KEYWORD ${ds_type} = BuiltIn . Set Variable If   '${shard_type}' != 'config' operational config
Documentation:

Sets variable based on the given condition.
Start / End / Elapsed: 20250309 23:50:51.574 / 20250309 23:50:51.574 / 00:00:00.000
00:00:00.000 KEYWORD ${leader_list} = BuiltIn . Create List  
Documentation:

Returns a list containing given items.
Start / End / Elapsed: 20250309 23:50:51.574 / 20250309 23:50:51.574 / 00:00:00.000
00:00:00.000 KEYWORD ${follower_list} = BuiltIn . Create List  
Documentation:

Returns a list containing given items.
Start / End / Elapsed: 20250309 23:50:51.574 / 20250309 23:50:51.574 / 00:00:00.000
00:00:00.185 FOR ${index} IN @{index_list}  
Start / End / Elapsed: 20250309 23:50:51.575 / 20250309 23:50:51.760 / 00:00:00.185
00:00:00.184 ITERATION ${index} = 1  
Start / End / Elapsed: 20250309 23:50:51.575 / 20250309 23:50:51.759 / 00:00:00.184
00:00:00.183 KEYWORD ${raft_state} = ClusterManagement . Get_Raft_State_Of_Shard_At_Member   shard_name=${shard_name} shard_type=${ds_type} member_index=${index} verify_restconf=${verify_restconf} http_timeout=${http_timeout}
Documentation:

Send request to Jolokia on indexed member, return extracted Raft status. Optionally, check restconf works.
Start / End / Elapsed: 20250309 23:50:51.575 / 20250309 23:50:51.758 / 00:00:00.183
00:00:00.183 KEYWORD ${raft_state} = ClusterManagement . Get_Raft_Property_From_Shard_Member   RaftState ${shard_name} ${shard_type} ${member_index} verify_restconf=${verify_restconf} http_timeout=${http_timeout}
Documentation:

Send request to Jolokia on indexed member, return extracted Raft property. Optionally, check restconf works.
Start / End / Elapsed: 20250309 23:50:51.576 / 20250309 23:50:51.759 / 00:00:00.183
00:00:00.001 KEYWORD ${session} = ClusterManagement . Resolve_Http_Session_For_Member   member_index=${member_index}
Documentation:

Return RequestsLibrary session alias pointing to node of given index.
Start / End / Elapsed: 20250309 23:50:51.576 / 20250309 23:50:51.577 / 00:00:00.001
00:00:00.178 IF ${verify_restconf}  
Start / End / Elapsed: 20250309 23:50:51.577 / 20250309 23:50:51.755 / 00:00:00.178
00:00:00.174 KEYWORD TemplatedRequests . Get_As_Json_Templated   session=${session} folder=${RESTCONF_MODULES_DIR} verify=False http_timeout=${http_timeout}
Documentation:

Add arguments sensible for JSON data, return Get_Templated response text. Optionally, verification against JSON data (may be iterated) is called. Only subset of JSON data is verified and returned if JMES path is specified in file ${folder}/jmespath.expr.
Start / End / Elapsed: 20250309 23:50:51.580 / 20250309 23:50:51.754 / 00:00:00.174
00:00:00.170 KEYWORD ${response_text} = TemplatedRequests . Get_Templated   folder=${folder} mapping=${mapping} accept=${ACCEPT_EMPTY} session=${session} normalize_json=True http_timeout=${http_timeout} log_response=${log_response}
Documentation:

Resolve URI from folder, call Get_From_Uri, return response text.
Start / End / Elapsed: 20250309 23:50:51.584 / 20250309 23:50:51.754 / 00:00:00.170
00:00:00.118 KEYWORD ${uri} = TemplatedRequests . Resolve_Text_From_Template_Folder   folder=${folder} base_name=location extension=uri mapping=${mapping} percent_encode=True
Documentation:

Read a template from folder, strip endline, make changes according to mapping, return the result. If ${iterations} value is present, put text together from "prolog", "item" and "epilog" parts, where additional template variable ${i} goes from ${iter_start}, by one ${iterations} times. Template variable ${j} is calculated as ${i} incremented by offset ${iter_j_offset} ( j = i + iter_j_offset ) used to create non uniform data in order to be able to validate UPDATE operations. POST (as opposed to PUT) needs slightly different data, ${name_prefix} may be used to distinguish. (Actually, it is GET who formats data differently when URI is a top-level container.)
Start / End / Elapsed: 20250309 23:50:51.603 / 20250309 23:50:51.721 / 00:00:00.118
00:00:00.005 KEYWORD ${jmes_expression} = TemplatedRequests . Resolve_Jmes_Path   ${folder}
Documentation:

Reads JMES path from file /w/workspace/controller-csit-3node-rest-clust-cars-perf-tell-only-scandium/test/csit/libraries/../variables/restconf/modules/jmespath.expr if the file exists and returns the JMES path. Empty string is returned otherwise.
Start / End / Elapsed: 20250309 23:50:51.721 / 20250309 23:50:51.726 / 00:00:00.005
00:00:00.004 KEYWORD ${volatiles_list} = TemplatedRequests . Resolve_Volatiles_Path   ${folder}
Documentation:

Reads Volatiles List from file /w/workspace/controller-csit-3node-rest-clust-cars-perf-tell-only-scandium/test/csit/libraries/../variables/restconf/modules/volatiles.list if the file exists and returns the Volatiles List. Empty string is returned otherwise.
Start / End / Elapsed: 20250309 23:50:51.726 / 20250309 23:50:51.730 / 00:00:00.004
00:00:00.022 KEYWORD ${response_text} = TemplatedRequests . Get_From_Uri   uri=${uri} accept=${accept} session=${session} normalize_json=${normalize_json} jmes_path=${jmes_expression} http_timeout=${http_timeout} keys_with_volatiles=${volatiles_list} log_response=${log_response}
Documentation:

GET data from given URI, check status code and return response text. ${accept} is a Python object with headers to use. If ${normalize_json}, normalize as JSON text before returning.
Start / End / Elapsed: 20250309 23:50:51.731 / 20250309 23:50:51.753 / 00:00:00.022
00:00:00.000 KEYWORD BuiltIn . Log   ${uri}
Documentation:

Logs the given message with the given level.
Start / End / Elapsed: 20250309 23:50:51.732 / 20250309 23:50:51.732 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Log   ${accept}
Documentation:

Logs the given message with the given level.
Start / End / Elapsed: 20250309 23:50:51.732 / 20250309 23:50:51.732 / 00:00:00.000
00:00:00.017 IF """${http_timeout}""" == """${EMPTY}"""  
Start / End / Elapsed: 20250309 23:50:51.733 / 20250309 23:50:51.750 / 00:00:00.017
00:00:00.012 KEYWORD ${response} = RequestsLibrary . GET On Session   ${session} url=${uri} headers=${accept}
Documentation:

Sends a GET request on a previously created HTTP Session.
Start / End / Elapsed: 20250309 23:50:51.738 / 20250309 23:50:51.750 / 00:00:00.012
23:50:51.748 INFO GET Request : url=http://10.30.171.210:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig path_url=/rests/data/ietf-yang-library:modules-state?content=nonconfig headers={'User-Agent': 'python-requests/2.32.3', 'Accept-Encoding': 'gzip, deflate', 'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic YWRtaW46YWRtaW4='} body=None
23:50:51.749 INFO GET Response : url=http://10.30.171.210:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig status=401, reason=Unauthorized headers={'Cache-Control': 'must-revalidate,no-cache,no-store', 'Content-Type': 'text/html;charset=iso-8859-1', 'Content-Length': '414'} body=<html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 401 Unauthorized</title> </head> <body><h2>HTTP ERROR 401 Unauthorized</h2> <table> <tr><th>URI:</th><td>/rests/data/ietf-yang-library:modules-state</td></tr> <tr><th>STATUS:</th><td>401</td></tr> <tr><th>MESSAGE:</th><td>Unauthorized</td></tr> <tr><th>SERVLET:</th><td>default</td></tr> </table> </body> </html>
23:50:51.749 FAIL HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.210:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
00:00:00.001 ELSE  
Start / End / Elapsed: 20250309 23:50:51.750 / 20250309 23:50:51.751 / 00:00:00.001
00:00:00.000 KEYWORD TemplatedRequests . Check_Status_Code   ${response} log_response=${log_response}
Documentation:

Log response text, check status_code is one of allowed ones. In cases where this keyword is called in a WUKS it could end up logging tons of data and it may be desired to skip the logging by passing log_response=False, but by default it remains True.
Start / End / Elapsed: 20250309 23:50:51.752 / 20250309 23:50:51.752 / 00:00:00.000
00:00:00.000 IF not ${normalize_json}  
Start / End / Elapsed: 20250309 23:50:51.752 / 20250309 23:50:51.752 / 00:00:00.000
00:00:00.000 KEYWORD ${text_normalized} = norm_json . Normalize Json Text   ${response.text} jmes_path=${jmes_path} keys_with_volatiles=${keys_with_volatiles}
Documentation:

Attempt to return sorted indented JSON string.
Start / End / Elapsed: 20250309 23:50:51.753 / 20250309 23:50:51.753 / 00:00:00.000
00:00:00.000 RETURN   ${text_normalized}
Start / End / Elapsed: 20250309 23:50:51.753 / 20250309 23:50:51.753 / 00:00:00.000
00:00:00.000 RETURN   ${response_text}
Start / End / Elapsed: 20250309 23:50:51.753 / 20250309 23:50:51.753 / 00:00:00.000
00:00:00.001 IF ${verify}  
Start / End / Elapsed: 20250309 23:50:51.754 / 20250309 23:50:51.755 / 00:00:00.001
00:00:00.000 RETURN   ${response_text}
Start / End / Elapsed: 20250309 23:50:51.754 / 20250309 23:50:51.754 / 00:00:00.000
00:00:00.000 KEYWORD ${type_class} = ClusterManagement . Resolve_Shard_Type_Class   shard_type=${shard_type}
Documentation:

Simple lookup for class name corresponding to desired type.
Start / End / Elapsed: 20250309 23:50:51.755 / 20250309 23:50:51.755 / 00:00:00.000
00:00:00.000 KEYWORD ${cluster_index} = BuiltIn . Evaluate   ${member_index}+${NODE_ROLE_INDEX_START}-1
Documentation:

Evaluates the given expression in Python and returns the result.
Start / End / Elapsed: 20250309 23:50:51.756 / 20250309 23:50:51.756 / 00:00:00.000
00:00:00.000 KEYWORD ${uri} = BuiltIn . Set Variable   ${JOLOKIA_READ_URI}:Category=Shards,name=member-${cluster_index}-shard-${shard_name}-${shard_type},type=${type_class}
Documentation:

Returns the given values which can then be assigned to a variables.
Start / End / Elapsed: 20250309 23:50:51.756 / 20250309 23:50:51.756 / 00:00:00.000
00:00:00.000 KEYWORD ${data_text} = TemplatedRequests . Get_As_Json_From_Uri   uri=${uri} session=${session} http_timeout=${http_timeout}
Documentation:

Specify JSON headers and return Get_From_Uri normalized response text.
Start / End / Elapsed: 20250309 23:50:51.757 / 20250309 23:50:51.757 / 00:00:00.000
00:00:00.000 KEYWORD ${data_object} = Utils . Json Parse From String   ${data_text}
Documentation:

Parse given plain string into json (dictionary)
Start / End / Elapsed: 20250309 23:50:51.757 / 20250309 23:50:51.757 / 00:00:00.000
00:00:00.000 KEYWORD ${value} = Collections . Get From Dictionary   ${data_object} value
Documentation:

Returns a value from the given dictionary based on the given key.
Start / End / Elapsed: 20250309 23:50:51.758 / 20250309 23:50:51.758 / 00:00:00.000
00:00:00.000 KEYWORD ${raft_property} = Collections . Get From Dictionary   ${value} ${property}
Documentation:

Returns a value from the given dictionary based on the given key.
Start / End / Elapsed: 20250309 23:50:51.758 / 20250309 23:50:51.758 / 00:00:00.000
00:00:00.000 RETURN   ${raft_property}
Start / End / Elapsed: 20250309 23:50:51.758 / 20250309 23:50:51.758 / 00:00:00.000
00:00:00.000 RETURN   ${raft_state}
Start / End / Elapsed: 20250309 23:50:51.758 / 20250309 23:50:51.758 / 00:00:00.000
00:00:00.000 IF 'Follower' == '${raft_state}'  
Start / End / Elapsed: 20250309 23:50:51.758 / 20250309 23:50:51.758 / 00:00:00.000
00:00:00.000 ELSE IF 'Leader' == '${raft_state}'  
Start / End / Elapsed: 20250309 23:50:51.759 / 20250309 23:50:51.759 / 00:00:00.000
00:00:00.000 ELSE IF ${validate}  
Start / End / Elapsed: 20250309 23:50:51.759 / 20250309 23:50:51.759 / 00:00:00.000
00:00:00.000 RETURN   ${leader_list} ${follower_list}
Start / End / Elapsed: 20250309 23:50:51.759 / 20250309 23:50:51.759 / 00:00:00.000
00:00:00.000 KEYWORD ${leader_count} = BuiltIn . Get Length   ${leader_list}
Documentation:

Returns and logs the length of the given item as an integer.
Start / End / Elapsed: 20250309 23:50:51.759 / 20250309 23:50:51.759 / 00:00:00.000
00:00:00.000 IF ${leader_count} < 1  
Start / End / Elapsed: 20250309 23:50:51.759 / 20250309 23:50:51.759 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Length Should Be   ${leader_list} ${1} Too many Leaders.
Documentation:

Verifies that the length of the given item is correct.
Start / End / Elapsed: 20250309 23:50:51.760 / 20250309 23:50:51.760 / 00:00:00.000
00:00:00.000 KEYWORD ${leader} = Collections . Get From List   ${leader_list} 0
Documentation:

Returns the value specified with an index from list.
Start / End / Elapsed: 20250309 23:50:51.760 / 20250309 23:50:51.760 / 00:00:00.000
00:00:00.000 RETURN   ${leader} ${follower_list}
Start / End / Elapsed: 20250309 23:50:51.760 / 20250309 23:50:51.760 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Set Suite Variable   \${${shard_name}_leader_index} ${leader}
Documentation:

Makes a variable available everywhere within the scope of the current suite.
Start / End / Elapsed: 20250309 23:50:51.760 / 20250309 23:50:51.760 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Set Suite Variable   \${${shard_name}_follower_indices} ${follower_list}
Documentation:

Makes a variable available everywhere within the scope of the current suite.
Start / End / Elapsed: 20250309 23:50:51.760 / 20250309 23:50:51.760 / 00:00:00.000
00:00:00.000 KEYWORD ${first_follower_index} = Collections . Get From List   ${follower_list} 0
Documentation:

Returns the value specified with an index from list.
Start / End / Elapsed: 20250309 23:50:51.761 / 20250309 23:50:51.761 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Set Suite Variable   \${${shard_name}_first_follower_index} ${first_follower_index}
Documentation:

Makes a variable available everywhere within the scope of the current suite.
Start / End / Elapsed: 20250309 23:50:51.761 / 20250309 23:50:51.761 / 00:00:00.000
00:00:00.000 KEYWORD ${leader_session} = ClusterManagement . Resolve_Http_Session_For_Member   member_index=${leader}
Documentation:

Return RequestsLibrary session alias pointing to node of given index.
Start / End / Elapsed: 20250309 23:50:51.761 / 20250309 23:50:51.761 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Set Suite Variable   \${${shard_name}_leader_session} ${leader_session}
Documentation:

Makes a variable available everywhere within the scope of the current suite.
Start / End / Elapsed: 20250309 23:50:51.761 / 20250309 23:50:51.761 / 00:00:00.000
00:00:00.000 KEYWORD ${sessions} = BuiltIn . Create List  
Documentation:

Returns a list containing given items.
Start / End / Elapsed: 20250309 23:50:51.761 / 20250309 23:50:51.761 / 00:00:00.000
00:00:00.000 FOR ${follower_index} IN @{follower_list}  
Start / End / Elapsed: 20250309 23:50:51.761 / 20250309 23:50:51.761 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Set Suite Variable   \${${shard_name}_follower_sessions} ${sessions}
Documentation:

Makes a variable available everywhere within the scope of the current suite.
Start / End / Elapsed: 20250309 23:50:51.762 / 20250309 23:50:51.762 / 00:00:00.000
00:00:00.000 KEYWORD ${first_follower_session} = Collections . Get From List   ${sessions} 0
Documentation:

Returns the value specified with an index from list.
Start / End / Elapsed: 20250309 23:50:51.762 / 20250309 23:50:51.762 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Set Suite Variable   \${${shard_name}_first_follower_session} ${first_follower_session}
Documentation:

Makes a variable available everywhere within the scope of the current suite.
Start / End / Elapsed: 20250309 23:50:51.762 / 20250309 23:50:51.762 / 00:00:00.000
00:00:00.000 KEYWORD KarafKeywords . Execute_Controller_Karaf_Command_On_Background   log:set ${CONTROLLER_LOG_LEVEL}
Documentation:

Send command to karaf without affecting current SSH connection. Read, log and return response.
Start / End / Elapsed: 20250309 23:50:51.763 / 20250309 23:50:51.763 / 00:00:00.000
00:00:00.000 KEYWORD ${mininet_conn_id} = SSHLibrary . Open Connection   ${TOOLS_SYSTEM_IP} prompt=${DEFAULT_LINUX_PROMPT} timeout=6s
Documentation:

Opens a new SSH connection to the given host and port.
Start / End / Elapsed: 20250309 23:50:51.763 / 20250309 23:50:51.763 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Set Suite Variable   ${mininet_conn_id}
Documentation:

Makes a variable available everywhere within the scope of the current suite.
Start / End / Elapsed: 20250309 23:50:51.763 / 20250309 23:50:51.763 / 00:00:00.000
00:00:00.000 KEYWORD SSHKeywords . Flexible_Mininet_Login   ${TOOLS_SYSTEM_USER}
Documentation:

Call Flexible SSH Login, but with default values suitable for Mininet machine.
Start / End / Elapsed: 20250309 23:50:51.763 / 20250309 23:50:51.763 / 00:00:00.000
00:00:00.000 KEYWORD SSHLibrary . Put File   /w/workspace/controller-csit-3node-rest-clust-cars-perf-tell-only-scandium/test/csit/suites/controller/ThreeNodes_Datastore/../../../../tools/odl-mdsal-clustering-tests/scripts/cluster_rest_script.py .
Documentation:

Uploads file(s) from the local machine to the remote machine.
Start / End / Elapsed: 20250309 23:50:51.764 / 20250309 23:50:51.764 / 00:00:00.000
00:00:00.000 KEYWORD ${stdout} ${stderr} ${rc} = SSHLibrary . Execute Command   ls return_stdout=True return_stderr=True return_rc=True
Documentation:

Executes command on the remote machine and returns its outputs.
Start / End / Elapsed: 20250309 23:50:51.764 / 20250309 23:50:51.764 / 00:00:00.000
00:00:00.000 KEYWORD RequestsLibrary . Create Session   session http://${ODL_SYSTEM_IP}:${RESTCONFPORT} auth=${AUTH}
Documentation:

Create Session: create a HTTP session to a server
Start / End / Elapsed: 20250309 23:50:51.764 / 20250309 23:50:51.764 / 00:00:00.000
00:00:00.001 TEARDOWN Stop Suite  
Documentation:

Suite teardown keyword
Start / End / Elapsed: 20250309 23:50:51.769 / 20250309 23:50:51.770 / 00:00:00.001
00:00:00.000 TEST Add Cars
Full Name: controller-rest-clust-cars-perf-tell.txt.010 Crud Mdsal Perf.Add Cars
Documentation:

Request to add 10000 cars (timeout in 5m).
Start / End / Elapsed: 20250309 23:50:51.764 / 20250309 23:50:51.764 / 00:00:00.000
Status: FAIL
Message: Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.210:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
00:00:00.000 TEST Verify Cars
Full Name: controller-rest-clust-cars-perf-tell.txt.010 Crud Mdsal Perf.Verify Cars
Documentation:

Store logs and verify result
Start / End / Elapsed: 20250309 23:50:51.765 / 20250309 23:50:51.765 / 00:00:00.000
Status: FAIL
Message: Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.210:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
00:00:00.000 TEST Add People
Full Name: controller-rest-clust-cars-perf-tell.txt.010 Crud Mdsal Perf.Add People
Documentation:

Request to add 10000 people (timeout in 5m).
Start / End / Elapsed: 20250309 23:50:51.765 / 20250309 23:50:51.765 / 00:00:00.000
Status: FAIL
Message: Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.210:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
00:00:00.000 TEST Verify People
Full Name: controller-rest-clust-cars-perf-tell.txt.010 Crud Mdsal Perf.Verify People
Documentation:

Store logs and verify result
Start / End / Elapsed: 20250309 23:50:51.766 / 20250309 23:50:51.766 / 00:00:00.000
Status: FAIL
Message: Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.210:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
00:00:00.000 TEST Purchase Cars
Full Name: controller-rest-clust-cars-perf-tell.txt.010 Crud Mdsal Perf.Purchase Cars
Documentation:

Request to purchase 10000 cars (timeout in 5m).
Start / End / Elapsed: 20250309 23:50:51.766 / 20250309 23:50:51.766 / 00:00:00.000
Status: FAIL
Message: Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.210:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
00:00:00.000 TEST Verify Purchases
Full Name: controller-rest-clust-cars-perf-tell.txt.010 Crud Mdsal Perf.Verify Purchases
Documentation:

Store logs and verify result
Start / End / Elapsed: 20250309 23:50:51.767 / 20250309 23:50:51.767 / 00:00:00.000
Status: FAIL
Message: Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.210:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
00:00:00.000 TEST Delete Cars
Full Name: controller-rest-clust-cars-perf-tell.txt.010 Crud Mdsal Perf.Delete Cars
Documentation:

Remove cars from the datastore
Start / End / Elapsed: 20250309 23:50:51.767 / 20250309 23:50:51.767 / 00:00:00.000
Status: FAIL
Message: Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.210:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
00:00:00.000 TEST Delete People
Full Name: controller-rest-clust-cars-perf-tell.txt.010 Crud Mdsal Perf.Delete People
Documentation:

Remove people from the datastore
Start / End / Elapsed: 20250309 23:50:51.768 / 20250309 23:50:51.768 / 00:00:00.000
Status: FAIL
Message: Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.210:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
00:00:00.000 TEST Delete CarPeople
Full Name: controller-rest-clust-cars-perf-tell.txt.010 Crud Mdsal Perf.Delete CarPeople
Documentation:

Remove car-people entries from the datastore
Start / End / Elapsed: 20250309 23:50:51.768 / 20250309 23:50:51.768 / 00:00:00.000
Status: FAIL
Message: Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.210:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
00:00:05.885 SUITE Puts During Isolation
Full Name: controller-rest-clust-cars-perf-tell.txt.Puts During Isolation
Documentation:

Test when a car shard leader is isolated while configuring cars.

Copyright (c) 2017 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

This test suite requires odl-restconf and odl-clustering-test-app modules. The script cluster_rest_script.py is used for generating requests for PUTing car items while the car shard leader is isolated.
Source: /w/workspace/controller-csit-3node-rest-clust-cars-perf-tell-only-scandium/test/csit/suites/controller/ThreeNodes_Datastore/puts_during_isolation.robot
Start / End / Elapsed: 20250309 23:50:51.770 / 20250309 23:50:57.655 / 00:00:05.885
Status: 6 tests total, 0 passed, 6 failed, 0 skipped
Message: Suite setup failed: NoValidConnectionsError: [Errno None] Unable to connect to port 8101 on 10.30.170.86 Also suite teardown failed: Several failures occurred: 1) No open connection. 2) No open connection. 3) No open connection. 4) No open connection. 5) No open connection. 6) Variable '${new_leader_index}' not found. 7) ConnectionError: HTTPConnectionPool(host='10.30.170.86', port=8181): Max retries exceeded with url: /rests/data/car:cars (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fcf442d7650>: Failed to establish a new connection: [Errno 111] Connection refused')) 8) Resolving variable '${rsp.status_code}' failed: AttributeError: 'NoneType' object has no attribute 'status_code' 9) Several failures occurred: 1) No open connection. 2) Got rc: None or stderr was not empty: None 10) Variable '${out_file}' not found. Did you mean: ${OUTPUT_FILE} ${LOG_FILE}
00:00:05.778 SETUP Start Suite  
Documentation:

Upload the script file and create a virtual env
Start / End / Elapsed: 20250309 23:50:51.836 / 20250309 23:50:57.614 / 00:00:05.778
00:00:05.229 KEYWORD SetupUtils . Setup_Utils_For_Setup_And_Teardown  
Documentation:

Prepare both FailFast and Karaf logging, log that the caller suite has started. This keyword is to be used in suite setup, and without it the other keywords may not work properly.
Start / End / Elapsed: 20250309 23:50:51.836 / 20250309 23:50:57.065 / 00:00:05.229
00:00:00.544 KEYWORD SetupUtils . Setup_Logging_For_Debug_Purposes_On_List_Or_All   ${TEST_LOG_LEVEL} ${TEST_LOG_COMPONENTS}
Documentation:

Set the log level for given loggers on node nodes of the cluster
Start / End / Elapsed: 20250309 23:50:57.065 / 20250309 23:50:57.609 / 00:00:00.544
00:00:00.542 FOR ${logger} IN @{loggers_list}  
Start / End / Elapsed: 20250309 23:50:57.067 / 20250309 23:50:57.609 / 00:00:00.542
00:00:00.542 ITERATION ${logger} = org.opendaylight.controller  
Start / End / Elapsed: 20250309 23:50:57.067 / 20250309 23:50:57.609 / 00:00:00.542
00:00:00.541 KEYWORD ClusterManagement . Run_Karaf_Command_On_List_Or_All   log:set ${log_level} ${logger} member_index_list=${member_index_list}
Documentation:

Cycle through indices (or all), run karaf command on each.
Start / End / Elapsed: 20250309 23:50:57.067 / 20250309 23:50:57.608 / 00:00:00.541
00:00:00.001 KEYWORD ${index_list} = ClusterManagement . List_Indices_Or_All   given_list=${member_index_list}
Documentation:

Utility to allow ${EMPTY} as default argument value, as the internal list is computed at runtime. This keyword always returns a (shallow) copy of given or default list, so operations with the returned list should not affect other lists. Also note that this keyword does not consider empty list to be ${EMPTY}.
Start / End / Elapsed: 20250309 23:50:57.067 / 20250309 23:50:57.068 / 00:00:00.001
00:00:00.540 FOR ${index} IN @{index_list}  
Start / End / Elapsed: 20250309 23:50:57.069 / 20250309 23:50:57.609 / 00:00:00.540
00:00:00.225 ITERATION ${index} = 1  
Start / End / Elapsed: 20250309 23:50:57.069 / 20250309 23:50:57.294 / 00:00:00.225
00:00:00.300 ITERATION ${index} = 2  
Start / End / Elapsed: 20250309 23:50:57.294 / 20250309 23:50:57.594 / 00:00:00.300
00:00:00.014 ITERATION ${index} = 3  
Start / End / Elapsed: 20250309 23:50:57.595 / 20250309 23:50:57.609 / 00:00:00.014
00:00:00.000 KEYWORD ${member_ip} = Collections . Get From Dictionary   dictionary=${ClusterManagement__index_to_ip_mapping} key=${index}
Documentation:

Returns a value from the given dictionary based on the given key.
Start / End / Elapsed: 20250309 23:50:57.595 / 20250309 23:50:57.595 / 00:00:00.000
00:00:00.013 KEYWORD KarafKeywords . Safe_Issue_Command_On_Karaf_Console   ${command} ${member_ip} timeout=${timeout}
Documentation:

Run Issue_Command_On_Karaf_Console but restore previous connection afterwards.
Start / End / Elapsed: 20250309 23:50:57.595 / 20250309 23:50:57.608 / 00:00:00.013
00:00:00.000 IF '${IS_KARAF_APPL}' == 'False'  
Start / End / Elapsed: 20250309 23:50:57.596 / 20250309 23:50:57.596 / 00:00:00.000
00:00:00.012 KEYWORD BuiltIn . Run Keyword And Return   SSHKeywords.Run_Keyword_Preserve_Connection Issue_Command_On_Karaf_Console ${cmd} ${controller} ${karaf_port} ${timeout} ${loglevel}
Documentation:

Runs the specified keyword and returns from the enclosing user keyword.
Start / End / Elapsed: 20250309 23:50:57.596 / 20250309 23:50:57.608 / 00:00:00.012
00:00:00.012 KEYWORD SSHKeywords . Run_Keyword_Preserve_Connection   Issue_Command_On_Karaf_Console ${cmd} ${controller} ${karaf_port} ${timeout} ${loglevel}
Documentation:

Store current connection index, run keyword returning its result, restore connection in teardown. Note that in order to avoid "got positional argument after named arguments", it is safer to use positional (not named) arguments on call.
Start / End / Elapsed: 20250309 23:50:57.596 / 20250309 23:50:57.608 / 00:00:00.012
00:00:00.000 KEYWORD ${current_connection} = SSHLibrary . Get Connection  
Documentation:

Returns information about the connection.
Start / End / Elapsed: 20250309 23:50:57.597 / 20250309 23:50:57.597 / 00:00:00.000
00:00:00.008 KEYWORD BuiltIn . Run Keyword And Return   ${keyword_name} @{args} &{kwargs}
Documentation:

Runs the specified keyword and returns from the enclosing user keyword.
Start / End / Elapsed: 20250309 23:50:57.597 / 20250309 23:50:57.605 / 00:00:00.008
00:00:00.004 KEYWORD KarafKeywords . Issue_Command_On_Karaf_Console   @{args} &{kwargs}
Documentation:

Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.210 Note that this keyword will open&close new SSH connection, without switching back to previously current session.
Start / End / Elapsed: 20250309 23:50:57.600 / 20250309 23:50:57.604 / 00:00:00.004
00:00:00.000 IF '${IS_KARAF_APPL}' == 'False'  
Start / End / Elapsed: 20250309 23:50:57.601 / 20250309 23:50:57.601 / 00:00:00.000
00:00:00.001 KEYWORD SSHLibrary . Open Connection   ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout}
Documentation:

Opens a new SSH connection to the given host and port.
Start / End / Elapsed: 20250309 23:50:57.601 / 20250309 23:50:57.602 / 00:00:00.001
00:00:00.002 KEYWORD SSHLibrary . Login   ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel}
Documentation:

Logs into the SSH server with the given username and password.
Start / End / Elapsed: 20250309 23:50:57.602 / 20250309 23:50:57.604 / 00:00:00.002
23:50:57.602 INFO Logging into '10.30.170.86:8101' as 'karaf'.
23:50:57.603 FAIL NoValidConnectionsError: [Errno None] Unable to connect to port 8101 on 10.30.170.86
00:00:00.000 KEYWORD SSHLibrary . Write   ${cmd}
Documentation:

Writes the given text on the remote machine and appends a newline.
Start / End / Elapsed: 20250309 23:50:57.604 / 20250309 23:50:57.604 / 00:00:00.000
00:00:00.000 KEYWORD ${output} = SSHLibrary . Read Until Regexp   ${KARAF_PROMPT}
Documentation:

Consumes and returns the server output until a match to regexp is found.
Start / End / Elapsed: 20250309 23:50:57.604 / 20250309 23:50:57.604 / 00:00:00.000
00:00:00.000 KEYWORD SSHLibrary . Write Bare   logout\n
Documentation:

Writes the given text on the remote machine without appending a newline.
Start / End / Elapsed: 20250309 23:50:57.604 / 20250309 23:50:57.604 / 00:00:00.000
00:00:00.000 KEYWORD SSHLibrary . Close Connection  
Documentation:

Closes the current connection.
Start / End / Elapsed: 20250309 23:50:57.604 / 20250309 23:50:57.604 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Log   ${output}
Documentation:

Logs the given message with the given level.
Start / End / Elapsed: 20250309 23:50:57.604 / 20250309 23:50:57.604 / 00:00:00.000
00:00:00.000 RETURN   ${output}
Start / End / Elapsed: 20250309 23:50:57.604 / 20250309 23:50:57.604 / 00:00:00.000
23:50:57.605 INFO Returning from the enclosing user keyword.
00:00:00.003 TEARDOWN SSHKeywords . Restore_Current_Ssh_Connection_From_Index   ${current_connection.index}
Documentation:

Restore active SSH connection in SSHLibrary to given index.
Start / End / Elapsed: 20250309 23:50:57.605 / 20250309 23:50:57.608 / 00:00:00.003
23:50:57.608 INFO Returning from the enclosing user keyword.
00:00:00.000 KEYWORD ${mininet_conn_id} = SSHKeywords . Open_Connection_To_Tools_System   prompt=~]>
Documentation:

Open a connection to the tools system at ${ip_address} and return its identifier.
Start / End / Elapsed: 20250309 23:50:57.612 / 20250309 23:50:57.612 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Set Suite Variable   ${mininet_conn_id}
Documentation:

Makes a variable available everywhere within the scope of the current suite.
Start / End / Elapsed: 20250309 23:50:57.612 / 20250309 23:50:57.612 / 00:00:00.000
00:00:00.000 KEYWORD SSHLibrary . Put File   /w/workspace/controller-csit-3node-rest-clust-cars-perf-tell-only-scandium/test/csit/suites/controller/ThreeNodes_Datastore/../../../../tools/odl-mdsal-clustering-tests/scripts/${TOOL_NAME} .
Documentation:

Uploads file(s) from the local machine to the remote machine.
Start / End / Elapsed: 20250309 23:50:57.613 / 20250309 23:50:57.613 / 00:00:00.000
00:00:00.000 KEYWORD ${stdout} ${stderr} ${rc} = SSHLibrary . Execute Command   ls return_stdout=True return_stderr=True return_rc=True
Documentation:

Executes command on the remote machine and returns its outputs.
Start / End / Elapsed: 20250309 23:50:57.613 / 20250309 23:50:57.613 / 00:00:00.000
00:00:00.000 KEYWORD ${out_file} = Utils . Get Log File Name   ${TOOL_NAME}
Documentation:

Get the name of the suite sanitized to be usable as a part of filename. These names are used to constructs names of the log files produced by the testing tools so two suites using a tool wont overwrite the log files if they happen to run in one job.
Start / End / Elapsed: 20250309 23:50:57.613 / 20250309 23:50:57.613 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Set Suite Variable   ${out_file}
Documentation:

Makes a variable available everywhere within the scope of the current suite.
Start / End / Elapsed: 20250309 23:50:57.613 / 20250309 23:50:57.613 / 00:00:00.000
00:00:00.000 KEYWORD SSHKeywords . Virtual_Env_Create  
Documentation:

Creates virtual env. If not to use the default name, use Virtual_Env_Set_Path kw. Returns stdout.
Start / End / Elapsed: 20250309 23:50:57.613 / 20250309 23:50:57.613 / 00:00:00.000
00:00:00.000 KEYWORD SSHKeywords . Virtual_Env_Install_Package   requests
Documentation:

Installs python package into virtual env. Use with version if needed (e.g. exabgp==3.4.16). Returns stdout.
Start / End / Elapsed: 20250309 23:50:57.614 / 20250309 23:50:57.614 / 00:00:00.000
00:00:00.000 KEYWORD CarPeople . Set_Variables_For_Shard   ${SHARD_NAME} shard_type=${SHARD_TYPE}
Documentation:

Get leader and followers for given shard name and set several suite variables related to member indices and sessions. ClusterManagement Resource is assumed to be initialized. TODO: car-people shard name causes dash in variable names. Should we convert to underscores?
Start / End / Elapsed: 20250309 23:50:57.614 / 20250309 23:50:57.614 / 00:00:00.000
00:00:00.038 TEARDOWN Stop Suite  
Documentation:

Stop the tool, remove virtual env and close ssh connection towards tools vm.
Start / End / Elapsed: 20250309 23:50:57.617 / 20250309 23:50:57.655 / 00:00:00.038
00:00:00.006 KEYWORD Stop_Tool  
Documentation:

Stop the tool if still running.
Start / End / Elapsed: 20250309 23:50:57.618 / 20250309 23:50:57.624 / 00:00:00.006
00:00:00.004 KEYWORD ${session} = ClusterManagement . Resolve_Http_Session_For_Member   member_index=${new_leader_index}
Documentation:

Return RequestsLibrary session alias pointing to node of given index.
Start / End / Elapsed: 20250309 23:50:57.623 / 20250309 23:50:57.627 / 00:00:00.004
00:00:00.004 KEYWORD ${rsp} = RequestsLibrary . DELETE On Session   ${session} url=${CARURL} expected_status=anything
Documentation:

Sends a DELETE request on a previously created HTTP Session.
Start / End / Elapsed: 20250309 23:50:57.627 / 20250309 23:50:57.631 / 00:00:00.004
00:00:00.002 KEYWORD BuiltIn . Log   ${rsp.status_code} : ${rsp.text}
Documentation:

Logs the given message with the given level.
Start / End / Elapsed: 20250309 23:50:57.632 / 20250309 23:50:57.634 / 00:00:00.002
00:00:00.011 KEYWORD SSHKeywords . Virtual_Env_Delete  
Documentation:

Deletes a directory with virtual env.
Start / End / Elapsed: 20250309 23:50:57.634 / 20250309 23:50:57.645 / 00:00:00.011
00:00:00.003 KEYWORD Store_File_To_Workspace   ${out_file} ${out_file}
Documentation:

Store the ${source_file_name} to the workspace as ${target_file_name}.
Start / End / Elapsed: 20250309 23:50:57.652 / 20250309 23:50:57.655 / 00:00:00.003
00:00:00.000 KEYWORD SSHLibrary . Close All Connections  
Documentation:

Closes all open connections.
Start / End / Elapsed: 20250309 23:50:57.655 / 20250309 23:50:57.655 / 00:00:00.000
00:00:00.000 TEST Start_Adding_Cars_To_Follower
Full Name: controller-rest-clust-cars-perf-tell.txt.Puts During Isolation.Start_Adding_Cars_To_Follower
Documentation:

Start the script to configure 10000 cars in the background.
Tags: critical
Start / End / Elapsed: 20250309 23:50:57.614 / 20250309 23:50:57.614 / 00:00:00.000
Status: FAIL
Message: Parent suite setup failed: NoValidConnectionsError: [Errno None] Unable to connect to port 8101 on 10.30.170.86 Also parent suite teardown failed: Several failures occurred: 1) No open connection. 2) No open connection. 3) No open connection. 4) No open connection. 5) No open connection. 6) Variable '${new_leader_index}' not found. 7) ConnectionError: HTTPConnectionPool(host='10.30.170.86', port=8181): Max retries exceeded with url: /rests/data/car:cars (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fcf442d7650>: Failed to establish a new connection: [Errno 111] Connection refused')) 8) Resolving variable '${rsp.status_code}' failed: AttributeError: 'NoneType' object has no attribute 'status_code' 9) Several failures occurred: 1) No open connection. 2) Got rc: None or stderr was not empty: None 10) Variable '${out_file}' not found. Did you mean: ${OUTPUT_FILE} ${LOG_FILE}
00:00:00.000 TEST Isolate_Current_Car_Leader
Full Name: controller-rest-clust-cars-perf-tell.txt.Puts During Isolation.Isolate_Current_Car_Leader
Documentation:

Isolating cluster node which is the car shard leader.
Tags: critical
Start / End / Elapsed: 20250309 23:50:57.615 / 20250309 23:50:57.615 / 00:00:00.000
Status: FAIL
Message: Parent suite setup failed: NoValidConnectionsError: [Errno None] Unable to connect to port 8101 on 10.30.170.86 Also parent suite teardown failed: Several failures occurred: 1) No open connection. 2) No open connection. 3) No open connection. 4) No open connection. 5) No open connection. 6) Variable '${new_leader_index}' not found. 7) ConnectionError: HTTPConnectionPool(host='10.30.170.86', port=8181): Max retries exceeded with url: /rests/data/car:cars (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fcf442d7650>: Failed to establish a new connection: [Errno 111] Connection refused')) 8) Resolving variable '${rsp.status_code}' failed: AttributeError: 'NoneType' object has no attribute 'status_code' 9) Several failures occurred: 1) No open connection. 2) Got rc: None or stderr was not empty: None 10) Variable '${out_file}' not found. Did you mean: ${OUTPUT_FILE} ${LOG_FILE}
00:00:00.000 TEST Verify_New_Car_Leader_Elected
Full Name: controller-rest-clust-cars-perf-tell.txt.Puts During Isolation.Verify_New_Car_Leader_Elected
Documentation:

Verify new owner of the car shard is elected.
Tags: critical
Start / End / Elapsed: 20250309 23:50:57.615 / 20250309 23:50:57.615 / 00:00:00.000
Status: FAIL
Message: Parent suite setup failed: NoValidConnectionsError: [Errno None] Unable to connect to port 8101 on 10.30.170.86 Also parent suite teardown failed: Several failures occurred: 1) No open connection. 2) No open connection. 3) No open connection. 4) No open connection. 5) No open connection. 6) Variable '${new_leader_index}' not found. 7) ConnectionError: HTTPConnectionPool(host='10.30.170.86', port=8181): Max retries exceeded with url: /rests/data/car:cars (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fcf442d7650>: Failed to establish a new connection: [Errno 111] Connection refused')) 8) Resolving variable '${rsp.status_code}' failed: AttributeError: 'NoneType' object has no attribute 'status_code' 9) Several failures occurred: 1) No open connection. 2) Got rc: None or stderr was not empty: None 10) Variable '${out_file}' not found. Did you mean: ${OUTPUT_FILE} ${LOG_FILE}
00:00:00.000 TEST Verify_Cars_Configured
Full Name: controller-rest-clust-cars-perf-tell.txt.Puts During Isolation.Verify_Cars_Configured
Documentation:

Verify that all cars are configured.
Tags: critical
Start / End / Elapsed: 20250309 23:50:57.616 / 20250309 23:50:57.616 / 00:00:00.000
Status: FAIL
Message: Parent suite setup failed: NoValidConnectionsError: [Errno None] Unable to connect to port 8101 on 10.30.170.86 Also parent suite teardown failed: Several failures occurred: 1) No open connection. 2) No open connection. 3) No open connection. 4) No open connection. 5) No open connection. 6) Variable '${new_leader_index}' not found. 7) ConnectionError: HTTPConnectionPool(host='10.30.170.86', port=8181): Max retries exceeded with url: /rests/data/car:cars (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fcf442d7650>: Failed to establish a new connection: [Errno 111] Connection refused')) 8) Resolving variable '${rsp.status_code}' failed: AttributeError: 'NoneType' object has no attribute 'status_code' 9) Several failures occurred: 1) No open connection. 2) Got rc: None or stderr was not empty: None 10) Variable '${out_file}' not found. Did you mean: ${OUTPUT_FILE} ${LOG_FILE}
00:00:00.000 TEST Rejoin_Isolated_Member
Full Name: controller-rest-clust-cars-perf-tell.txt.Puts During Isolation.Rejoin_Isolated_Member
Documentation:

Rejoin isolated node
Tags: critical
Start / End / Elapsed: 20250309 23:50:57.616 / 20250309 23:50:57.616 / 00:00:00.000
Status: FAIL
Message: Parent suite setup failed: NoValidConnectionsError: [Errno None] Unable to connect to port 8101 on 10.30.170.86 Also parent suite teardown failed: Several failures occurred: 1) No open connection. 2) No open connection. 3) No open connection. 4) No open connection. 5) No open connection. 6) Variable '${new_leader_index}' not found. 7) ConnectionError: HTTPConnectionPool(host='10.30.170.86', port=8181): Max retries exceeded with url: /rests/data/car:cars (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fcf442d7650>: Failed to establish a new connection: [Errno 111] Connection refused')) 8) Resolving variable '${rsp.status_code}' failed: AttributeError: 'NoneType' object has no attribute 'status_code' 9) Several failures occurred: 1) No open connection. 2) Got rc: None or stderr was not empty: None 10) Variable '${out_file}' not found. Did you mean: ${OUTPUT_FILE} ${LOG_FILE}
00:00:00.000 TEST Delete Cars
Full Name: controller-rest-clust-cars-perf-tell.txt.Puts During Isolation.Delete Cars
Documentation:

Remove cars from the datastore
Tags: critical
Start / End / Elapsed: 20250309 23:50:57.617 / 20250309 23:50:57.617 / 00:00:00.000
Status: FAIL
Message: Parent suite setup failed: NoValidConnectionsError: [Errno None] Unable to connect to port 8101 on 10.30.170.86 Also parent suite teardown failed: Several failures occurred: 1) No open connection. 2) No open connection. 3) No open connection. 4) No open connection. 5) No open connection. 6) Variable '${new_leader_index}' not found. 7) ConnectionError: HTTPConnectionPool(host='10.30.170.86', port=8181): Max retries exceeded with url: /rests/data/car:cars (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fcf442d7650>: Failed to establish a new connection: [Errno 111] Connection refused')) 8) Resolving variable '${rsp.status_code}' failed: AttributeError: 'NoneType' object has no attribute 'status_code' 9) Several failures occurred: 1) No open connection. 2) Got rc: None or stderr was not empty: None 10) Variable '${out_file}' not found. Did you mean: ${OUTPUT_FILE} ${LOG_FILE}