Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.170.26:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>log:set ERROR ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} log:set ${log_level} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.170.26 Note that this keyword will open&close new SSH connection, without switching back to previously current session. 3x 1s KarafKeywords.Issue Command On Karaf Console log:set ${log_level} Runs the specified keyword and retries if it fails. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/latency.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/latency.csv</a>'. ${latency_results_file} LATENCY_MIN,LATENCY_MAX,LATENCY_AVERAGE\n Appends the given content to the specified file. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/throughput.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/throughput.csv</a>'. ${throughput_results_file} THROUGHPUT_MIN,THROUGHPUT_MAX,THROUGHPUT_AVERAGE\n Appends the given content to the specified file. ${duration_in_ms} = 60000 ${duration_in_ms} ${duration_in_secs} * 1000 Evaluates the given expression in Python and returns the result. ${duration_in_ms} = 60000 ${duration_in_ms} Makes a variable available everywhere within the scope of the current suite. ${test_timeout} = 900.0 ${test_timeout} (${loops} * ${duration_in_secs}) * 1.5 Evaluates the given expression in Python and returns the result. ${test_timeout} = 900.0 ${test_timeout} Makes a variable available everywhere within the scope of the current suite. ${cbench_executable} Fails unless the given ``path`` points to an existing file. ${conn_id} = 2 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.201:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Mon Jun 22 00:45:41 UTC 2026 System load: 0.13 Processes: 111 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.201 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. [?2004h[jenkins@releng-63164-317-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. [chan 1] Opened sftp connection (server version 3) ${file} Fails if the given ``path`` does NOT point to an existing file. Closes the current connection. ${cbench_system} ${cbench_executable} Will create connection with public key and will PASS if the given ${file} exists, otherwise will FAIL ${loops} >= 2 If number of loops is less than 2, cbench will not run Fails if the given condition is not true. Not A Karaf App Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.170.26:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>feature:list -i | 0[C 0g[Krep odl-openflowplugin-drop-test ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.3 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.3 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.3 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.3 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} feature:list -i | grep ${feature_name} ${controller} ${karaf_port} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.170.26 Note that this keyword will open&close new SSH connection, without switching back to previously current session. ${output} ${feature_name} Fails if ``container`` does not contain ``item`` one or more times. ${output} odl-openflowplugin-drop-test Will Succeed if the given ${feature_name} is found in the output of "feature:list -i" Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.170.26:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>dropallpacketsrpc on ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} dropallpacketsrpc on Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.170.26 Note that this keyword will open&close new SSH connection, without switching back to previously current session. Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = latency.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.170.26 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.201" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 5 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.201:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Mon Jun 22 00:45:41 UTC 2026 System load: 0.13 Processes: 111 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.201 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Mon Jun 22 00:45:41 2026 from 10.30.171.67 [?2004h[jenkins@releng-63164-317-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.170.26 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.26:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.26:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.26. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:46:47.830 16 switches: flows: 101317 102832 100803 101921 103213 101173 100900 102838 99240 100407 97855 100780 99506 100012 96881 100156 total = 26.830567 per ms 00:47:47.931 16 switches: flows: 117923 118073 118497 115555 118081 117606 117331 117285 115979 113996 114292 115327 115057 115451 111082 113296 total = 30.862254 per ms 00:48:48.032 16 switches: flows: 113963 114887 114090 111843 114467 113227 114936 114234 112253 111205 111905 112265 111706 109110 110237 110209 total = 29.958869 per ms 00:49:48.133 16 switches: flows: 121291 123355 123772 117743 125325 124497 123496 123898 121980 120262 120429 121066 121680 121375 116961 119090 total = 32.382911 per ms 00:50:48.234 16 switches: flows: 123787 124029 123238 118466 124597 124116 124545 123486 120301 121151 119154 123112 120397 120850 118024 119066 total = 32.417765 per ms 00:51:48.335 16 switches: flows: 125523 123104 124762 119840 124483 123837 123573 123963 122150 119978 118827 122184 121587 119865 118926 119800 total = 32.485776 per ms 00:52:48.436 16 switches: flows: 125018 126893 125067 120621 123706 123305 124737 125816 121001 121353 118736 121424 120282 119561 120929 119629 total = 32.580231 per ms 00:53:48.537 16 switches: flows: 124718 127378 125244 118782 125385 124186 123400 125069 119801 119304 119404 121218 120761 119918 118494 119209 total = 32.483476 per ms 00:54:48.639 16 switches: flows: 125043 126840 124639 118622 125948 123687 121746 124165 119901 119257 118100 122595 122330 119566 117864 119465 total = 32.441779 per ms 00:55:48.740 16 switches: flows: 125358 127430 126441 121032 126410 126174 125693 125799 120646 119726 119617 124293 121776 122076 120401 119881 total = 32.824041 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 29958.87/32824.04/32048.57/10721.48 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.26:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.26:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.26. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:46:47.830 16 switches: flows: 101317 102832 100803 101921 103213 101173 100900 102838 99240 100407 97855 100780 99506 100012 96881 100156 total = 26.830567 per ms 00:47:47.931 16 switches: flows: 117923 118073 118497 115555 118081 117606 117331 117285 115979 113996 114292 115327 115057 115451 111082 113296 total = 30.862254 per ms 00:48:48.032 16 switches: flows: 113963 114887 114090 111843 114467 113227 114936 114234 112253 111205 111905 112265 111706 109110 110237 110209 total = 29.958869 per ms 00:49:48.133 16 switches: flows: 121291 123355 123772 117743 125325 124497 123496 123898 121980 120262 120429 121066 121680 121375 116961 119090 total = 32.382911 per ms 00:50:48.234 16 switches: flows: 123787 124029 123238 118466 124597 124116 124545 123486 120301 121151 119154 123112 120397 120850 118024 119066 total = 32.417765 per ms 00:51:48.335 16 switches: flows: 125523 123104 124762 119840 124483 123837 123573 123963 122150 119978 118827 122184 121587 119865 118926 119800 total = 32.485776 per ms 00:52:48.436 16 switches: flows: 125018 126893 125067 120621 123706 123305 124737 125816 121001 121353 118736 121424 120282 119561 120929 119629 total = 32.580231 per ms 00:53:48.537 16 switches: flows: 124718 127378 125244 118782 125385 124186 123400 125069 119801 119304 119404 121218 120761 119918 118494 119209 total = 32.483476 per ms 00:54:48.639 16 switches: flows: 125043 126840 124639 118622 125948 123687 121746 124165 119901 119257 118100 122595 122330 119566 117864 119465 total = 32.441779 per ms 00:55:48.740 16 switches: flows: 125358 127430 126441 121032 126410 126174 125693 125799 120646 119726 119617 124293 121776 122076 120401 119881 total = 32.824041 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 29958.87/32824.04/32048.57/10721.48 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 29958.87/32824.04/32048.57/10721.48 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 29958.87/32824.04/32048.57/10721.48 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 29958.87/32824.04/32048.57/10721.48 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 29958.87 | 32824.04 | 32048.57 | 10721.48 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 29958.87 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 32824.04 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 32048.57 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 10721.48 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 29958.87 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 32824.04 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 32048.57 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 10721.48 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-06-22 00:55:48 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-06-22 00:55:48,-m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,29958.87,32824.04,32048.57,10721.48 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/latency.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/latency.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} ${latency_results_file} Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in default latency mode. Test parameters have defaults, but can be overridden on the pybot command line cbench latency Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = throughput.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.170.26 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.201" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 7 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.201:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Mon Jun 22 00:55:49 UTC 2026 System load: 1.02 Processes: 105 Usage of /: 19.5% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.201 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Mon Jun 22 00:45:42 2026 from 10.30.171.67 [?2004h[jenkins@releng-63164-317-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.170.26 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 1. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.26:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with ... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.26:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.26. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:56:58.953 16 switches: flows: 489481 489532 497158 470227 490437 492670 493194 486315 483230 467451 459208 479601 466965 475378 461298 464121 total = 127.771100 per ms 00:57:59.056 16 switches: flows: 444638 511913 448454 451452 461576 547603 532295 443005 455837 459018 495651 458764 456729 448029 502241 443019 total = 125.791201 per ms 00:58:59.158 16 switches: flows: 581007 577858 584151 578595 586821 583765 590302 578961 595277 580780 587500 576881 573579 589931 574748 583391 total = 155.131829 per ms 00:59:59.260 16 switches: flows: 565148 564575 559568 563983 560231 561020 559977 565221 562769 558625 567311 553587 561734 552768 563543 553491 total = 149.307590 per ms 01:00:59.361 16 switches: flows: 598406 601234 593942 602214 599417 590780 598545 595241 605743 600527 594157 587534 588532 588920 604800 596589 total = 158.841694 per ms 01:01:59.463 16 switches: flows: 570205 570127 563669 560171 560192 559932 564034 557300 557539 477124 561596 560963 560322 566292 567238 567904 total = 148.493572 per ms 01:02:59.565 16 switches: flows: 597394 590541 590567 589908 595007 585680 590692 596351 588894 599035 591791 594802 586211 596193 592154 592729 total = 157.699168 per ms 01:03:59.667 16 switches: flows: 479081 497224 498675 499168 486132 434670 441105 462850 448727 479948 437793 439046 491668 460627 479679 407942 total = 123.863859 per ms controller msgbuf_read() = 0: closed connection ... exiting ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.26:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with ... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.26:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.26. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:56:58.953 16 switches: flows: 489481 489532 497158 470227 490437 492670 493194 486315 483230 467451 459208 479601 466965 475378 461298 464121 total = 127.771100 per ms 00:57:59.056 16 switches: flows: 444638 511913 448454 451452 461576 547603 532295 443005 455837 459018 495651 458764 456729 448029 502241 443019 total = 125.791201 per ms 00:58:59.158 16 switches: flows: 581007 577858 584151 578595 586821 583765 590302 578961 595277 580780 587500 576881 573579 589931 574748 583391 total = 155.131829 per ms 00:59:59.260 16 switches: flows: 565148 564575 559568 563983 560231 561020 559977 565221 562769 558625 567311 553587 561734 552768 563543 553491 total = 149.307590 per ms 01:00:59.361 16 switches: flows: 598406 601234 593942 602214 599417 590780 598545 595241 605743 600527 594157 587534 588532 588920 604800 596589 total = 158.841694 per ms 01:01:59.463 16 switches: flows: 570205 570127 563669 560171 560192 559932 564034 557300 557539 477124 561596 560963 560322 566292 567238 567904 total = 148.493572 per ms 01:02:59.565 16 switches: flows: 597394 590541 590567 589908 595007 585680 590692 596351 588894 599035 591791 594802 586211 596193 592154 592729 total = 157.699168 per ms 01:03:59.667 16 switches: flows: 479081 497224 498675 499168 486132 434670 441105 462850 448727 479948 437793 439046 491668 460627 479679 407942 total = 123.863859 per ms controller msgbuf_read() = 0: closed connection ... exiting ${output} Logs the given message with the given level. 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.26:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.26. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:56:58.953 16 switches: flows: 489481 489532 497158 470227 490437 492670 493194 486315 483230 467451 459208 479601 466965 475378 461298 464121 total = 127.771100 per ms 00:57:59.056 16 switches: flows: 444638 511913 448454 451452 461576 547603 532295 443005 455837 459018 495651 458764 456729 448029 502241 443019 total = 125.791201 per ms 00:58:59.158 16 switches: flows: 581007 577858 584151 578595 586821 583765 590302 578961 595277 580780 587500 576881 573579 589931 574748 583391 total = 155.131829 per ms 00:59:59.260 16 switches: flows: 565148 564575 559568 563983 560231 561020 559977 565221 562769 558625 567311 553587 561734 552768 563543 553491 total = 149.307590 per ms 01:00:59.361 16 switches: flows: 598406 601234 593942 602214 599417 590780 598545 595241 605743 600527 594157 587534 588532 588920 604800 596589 total = 158.841694 per ms 01:01:59.463 16 switches: flows: 570205 570127 563669 560171 560192 559932 564034 557300 557539 477124 561596 560963 560322 566292 567238 567904 total = 148.493572 per ms 01:02:59.565 16 switches: flows: 597394 590541 590567 589908 595007 585680 590692 596351 588894 599035 591791 594802 586211 596193 592154 592729 total = 157.699168 per ms 01:03:59.667 16 switches: flows: 479081 497224 498675 499168 486132 434670 441105 462850 448727 479948 437793 439046 491668 460627 479679 407942 total = 123.863859 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.26:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.26. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:56:58.953 16 switches: flows: 489481 489532 497158 470227 490437 492670 493194 486315 483230 467451 459208 479601 466965 475378 461298 464121 total = 127.771100 per ms 00:57:59.056 16 switches: flows: 444638 511913 448454 451452 461576 547603 532295 443005 455837 459018 495651 458764 456729 448029 502241 443019 total = 125.791201 per ms 00:58:59.158 16 switches: flows: 581007 577858 584151 578595 586821 583765 590302 578961 595277 580780 587500 576881 573579 589931 574748 583391 total = 155.131829 per ms 00:59:59.260 16 switches: flows: 565148 564575 559568 563983 560231 561020 559977 565221 562769 558625 567311 553587 561734 552768 563543 553491 total = 149.307590 per ms 01:00:59.361 16 switches: flows: 598406 601234 593942 602214 599417 590780 598545 595241 605743 600527 594157 587534 588532 588920 604800 596589 total = 158.841694 per ms 01:01:59.463 16 switches: flows: 570205 570127 563669 560171 560192 559932 564034 557300 557539 477124 561596 560963 560322 566292 567238 567904 total = 148.493572 per ms 01:02:59.565 16 switches: flows: 597394 590541 590567 589908 595007 585680 590692 596351 588894 599035 591791 594802 586211 596193 592154 592729 total = 157.699168 per ms 01:03:59.667 16 switches: flows: 479081 497224 498675 499168 486132 434670 441105 462850 448727 479948 437793 439046 491668 460627 479679 407942 total = 123.863859 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. ${results_list[5]} Logs the given message with the given level. ${results_list[7]} Logs the given message with the given level. @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. ${i} 0 ${num_stats} ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} d,m,s Returns the given time in the requested format. CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. ${min} ${max} ${average} ${average_threshold} ${output_filename} -t -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${throughput_threshold} ${throughput_results_file} 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.26:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.26. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:56:58.953 16 switches: flows: 489481 489532 497158 470227 490437 492670 493194 486315 483230 467451 459208 479601 466965 475378 461298 464121 total = 127.771100 per ms 00:57:59.056 16 switches: flows: 444638 511913 448454 451452 461576 547603 532295 443005 455837 459018 495651 458764 456729 448029 502241 443019 total = 125.791201 per ms 00:58:59.158 16 switches: flows: 581007 577858 584151 578595 586821 583765 590302 578961 595277 580780 587500 576881 573579 589931 574748 583391 total = 155.131829 per ms 00:59:59.260 16 switches: flows: 565148 564575 559568 563983 560231 561020 559977 565221 562769 558625 567311 553587 561734 552768 563543 553491 total = 149.307590 per ms 01:00:59.361 16 switches: flows: 598406 601234 593942 602214 599417 590780 598545 595241 605743 600527 594157 587534 588532 588920 604800 596589 total = 158.841694 per ms 01:01:59.463 16 switches: flows: 570205 570127 563669 560171 560192 559932 564034 557300 557539 477124 561596 560963 560322 566292 567238 567904 total = 148.493572 per ms 01:02:59.565 16 switches: flows: 597394 590541 590567 589908 595007 585680 590692 596351 588894 599035 591791 594802 586211 596193 592154 592729 total = 157.699168 per ms 01:03:59.667 16 switches: flows: 479081 497224 498675 499168 486132 434670 441105 462850 448727 479948 437793 439046 491668 460627 479679 407942 total = 123.863859 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in throughput mode (-t). Test parameters have defaults, but can be overridden on the pybot command line cbench throughput 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.26:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.26. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:56:58.953 16 switches: flows: 489481 489532 497158 470227 490437 492670 493194 486315 483230 467451 459208 479601 466965 475378 461298 464121 total = 127.771100 per ms 00:57:59.056 16 switches: flows: 444638 511913 448454 451452 461576 547603 532295 443005 455837 459018 495651 458764 456729 448029 502241 443019 total = 125.791201 per ms 00:58:59.158 16 switches: flows: 581007 577858 584151 578595 586821 583765 590302 578961 595277 580780 587500 576881 573579 589931 574748 583391 total = 155.131829 per ms 00:59:59.260 16 switches: flows: 565148 564575 559568 563983 560231 561020 559977 565221 562769 558625 567311 553587 561734 552768 563543 553491 total = 149.307590 per ms 01:00:59.361 16 switches: flows: 598406 601234 593942 602214 599417 590780 598545 595241 605743 600527 594157 587534 588532 588920 604800 596589 total = 158.841694 per ms 01:01:59.463 16 switches: flows: 570205 570127 563669 560171 560192 559932 564034 557300 557539 477124 561596 560963 560322 566292 567238 567904 total = 148.493572 per ms 01:02:59.565 16 switches: flows: 597394 590541 590567 589908 595007 585680 590692 596351 588894 599035 591791 594802 586211 596193 592154 592729 total = 157.699168 per ms 01:03:59.667 16 switches: flows: 479081 497224 498675 499168 486132 434670 441105 462850 448727 479948 437793 439046 491668 460627 479679 407942 total = 123.863859 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = bug.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.170.26 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.201" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 9 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.201:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Mon Jun 22 01:04:09 UTC 2026 System load: 0.46 Processes: 106 Usage of /: 19.5% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.201 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Mon Jun 22 00:55:49 2026 from 10.30.171.67 [?2004h[jenkins@releng-63164-317-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.170.26 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.26:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.26:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.26. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 01:05:14.883 16 switches: flows: 118204 121057 119754 116981 119210 118540 119332 122669 117596 118052 118615 115857 115646 120918 118681 117342 total = 31.640900 per ms 01:06:14.984 16 switches: flows: 102170 102020 99791 98334 100059 98881 100978 101442 98919 99081 99942 98330 97742 100229 99970 98743 total = 26.566155 per ms 01:07:15.084 16 switches: flows: 119961 124398 120361 121931 122410 120891 122457 124651 121547 119249 121852 120073 120139 120222 118990 117136 total = 32.217355 per ms 01:08:15.184 16 switches: flows: 107237 107620 105152 105235 104822 104819 107454 108452 105143 105357 105391 104046 104040 107263 104798 105587 total = 28.159925 per ms 01:09:15.284 16 switches: flows: 112191 112584 111624 109900 112176 109363 114151 114638 110824 110062 110122 110426 109149 112442 110521 109918 total = 29.618751 per ms 01:10:15.385 16 switches: flows: 123764 126408 123775 120404 124091 119906 124296 124193 122922 120896 120242 122402 121540 125115 119052 119723 total = 32.591072 per ms 01:11:15.485 16 switches: flows: 126183 128376 124671 123782 126269 121454 126895 127881 123315 121515 122496 123972 121226 127042 121437 121365 total = 33.076101 per ms 01:12:15.585 16 switches: flows: 126079 130406 126412 124550 125553 121359 127425 128675 123011 123681 123002 126257 121307 127365 122150 122720 total = 33.276931 per ms 01:13:15.686 16 switches: flows: 126405 128419 125054 122737 126371 120917 127071 126732 122892 121408 122787 123846 121048 127663 122317 121782 total = 33.068918 per ms 01:14:15.786 16 switches: flows: 125314 125191 123821 121280 124682 121487 125057 126208 122631 121533 120953 120892 121182 123332 121484 122319 total = 32.734758 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 26566.16/33276.93/31256.66/10681.33 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.26:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.26:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.26. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 01:05:14.883 16 switches: flows: 118204 121057 119754 116981 119210 118540 119332 122669 117596 118052 118615 115857 115646 120918 118681 117342 total = 31.640900 per ms 01:06:14.984 16 switches: flows: 102170 102020 99791 98334 100059 98881 100978 101442 98919 99081 99942 98330 97742 100229 99970 98743 total = 26.566155 per ms 01:07:15.084 16 switches: flows: 119961 124398 120361 121931 122410 120891 122457 124651 121547 119249 121852 120073 120139 120222 118990 117136 total = 32.217355 per ms 01:08:15.184 16 switches: flows: 107237 107620 105152 105235 104822 104819 107454 108452 105143 105357 105391 104046 104040 107263 104798 105587 total = 28.159925 per ms 01:09:15.284 16 switches: flows: 112191 112584 111624 109900 112176 109363 114151 114638 110824 110062 110122 110426 109149 112442 110521 109918 total = 29.618751 per ms 01:10:15.385 16 switches: flows: 123764 126408 123775 120404 124091 119906 124296 124193 122922 120896 120242 122402 121540 125115 119052 119723 total = 32.591072 per ms 01:11:15.485 16 switches: flows: 126183 128376 124671 123782 126269 121454 126895 127881 123315 121515 122496 123972 121226 127042 121437 121365 total = 33.076101 per ms 01:12:15.585 16 switches: flows: 126079 130406 126412 124550 125553 121359 127425 128675 123011 123681 123002 126257 121307 127365 122150 122720 total = 33.276931 per ms 01:13:15.686 16 switches: flows: 126405 128419 125054 122737 126371 120917 127071 126732 122892 121408 122787 123846 121048 127663 122317 121782 total = 33.068918 per ms 01:14:15.786 16 switches: flows: 125314 125191 123821 121280 124682 121487 125057 126208 122631 121533 120953 120892 121182 123332 121484 122319 total = 32.734758 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 26566.16/33276.93/31256.66/10681.33 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 26566.16/33276.93/31256.66/10681.33 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 26566.16/33276.93/31256.66/10681.33 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 26566.16/33276.93/31256.66/10681.33 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 26566.16 | 33276.93 | 31256.66 | 10681.33 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 26566.16 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 33276.93 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 31256.66 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 10681.33 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 26566.16 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 33276.93 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 31256.66 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 10681.33 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-06-22 01:14:15 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-06-22 01:14:15,-m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,26566.16,33276.93,31256.66,10681.33 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/bug.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/bug.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} bug.csv Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. ${test_skipped} = False ${test_skipped} len(re.findall('SKIPPED', """${TEST_MESSAGE}""")) > 0 modules=re Evaluates the given expression in Python and returns the result. Jira tickets are {PROJECT}-{NUMBER} while Bugzilla tickets are {NUMBER} Displays the given messages in the log file as keyword arguments. ${match} Should Contain ${number} - Runs the specified keyword and returns the status as a Boolean value. ${bug_url} ${match} https://jira.opendaylight.org/browse/${number} https://bugs.opendaylight.org/show_bug.cgi?id=${number} Sets variable based on the given condition. ${msg} This test fails due to ${bug_url} Returns the given values which can then be assigned to a variables. ${newline} chr(10) Evaluates the given expression in Python and returns the result. ${msg}${newline}${newline}${TEST_MESSAGE} Sets message for the current test case. ${msg} Logs the given message with the given level. ${bug_url} Adds given ``tags`` for the current test or all tests in a suite. 6176 Report that a test failed due to a known Bugzilla bug whose number is provided as an argument. Not FAILED (incl. SKIPPED) test are not reported. This keyword must be used in the [Teardown] setting of the affected test or as the first line of the test if FastFail module is not being used. It reports the URL of the bug on console and also puts it into the Robot log file. cbench executed in latency mode to see if controller is healthy cbench latency Cbench Latency and Throughput tests can be run from an external cbench. If cbench is run with a medium number of switches or higher (e.g. 32+) the normal openflow operations seem to break. BUG: https://bugs.opendaylight.org/show_bug.cgi?id=2897 All Tests cbench latency throughput openflowplugin-cbench.txt