Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.198:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>log:set ERROR ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} log:set ${log_level} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.198 Note that this keyword will open&close new SSH connection, without switching back to previously current session. 3x 1s KarafKeywords.Issue Command On Karaf Console log:set ${log_level} Runs the specified keyword and retries if it fails. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-chromium/latency.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-chromium/latency.csv</a>'. ${latency_results_file} LATENCY_MIN,LATENCY_MAX,LATENCY_AVERAGE\n Appends the given content to the specified file. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-chromium/throughput.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-chromium/throughput.csv</a>'. ${throughput_results_file} THROUGHPUT_MIN,THROUGHPUT_MAX,THROUGHPUT_AVERAGE\n Appends the given content to the specified file. ${duration_in_ms} = 60000 ${duration_in_ms} ${duration_in_secs} * 1000 Evaluates the given expression in Python and returns the result. ${duration_in_ms} = 60000 ${duration_in_ms} Makes a variable available everywhere within the scope of the current suite. ${test_timeout} = 900.0 ${test_timeout} (${loops} * ${duration_in_secs}) * 1.5 Evaluates the given expression in Python and returns the result. ${test_timeout} = 900.0 ${test_timeout} Makes a variable available everywhere within the scope of the current suite. ${cbench_executable} Fails unless the given ``path`` points to an existing file. ${conn_id} = 2 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.88:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-186-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Tue Aug 18 01:51:52 UTC 2026 System load: 0.14 Processes: 110 Usage of /: 19.7% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.88 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 14 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. [?2004h[jenkins@releng-00446-60-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. [chan 1] Opened sftp connection (server version 3) ${file} Fails if the given ``path`` does NOT point to an existing file. Closes the current connection. ${cbench_system} ${cbench_executable} Will create connection with public key and will PASS if the given ${file} exists, otherwise will FAIL ${loops} >= 2 If number of loops is less than 2, cbench will not run Fails if the given condition is not true. Not A Karaf App Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.198:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>feature:list -i | 0[C 0g[Krep odl-openflowplugin-drop-test ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 1.0.0 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 1.0.0 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 1.0.0 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 1.0.0 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} feature:list -i | grep ${feature_name} ${controller} ${karaf_port} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.198 Note that this keyword will open&close new SSH connection, without switching back to previously current session. ${output} ${feature_name} Fails if ``container`` does not contain ``item`` one or more times. ${output} odl-openflowplugin-drop-test Will Succeed if the given ${feature_name} is found in the output of "feature:list -i" Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.198:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>dropallpacketsrpc on ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} dropallpacketsrpc on Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.198 Note that this keyword will open&close new SSH connection, without switching back to previously current session. Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = latency.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.198 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.88" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 5 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.88:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-186-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Tue Aug 18 01:51:52 UTC 2026 System load: 0.14 Processes: 110 Usage of /: 19.7% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.88 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 14 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Tue Aug 18 01:52:33 2026 from 10.30.170.7 [?2004h[jenkins@releng-00446-60-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.198 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.198:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.198:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.198. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 01:53:39.130 16 switches: flows: 123578 119135 120841 121855 120849 122343 120245 117680 118046 115921 115668 116189 115328 117451 115569 117383 total = 31.634683 per ms 01:54:39.231 16 switches: flows: 133152 131404 130577 133079 131667 133581 129978 128406 127649 127185 125278 124605 126854 126879 124439 127869 total = 34.319155 per ms 01:55:39.331 16 switches: flows: 129481 127480 127459 129611 128389 128211 126749 122897 123796 120754 123439 121625 121415 122502 120139 121495 total = 33.201972 per ms 01:56:39.431 16 switches: flows: 128649 127306 128357 128219 128568 126990 126590 122486 122273 120374 121773 121006 122613 121438 120555 121257 total = 33.085688 per ms 01:57:39.531 16 switches: flows: 129631 128157 128481 128819 130430 129451 126549 124721 124494 121245 123129 121594 123428 123820 122215 123158 total = 33.432887 per ms 01:58:39.632 16 switches: flows: 129480 128529 126470 130757 129197 129659 127993 123957 122871 120995 123262 120663 121966 122095 121913 124662 total = 33.352061 per ms 01:59:39.732 16 switches: flows: 131605 127712 127544 129401 127865 129757 126631 122359 122226 120985 122871 121573 120337 121572 119121 122942 total = 33.186234 per ms 02:00:39.832 16 switches: flows: 130226 128888 125563 130009 129173 129032 127393 122031 121802 121697 123130 120962 121542 120443 118929 123157 total = 33.177511 per ms 02:01:39.933 16 switches: flows: 129824 126663 123280 128814 126890 129200 128182 120308 121130 119136 121315 120627 120031 121224 118798 120888 total = 32.883608 per ms 02:02:40.033 16 switches: flows: 131890 129609 127434 130756 128629 131178 128586 123249 122363 121645 124500 121808 122037 123017 120067 123424 total = 33.447330 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 32883.61/34319.15/33342.94/11120.91 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.198:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.198:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.198. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 01:53:39.130 16 switches: flows: 123578 119135 120841 121855 120849 122343 120245 117680 118046 115921 115668 116189 115328 117451 115569 117383 total = 31.634683 per ms 01:54:39.231 16 switches: flows: 133152 131404 130577 133079 131667 133581 129978 128406 127649 127185 125278 124605 126854 126879 124439 127869 total = 34.319155 per ms 01:55:39.331 16 switches: flows: 129481 127480 127459 129611 128389 128211 126749 122897 123796 120754 123439 121625 121415 122502 120139 121495 total = 33.201972 per ms 01:56:39.431 16 switches: flows: 128649 127306 128357 128219 128568 126990 126590 122486 122273 120374 121773 121006 122613 121438 120555 121257 total = 33.085688 per ms 01:57:39.531 16 switches: flows: 129631 128157 128481 128819 130430 129451 126549 124721 124494 121245 123129 121594 123428 123820 122215 123158 total = 33.432887 per ms 01:58:39.632 16 switches: flows: 129480 128529 126470 130757 129197 129659 127993 123957 122871 120995 123262 120663 121966 122095 121913 124662 total = 33.352061 per ms 01:59:39.732 16 switches: flows: 131605 127712 127544 129401 127865 129757 126631 122359 122226 120985 122871 121573 120337 121572 119121 122942 total = 33.186234 per ms 02:00:39.832 16 switches: flows: 130226 128888 125563 130009 129173 129032 127393 122031 121802 121697 123130 120962 121542 120443 118929 123157 total = 33.177511 per ms 02:01:39.933 16 switches: flows: 129824 126663 123280 128814 126890 129200 128182 120308 121130 119136 121315 120627 120031 121224 118798 120888 total = 32.883608 per ms 02:02:40.033 16 switches: flows: 131890 129609 127434 130756 128629 131178 128586 123249 122363 121645 124500 121808 122037 123017 120067 123424 total = 33.447330 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 32883.61/34319.15/33342.94/11120.91 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 32883.61/34319.15/33342.94/11120.91 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 32883.61/34319.15/33342.94/11120.91 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 32883.61/34319.15/33342.94/11120.91 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 32883.61 | 34319.15 | 33342.94 | 11120.91 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 32883.61 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 34319.15 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 33342.94 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 11120.91 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 32883.61 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 34319.15 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 33342.94 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 11120.91 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-08-18 02:02:40 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-08-18 02:02:40,-m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,32883.61,34319.15,33342.94,11120.91 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-chromium/latency.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-chromium/latency.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} ${latency_results_file} Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in default latency mode. Test parameters have defaults, but can be overridden on the pybot command line cbench latency Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = throughput.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.198 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.88" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 7 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.88:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-186-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Tue Aug 18 02:02:40 UTC 2026 System load: 1.0 Processes: 105 Usage of /: 20.2% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.88 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 14 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Tue Aug 18 01:52:33 2026 from 10.30.170.7 [?2004h[jenkins@releng-00446-60-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.198 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 1. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.198:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.198:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.198. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:03:45.832 16 switches: flows: 547022 553629 546570 548133 548838 550261 551640 545678 542343 536036 534229 540619 543207 544558 541370 544357 total = 145.308167 per ms 02:04:45.933 16 switches: flows: 512212 521283 514354 529374 517290 512362 507446 516604 510403 436471 522334 492408 510958 504265 515417 520015 total = 135.492248 per ms 02:05:46.053 16 switches: flows: 527620 510175 531529 516975 527307 526063 523422 530679 527820 533516 522234 509894 529664 530587 527098 526700 total = 139.742255 per ms 02:06:46.157 16 switches: flows: 476411 481585 494441 496609 488141 478933 481371 482724 493474 479900 471998 493794 483821 483622 490541 476933 total = 129.019232 per ms 02:07:46.260 16 switches: flows: 503223 509082 511829 498062 501249 507352 499364 505252 499370 501373 500984 505145 506511 503532 500748 502023 total = 134.021439 per ms 02:08:46.362 16 switches: flows: 498669 494167 499078 502150 493856 495096 496179 496636 501733 498355 489501 494258 497716 491110 498219 495833 total = 132.153453 per ms controller msgbuf_read() = -1: msgbuf_read: Connection reset by peer ... exiting ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.198:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.198:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.198. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:03:45.832 16 switches: flows: 547022 553629 546570 548133 548838 550261 551640 545678 542343 536036 534229 540619 543207 544558 541370 544357 total = 145.308167 per ms 02:04:45.933 16 switches: flows: 512212 521283 514354 529374 517290 512362 507446 516604 510403 436471 522334 492408 510958 504265 515417 520015 total = 135.492248 per ms 02:05:46.053 16 switches: flows: 527620 510175 531529 516975 527307 526063 523422 530679 527820 533516 522234 509894 529664 530587 527098 526700 total = 139.742255 per ms 02:06:46.157 16 switches: flows: 476411 481585 494441 496609 488141 478933 481371 482724 493474 479900 471998 493794 483821 483622 490541 476933 total = 129.019232 per ms 02:07:46.260 16 switches: flows: 503223 509082 511829 498062 501249 507352 499364 505252 499370 501373 500984 505145 506511 503532 500748 502023 total = 134.021439 per ms 02:08:46.362 16 switches: flows: 498669 494167 499078 502150 493856 495096 496179 496636 501733 498355 489501 494258 497716 491110 498219 495833 total = 132.153453 per ms controller msgbuf_read() = -1: msgbuf_read: Connection reset by peer ... exiting ${output} Logs the given message with the given level. 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.198:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.198. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:03:45.832 16 switches: flows: 547022 553629 546570 548133 548838 550261 551640 545678 542343 536036 534229 540619 543207 544558 541370 544357 total = 145.308167 per ms 02:04:45.933 16 switches: flows: 512212 521283 514354 529374 517290 512362 507446 516604 510403 436471 522334 492408 510958 504265 515417 520015 total = 135.492248 per ms 02:05:46.053 16 switches: flows: 527620 510175 531529 516975 527307 526063 523422 530679 527820 533516 522234 509894 529664 530587 527098 526700 total = 139.742255 per ms 02:06:46.157 16 switches: flows: 476411 481585 494441 496609 488141 478933 481371 482724 493474 479900 471998 493794 483821 483622 490541 476933 total = 129.019232 per ms 02:07:46.260 16 switches: flows: 503223 509082 511829 498062 501249 507352 499364 505252 499370 501373 500984 505145 506511 503532 500748 502023 total = 134.021439 per ms 02:08:46.362 16 switches: flows: 498669 494167 499078 502150 493856 495096 496179 496636 501733 498355 489501 494258 497716 491110 498219 495833 total = 132.153453 per ms controller msgbuf_read() = -1: msgbuf_read: Connection reset by peer ... exiting' does not contain 'RESULT' ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.198:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.198. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:03:45.832 16 switches: flows: 547022 553629 546570 548133 548838 550261 551640 545678 542343 536036 534229 540619 543207 544558 541370 544357 total = 145.308167 per ms 02:04:45.933 16 switches: flows: 512212 521283 514354 529374 517290 512362 507446 516604 510403 436471 522334 492408 510958 504265 515417 520015 total = 135.492248 per ms 02:05:46.053 16 switches: flows: 527620 510175 531529 516975 527307 526063 523422 530679 527820 533516 522234 509894 529664 530587 527098 526700 total = 139.742255 per ms 02:06:46.157 16 switches: flows: 476411 481585 494441 496609 488141 478933 481371 482724 493474 479900 471998 493794 483821 483622 490541 476933 total = 129.019232 per ms 02:07:46.260 16 switches: flows: 503223 509082 511829 498062 501249 507352 499364 505252 499370 501373 500984 505145 506511 503532 500748 502023 total = 134.021439 per ms 02:08:46.362 16 switches: flows: 498669 494167 499078 502150 493856 495096 496179 496636 501733 498355 489501 494258 497716 491110 498219 495833 total = 132.153453 per ms controller msgbuf_read() = -1: msgbuf_read: Connection reset by peer ... exiting' does not contain 'RESULT' ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. ${results_list[5]} Logs the given message with the given level. ${results_list[7]} Logs the given message with the given level. @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. ${i} 0 ${num_stats} ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} d,m,s Returns the given time in the requested format. CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. ${min} ${max} ${average} ${average_threshold} ${output_filename} -t -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${throughput_threshold} ${throughput_results_file} 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.198:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.198. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:03:45.832 16 switches: flows: 547022 553629 546570 548133 548838 550261 551640 545678 542343 536036 534229 540619 543207 544558 541370 544357 total = 145.308167 per ms 02:04:45.933 16 switches: flows: 512212 521283 514354 529374 517290 512362 507446 516604 510403 436471 522334 492408 510958 504265 515417 520015 total = 135.492248 per ms 02:05:46.053 16 switches: flows: 527620 510175 531529 516975 527307 526063 523422 530679 527820 533516 522234 509894 529664 530587 527098 526700 total = 139.742255 per ms 02:06:46.157 16 switches: flows: 476411 481585 494441 496609 488141 478933 481371 482724 493474 479900 471998 493794 483821 483622 490541 476933 total = 129.019232 per ms 02:07:46.260 16 switches: flows: 503223 509082 511829 498062 501249 507352 499364 505252 499370 501373 500984 505145 506511 503532 500748 502023 total = 134.021439 per ms 02:08:46.362 16 switches: flows: 498669 494167 499078 502150 493856 495096 496179 496636 501733 498355 489501 494258 497716 491110 498219 495833 total = 132.153453 per ms controller msgbuf_read() = -1: msgbuf_read: Connection reset by peer ... exiting' does not contain 'RESULT' ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in throughput mode (-t). Test parameters have defaults, but can be overridden on the pybot command line cbench throughput 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.198:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.198. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:03:45.832 16 switches: flows: 547022 553629 546570 548133 548838 550261 551640 545678 542343 536036 534229 540619 543207 544558 541370 544357 total = 145.308167 per ms 02:04:45.933 16 switches: flows: 512212 521283 514354 529374 517290 512362 507446 516604 510403 436471 522334 492408 510958 504265 515417 520015 total = 135.492248 per ms 02:05:46.053 16 switches: flows: 527620 510175 531529 516975 527307 526063 523422 530679 527820 533516 522234 509894 529664 530587 527098 526700 total = 139.742255 per ms 02:06:46.157 16 switches: flows: 476411 481585 494441 496609 488141 478933 481371 482724 493474 479900 471998 493794 483821 483622 490541 476933 total = 129.019232 per ms 02:07:46.260 16 switches: flows: 503223 509082 511829 498062 501249 507352 499364 505252 499370 501373 500984 505145 506511 503532 500748 502023 total = 134.021439 per ms 02:08:46.362 16 switches: flows: 498669 494167 499078 502150 493856 495096 496179 496636 501733 498355 489501 494258 497716 491110 498219 495833 total = 132.153453 per ms controller msgbuf_read() = -1: msgbuf_read: Connection reset by peer ... exiting' does not contain 'RESULT' Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = bug.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.198 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.88" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 9 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.88:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-186-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Tue Aug 18 02:09:43 UTC 2026 System load: 1.02 Processes: 105 Usage of /: 20.2% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.88 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 14 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Tue Aug 18 02:02:40 2026 from 10.30.170.7 [?2004h[jenkins@releng-00446-60-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.198 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.198:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.198:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.198. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:10:48.608 16 switches: flows: 122866 123916 126193 125268 123023 127830 124714 124334 120200 121616 120528 118614 122059 118386 119006 120457 total = 32.650167 per ms 02:11:48.709 16 switches: flows: 125989 125989 127119 127114 125658 123547 127624 126203 123514 124102 121931 121787 121224 122542 121243 121064 total = 33.055641 per ms 02:12:48.810 16 switches: flows: 126071 126587 129313 124321 125381 126060 127774 125201 123242 122798 119871 121911 124441 122076 120341 122488 total = 33.076064 per ms 02:13:48.911 16 switches: flows: 127069 127129 128471 125967 124290 126194 127389 123768 124216 122143 120402 122806 124368 119093 120936 121296 total = 33.037145 per ms 02:14:49.011 16 switches: flows: 123506 126152 125349 122846 121997 124606 126072 120743 121035 120259 118441 120227 122463 116698 120008 121189 total = 32.472303 per ms 02:15:49.112 16 switches: flows: 113806 117030 115796 111583 112377 113915 115920 112289 112926 111936 109082 112135 112190 107355 108615 112202 total = 29.935965 per ms 02:16:49.213 16 switches: flows: 113903 116174 115857 109486 110151 113012 115848 110981 112370 108739 108927 110484 110941 106399 109464 110660 total = 29.673725 per ms 02:17:49.314 16 switches: flows: 109081 106759 106903 105568 103878 104951 105504 103137 103462 101779 101842 101524 103359 99359 102983 101883 total = 27.653361 per ms 02:18:49.415 16 switches: flows: 116154 118231 115042 117187 115073 116465 120965 115409 114649 112869 115920 112111 114209 110515 113457 113662 total = 30.647484 per ms 02:19:49.516 16 switches: flows: 123033 124182 119799 123376 119672 122531 124180 121974 121249 118311 121150 116769 121492 114727 116317 115788 total = 32.022338 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 27653.36/33076.06/31286.00/10584.01 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.198:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.198:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.198. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:10:48.608 16 switches: flows: 122866 123916 126193 125268 123023 127830 124714 124334 120200 121616 120528 118614 122059 118386 119006 120457 total = 32.650167 per ms 02:11:48.709 16 switches: flows: 125989 125989 127119 127114 125658 123547 127624 126203 123514 124102 121931 121787 121224 122542 121243 121064 total = 33.055641 per ms 02:12:48.810 16 switches: flows: 126071 126587 129313 124321 125381 126060 127774 125201 123242 122798 119871 121911 124441 122076 120341 122488 total = 33.076064 per ms 02:13:48.911 16 switches: flows: 127069 127129 128471 125967 124290 126194 127389 123768 124216 122143 120402 122806 124368 119093 120936 121296 total = 33.037145 per ms 02:14:49.011 16 switches: flows: 123506 126152 125349 122846 121997 124606 126072 120743 121035 120259 118441 120227 122463 116698 120008 121189 total = 32.472303 per ms 02:15:49.112 16 switches: flows: 113806 117030 115796 111583 112377 113915 115920 112289 112926 111936 109082 112135 112190 107355 108615 112202 total = 29.935965 per ms 02:16:49.213 16 switches: flows: 113903 116174 115857 109486 110151 113012 115848 110981 112370 108739 108927 110484 110941 106399 109464 110660 total = 29.673725 per ms 02:17:49.314 16 switches: flows: 109081 106759 106903 105568 103878 104951 105504 103137 103462 101779 101842 101524 103359 99359 102983 101883 total = 27.653361 per ms 02:18:49.415 16 switches: flows: 116154 118231 115042 117187 115073 116465 120965 115409 114649 112869 115920 112111 114209 110515 113457 113662 total = 30.647484 per ms 02:19:49.516 16 switches: flows: 123033 124182 119799 123376 119672 122531 124180 121974 121249 118311 121150 116769 121492 114727 116317 115788 total = 32.022338 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 27653.36/33076.06/31286.00/10584.01 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 27653.36/33076.06/31286.00/10584.01 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 27653.36/33076.06/31286.00/10584.01 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 27653.36/33076.06/31286.00/10584.01 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 27653.36 | 33076.06 | 31286.00 | 10584.01 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 27653.36 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 33076.06 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 31286.00 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 10584.01 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 27653.36 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 33076.06 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 31286.00 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 10584.01 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-08-18 02:19:49 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-08-18 02:19:49,-m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,27653.36,33076.06,31286.00,10584.01 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-chromium/bug.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-chromium/bug.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} bug.csv Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. ${test_skipped} = False ${test_skipped} len(re.findall('SKIPPED', """${TEST_MESSAGE}""")) > 0 modules=re Evaluates the given expression in Python and returns the result. Jira tickets are {PROJECT}-{NUMBER} while Bugzilla tickets are {NUMBER} Displays the given messages in the log file as keyword arguments. ${match} Should Contain ${number} - Runs the specified keyword and returns the status as a Boolean value. ${bug_url} ${match} https://jira.opendaylight.org/browse/${number} https://bugs.opendaylight.org/show_bug.cgi?id=${number} Sets variable based on the given condition. ${msg} This test fails due to ${bug_url} Returns the given values which can then be assigned to a variables. ${newline} chr(10) Evaluates the given expression in Python and returns the result. ${msg}${newline}${newline}${TEST_MESSAGE} Sets message for the current test case. ${msg} Logs the given message with the given level. ${bug_url} Adds given ``tags`` for the current test or all tests in a suite. 6176 Report that a test failed due to a known Bugzilla bug whose number is provided as an argument. Not FAILED (incl. SKIPPED) test are not reported. This keyword must be used in the [Teardown] setting of the affected test or as the first line of the test if FastFail module is not being used. It reports the URL of the bug on console and also puts it into the Robot log file. cbench executed in latency mode to see if controller is healthy cbench latency Cbench Latency and Throughput tests can be run from an external cbench. If cbench is run with a medium number of switches or higher (e.g. 32+) the normal openflow operations seem to break. BUG: https://bugs.opendaylight.org/show_bug.cgi?id=2897 All Tests cbench latency throughput openflowplugin-cbench.txt