Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.51:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>log:set ERROR ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} log:set ${log_level} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.51 Note that this keyword will open&close new SSH connection, without switching back to previously current session. 3x 1s KarafKeywords.Issue Command On Karaf Console log:set ${log_level} Runs the specified keyword and retries if it fails. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/latency.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/latency.csv</a>'. ${latency_results_file} LATENCY_MIN,LATENCY_MAX,LATENCY_AVERAGE\n Appends the given content to the specified file. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/throughput.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/throughput.csv</a>'. ${throughput_results_file} THROUGHPUT_MIN,THROUGHPUT_MAX,THROUGHPUT_AVERAGE\n Appends the given content to the specified file. ${duration_in_ms} = 60000 ${duration_in_ms} ${duration_in_secs} * 1000 Evaluates the given expression in Python and returns the result. ${duration_in_ms} = 60000 ${duration_in_ms} Makes a variable available everywhere within the scope of the current suite. ${test_timeout} = 900.0 ${test_timeout} (${loops} * ${duration_in_secs}) * 1.5 Evaluates the given expression in Python and returns the result. ${test_timeout} = 900.0 ${test_timeout} Makes a variable available everywhere within the scope of the current suite. ${cbench_executable} Fails unless the given ``path`` points to an existing file. ${conn_id} = 2 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.90:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Wed May 13 00:44:56 UTC 2026 System load: 0.08 Processes: 110 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.90 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. [?2004h[jenkins@releng-63164-239-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. [chan 1] Opened sftp connection (server version 3) ${file} Fails if the given ``path`` does NOT point to an existing file. Closes the current connection. ${cbench_system} ${cbench_executable} Will create connection with public key and will PASS if the given ${file} exists, otherwise will FAIL ${loops} >= 2 If number of loops is less than 2, cbench will not run Fails if the given condition is not true. Not A Karaf App Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.51:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>feature:list -i | 0[C 0g[Krep odl-openflowplugin-drop-test ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.3 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.3 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.3 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.3 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} feature:list -i | grep ${feature_name} ${controller} ${karaf_port} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.51 Note that this keyword will open&close new SSH connection, without switching back to previously current session. ${output} ${feature_name} Fails if ``container`` does not contain ``item`` one or more times. ${output} odl-openflowplugin-drop-test Will Succeed if the given ${feature_name} is found in the output of "feature:list -i" Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.51:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>dropallpacketsrpc on ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} dropallpacketsrpc on Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.51 Note that this keyword will open&close new SSH connection, without switching back to previously current session. Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = latency.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.51 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.90" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 5 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.90:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Wed May 13 00:44:56 UTC 2026 System load: 0.08 Processes: 110 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.90 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Wed May 13 00:44:56 2026 from 10.30.170.123 [?2004h[jenkins@releng-63164-239-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.51 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.51:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.51:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.51. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:46:02.927 16 switches: flows: 111948 112349 114020 110516 110933 109586 108830 111070 108047 108266 107522 106383 108663 106150 107947 104954 total = 29.119733 per ms 00:47:03.028 16 switches: flows: 124885 124702 127172 126937 125200 125460 122180 124193 121192 121294 119798 120441 122380 120060 121840 118442 total = 32.715000 per ms 00:48:03.129 16 switches: flows: 114574 114880 114567 116186 115112 114821 114438 113867 109872 111498 109998 110440 111741 110403 109711 109057 total = 29.969367 per ms 00:49:03.230 16 switches: flows: 123874 124518 126456 124752 122802 125418 123583 123707 120574 118458 119164 119362 120963 120889 120121 117692 total = 32.484643 per ms 00:50:03.331 16 switches: flows: 126470 125595 127199 129458 123688 126547 125391 126527 121543 120564 120245 120667 122895 121209 120492 119845 total = 32.917245 per ms 00:51:03.432 16 switches: flows: 128864 129744 129192 128926 125586 129749 128340 129450 124781 123480 123679 124113 124356 123329 124460 121418 total = 33.601641 per ms 00:52:03.533 16 switches: flows: 129151 129300 129427 130203 127365 130280 128167 129672 124981 124724 125351 124036 125905 123731 123825 120627 total = 33.722769 per ms 00:53:03.634 16 switches: flows: 131165 131179 130488 131648 130108 132295 129575 131398 124783 126381 128158 125005 127619 126423 124391 122506 total = 34.161657 per ms 00:54:03.735 16 switches: flows: 127676 128882 126937 129765 128139 128585 124611 129238 122262 123180 124669 123542 123324 122467 123198 120156 total = 33.388096 per ms 00:55:03.836 16 switches: flows: 128447 130145 129945 131504 130070 130351 127975 132007 125131 127150 126451 124411 126238 124220 125072 122069 total = 33.963065 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 29969.37/34161.66/32991.50/11061.89 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.51:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.51:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.51. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:46:02.927 16 switches: flows: 111948 112349 114020 110516 110933 109586 108830 111070 108047 108266 107522 106383 108663 106150 107947 104954 total = 29.119733 per ms 00:47:03.028 16 switches: flows: 124885 124702 127172 126937 125200 125460 122180 124193 121192 121294 119798 120441 122380 120060 121840 118442 total = 32.715000 per ms 00:48:03.129 16 switches: flows: 114574 114880 114567 116186 115112 114821 114438 113867 109872 111498 109998 110440 111741 110403 109711 109057 total = 29.969367 per ms 00:49:03.230 16 switches: flows: 123874 124518 126456 124752 122802 125418 123583 123707 120574 118458 119164 119362 120963 120889 120121 117692 total = 32.484643 per ms 00:50:03.331 16 switches: flows: 126470 125595 127199 129458 123688 126547 125391 126527 121543 120564 120245 120667 122895 121209 120492 119845 total = 32.917245 per ms 00:51:03.432 16 switches: flows: 128864 129744 129192 128926 125586 129749 128340 129450 124781 123480 123679 124113 124356 123329 124460 121418 total = 33.601641 per ms 00:52:03.533 16 switches: flows: 129151 129300 129427 130203 127365 130280 128167 129672 124981 124724 125351 124036 125905 123731 123825 120627 total = 33.722769 per ms 00:53:03.634 16 switches: flows: 131165 131179 130488 131648 130108 132295 129575 131398 124783 126381 128158 125005 127619 126423 124391 122506 total = 34.161657 per ms 00:54:03.735 16 switches: flows: 127676 128882 126937 129765 128139 128585 124611 129238 122262 123180 124669 123542 123324 122467 123198 120156 total = 33.388096 per ms 00:55:03.836 16 switches: flows: 128447 130145 129945 131504 130070 130351 127975 132007 125131 127150 126451 124411 126238 124220 125072 122069 total = 33.963065 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 29969.37/34161.66/32991.50/11061.89 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 29969.37/34161.66/32991.50/11061.89 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 29969.37/34161.66/32991.50/11061.89 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 29969.37/34161.66/32991.50/11061.89 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 29969.37 | 34161.66 | 32991.50 | 11061.89 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 29969.37 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 34161.66 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 32991.50 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 11061.89 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 29969.37 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 34161.66 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 32991.50 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 11061.89 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-05-13 00:55:03 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-05-13 00:55:03,-m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,29969.37,34161.66,32991.50,11061.89 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/latency.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/latency.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} ${latency_results_file} Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in default latency mode. Test parameters have defaults, but can be overridden on the pybot command line cbench latency Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = throughput.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.51 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.90" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 7 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.90:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Wed May 13 00:55:04 UTC 2026 System load: 1.0 Processes: 105 Usage of /: 19.5% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.90 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Wed May 13 00:44:57 2026 from 10.30.170.123 [?2004h[jenkins@releng-63164-239-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.51 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.51:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with ... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.51:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.51. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:56:09.635 16 switches: flows: 573229 570222 559318 565658 565601 567288 570521 567202 551207 552412 544837 550700 565895 553174 542727 563956 total = 149.399117 per ms 00:57:09.737 16 switches: flows: 587682 578456 585958 579178 587738 581644 591714 579875 589365 596762 575027 576215 577307 591185 582748 578106 total = 155.386528 per ms 00:58:09.839 16 switches: flows: 631842 630751 626434 634809 630433 629164 633997 633926 629474 630815 630423 626111 627434 623612 630343 620382 total = 167.550030 per ms 00:59:09.942 16 switches: flows: 639274 621469 628321 637616 627402 637048 634192 652823 639936 649289 645997 634015 656019 637113 641229 624477 total = 169.810867 per ms 01:00:10.044 16 switches: flows: 669477 673905 675428 673381 679476 652501 668724 673099 672472 661417 666724 674787 669281 664441 672282 658344 total = 178.129666 per ms 01:01:10.158 16 switches: flows: 606481 585029 597615 581990 596563 439309 583299 579536 444849 590248 437175 580641 583051 588193 591231 597568 total = 149.427809 per ms 01:02:10.260 16 switches: flows: 677859 669798 673849 663568 661286 648956 667720 667025 658566 671306 654180 663916 672958 669933 654832 666531 total = 177.072361 per ms 01:03:10.606 16 switches: flows: 641141 627609 621189 636038 639090 623747 631009 630711 634712 623017 631625 639558 638140 633071 636117 634035 total = 167.712741 per ms 01:04:10.707 16 switches: flows: 554940 558668 559709 550612 563648 552672 564972 539108 555445 538129 541314 545614 550626 547955 551209 547047 total = 146.780871 per ms 01:05:10.809 16 switches: flows: 652617 627560 638450 633515 634845 622496 638366 631173 627855 647965 636816 625014 637426 636251 632853 648624 total = 169.244897 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 146780.87/178129.67/164568.42/55897.82 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.51:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with ... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.51:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.51. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:56:09.635 16 switches: flows: 573229 570222 559318 565658 565601 567288 570521 567202 551207 552412 544837 550700 565895 553174 542727 563956 total = 149.399117 per ms 00:57:09.737 16 switches: flows: 587682 578456 585958 579178 587738 581644 591714 579875 589365 596762 575027 576215 577307 591185 582748 578106 total = 155.386528 per ms 00:58:09.839 16 switches: flows: 631842 630751 626434 634809 630433 629164 633997 633926 629474 630815 630423 626111 627434 623612 630343 620382 total = 167.550030 per ms 00:59:09.942 16 switches: flows: 639274 621469 628321 637616 627402 637048 634192 652823 639936 649289 645997 634015 656019 637113 641229 624477 total = 169.810867 per ms 01:00:10.044 16 switches: flows: 669477 673905 675428 673381 679476 652501 668724 673099 672472 661417 666724 674787 669281 664441 672282 658344 total = 178.129666 per ms 01:01:10.158 16 switches: flows: 606481 585029 597615 581990 596563 439309 583299 579536 444849 590248 437175 580641 583051 588193 591231 597568 total = 149.427809 per ms 01:02:10.260 16 switches: flows: 677859 669798 673849 663568 661286 648956 667720 667025 658566 671306 654180 663916 672958 669933 654832 666531 total = 177.072361 per ms 01:03:10.606 16 switches: flows: 641141 627609 621189 636038 639090 623747 631009 630711 634712 623017 631625 639558 638140 633071 636117 634035 total = 167.712741 per ms 01:04:10.707 16 switches: flows: 554940 558668 559709 550612 563648 552672 564972 539108 555445 538129 541314 545614 550626 547955 551209 547047 total = 146.780871 per ms 01:05:10.809 16 switches: flows: 652617 627560 638450 633515 634845 622496 638366 631173 627855 647965 636816 625014 637426 636251 632853 648624 total = 169.244897 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 146780.87/178129.67/164568.42/55897.82 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 146780.87/178129.67/164568.42/55897.82 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 146780.87/178129.67/164568.42/55897.82 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 146780.87/178129.67/164568.42/55897.82 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 146780.87 | 178129.67 | 164568.42 | 55897.82 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 146780.87 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 178129.67 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 164568.42 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 55897.82 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 146780.87 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 178129.67 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 164568.42 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 55897.82 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-05-13 01:05:10 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-05-13 01:05:10,-t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,146780.87,178129.67,164568.42,55897.82 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/throughput.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/throughput.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -t -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${throughput_threshold} ${throughput_results_file} Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in throughput mode (-t). Test parameters have defaults, but can be overridden on the pybot command line cbench throughput Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = bug.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.51 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.90" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 9 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.90:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Wed May 13 01:05:11 UTC 2026 System load: 0.3 Processes: 104 Usage of /: 19.5% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.90 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Wed May 13 00:55:04 2026 from 10.30.170.123 [?2004h[jenkins@releng-63164-239-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.51 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.51:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.51:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.51. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 01:06:16.744 16 switches: flows: 109339 109079 113444 109557 110748 109840 110276 110559 109972 128329 111187 108432 111340 108349 107480 121490 total = 29.823683 per ms 01:07:16.844 16 switches: flows: 112887 113446 116494 112180 113245 112795 113643 114813 111871 111353 112904 112955 113565 111953 111663 112261 total = 30.083582 per ms 01:08:16.945 16 switches: flows: 111213 110125 111957 111039 108992 111507 110211 112054 111823 109511 109334 112532 110379 109241 109407 109581 total = 29.432602 per ms 01:09:17.047 16 switches: flows: 126618 125260 127759 125596 124817 127941 124696 125791 126822 126303 126127 126016 125654 122223 122749 123489 total = 33.408593 per ms 01:10:17.147 16 switches: flows: 130075 129192 134702 130746 130319 133925 128731 132937 132022 130642 129097 130970 131576 126598 129679 125847 total = 34.726337 per ms 01:11:17.248 16 switches: flows: 126750 128053 130565 127143 125977 128642 128734 129240 126878 127756 127697 129994 126699 122860 124971 123059 total = 33.860461 per ms 01:12:17.389 16 switches: flows: 118957 118893 121342 118685 116324 119589 118921 119740 117869 116839 118107 117436 117691 115799 115706 116115 total = 31.393687 per ms 01:13:17.490 16 switches: flows: 120546 121980 123082 121650 121255 123675 121226 123712 121038 119116 121104 121139 120219 117658 118558 116831 total = 32.159462 per ms 01:14:17.590 16 switches: flows: 124222 123770 123966 122561 122731 123574 123237 123852 120102 121664 121350 121847 120383 117795 118703 117551 total = 32.400990 per ms 01:15:17.691 16 switches: flows: 123590 122185 124896 121716 122122 123271 122230 123982 121151 120785 120433 120577 119395 118228 118635 118348 total = 32.305006 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 29432.60/34726.34/32196.75/10852.91 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.51:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.51:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.51. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 01:06:16.744 16 switches: flows: 109339 109079 113444 109557 110748 109840 110276 110559 109972 128329 111187 108432 111340 108349 107480 121490 total = 29.823683 per ms 01:07:16.844 16 switches: flows: 112887 113446 116494 112180 113245 112795 113643 114813 111871 111353 112904 112955 113565 111953 111663 112261 total = 30.083582 per ms 01:08:16.945 16 switches: flows: 111213 110125 111957 111039 108992 111507 110211 112054 111823 109511 109334 112532 110379 109241 109407 109581 total = 29.432602 per ms 01:09:17.047 16 switches: flows: 126618 125260 127759 125596 124817 127941 124696 125791 126822 126303 126127 126016 125654 122223 122749 123489 total = 33.408593 per ms 01:10:17.147 16 switches: flows: 130075 129192 134702 130746 130319 133925 128731 132937 132022 130642 129097 130970 131576 126598 129679 125847 total = 34.726337 per ms 01:11:17.248 16 switches: flows: 126750 128053 130565 127143 125977 128642 128734 129240 126878 127756 127697 129994 126699 122860 124971 123059 total = 33.860461 per ms 01:12:17.389 16 switches: flows: 118957 118893 121342 118685 116324 119589 118921 119740 117869 116839 118107 117436 117691 115799 115706 116115 total = 31.393687 per ms 01:13:17.490 16 switches: flows: 120546 121980 123082 121650 121255 123675 121226 123712 121038 119116 121104 121139 120219 117658 118558 116831 total = 32.159462 per ms 01:14:17.590 16 switches: flows: 124222 123770 123966 122561 122731 123574 123237 123852 120102 121664 121350 121847 120383 117795 118703 117551 total = 32.400990 per ms 01:15:17.691 16 switches: flows: 123590 122185 124896 121716 122122 123271 122230 123982 121151 120785 120433 120577 119395 118228 118635 118348 total = 32.305006 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 29432.60/34726.34/32196.75/10852.91 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 29432.60/34726.34/32196.75/10852.91 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 29432.60/34726.34/32196.75/10852.91 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 29432.60/34726.34/32196.75/10852.91 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 29432.60 | 34726.34 | 32196.75 | 10852.91 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 29432.60 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 34726.34 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 32196.75 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 10852.91 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 29432.60 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 34726.34 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 32196.75 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 10852.91 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-05-13 01:15:17 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-05-13 01:15:17,-m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,29432.60,34726.34,32196.75,10852.91 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/bug.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/bug.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} bug.csv Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. ${test_skipped} = False ${test_skipped} len(re.findall('SKIPPED', """${TEST_MESSAGE}""")) > 0 modules=re Evaluates the given expression in Python and returns the result. Jira tickets are {PROJECT}-{NUMBER} while Bugzilla tickets are {NUMBER} Displays the given messages in the log file as keyword arguments. ${match} Should Contain ${number} - Runs the specified keyword and returns the status as a Boolean value. ${bug_url} ${match} https://jira.opendaylight.org/browse/${number} https://bugs.opendaylight.org/show_bug.cgi?id=${number} Sets variable based on the given condition. ${msg} This test fails due to ${bug_url} Returns the given values which can then be assigned to a variables. ${newline} chr(10) Evaluates the given expression in Python and returns the result. ${msg}${newline}${newline}${TEST_MESSAGE} Sets message for the current test case. ${msg} Logs the given message with the given level. ${bug_url} Adds given ``tags`` for the current test or all tests in a suite. 6176 Report that a test failed due to a known Bugzilla bug whose number is provided as an argument. Not FAILED (incl. SKIPPED) test are not reported. This keyword must be used in the [Teardown] setting of the affected test or as the first line of the test if FastFail module is not being used. It reports the URL of the bug on console and also puts it into the Robot log file. cbench executed in latency mode to see if controller is healthy cbench latency Cbench Latency and Throughput tests can be run from an external cbench. If cbench is run with a medium number of switches or higher (e.g. 32+) the normal openflow operations seem to break. BUG: https://bugs.opendaylight.org/show_bug.cgi?id=2897 All Tests cbench latency throughput openflowplugin-cbench.txt