Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.49:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>log:set ERROR ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} log:set ${log_level} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.49 Note that this keyword will open&close new SSH connection, without switching back to previously current session. 3x 1s KarafKeywords.Issue Command On Karaf Console log:set ${log_level} Runs the specified keyword and retries if it fails. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/latency.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/latency.csv</a>'. ${latency_results_file} LATENCY_MIN,LATENCY_MAX,LATENCY_AVERAGE\n Appends the given content to the specified file. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/throughput.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/throughput.csv</a>'. ${throughput_results_file} THROUGHPUT_MIN,THROUGHPUT_MAX,THROUGHPUT_AVERAGE\n Appends the given content to the specified file. ${duration_in_ms} = 60000 ${duration_in_ms} ${duration_in_secs} * 1000 Evaluates the given expression in Python and returns the result. ${duration_in_ms} = 60000 ${duration_in_ms} Makes a variable available everywhere within the scope of the current suite. ${test_timeout} = 900.0 ${test_timeout} (${loops} * ${duration_in_secs}) * 1.5 Evaluates the given expression in Python and returns the result. ${test_timeout} = 900.0 ${test_timeout} Makes a variable available everywhere within the scope of the current suite. ${cbench_executable} Fails unless the given ``path`` points to an existing file. ${conn_id} = 2 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.18:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Tue May 26 00:50:59 UTC 2026 System load: 0.03 Processes: 110 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.18 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. [?2004h[jenkins@releng-63164-265-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. [chan 1] Opened sftp connection (server version 3) ${file} Fails if the given ``path`` does NOT point to an existing file. Closes the current connection. ${cbench_system} ${cbench_executable} Will create connection with public key and will PASS if the given ${file} exists, otherwise will FAIL ${loops} >= 2 If number of loops is less than 2, cbench will not run Fails if the given condition is not true. Not A Karaf App Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.49:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>feature:list -i | 0[C 0g[Krep odl-openflowplugin-drop-test ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.3 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.3 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.3 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.3 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} feature:list -i | grep ${feature_name} ${controller} ${karaf_port} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.49 Note that this keyword will open&close new SSH connection, without switching back to previously current session. ${output} ${feature_name} Fails if ``container`` does not contain ``item`` one or more times. ${output} odl-openflowplugin-drop-test Will Succeed if the given ${feature_name} is found in the output of "feature:list -i" Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.49:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>dropallpacketsrpc on ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} dropallpacketsrpc on Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.49 Note that this keyword will open&close new SSH connection, without switching back to previously current session. Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = latency.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.49 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.18" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 5 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.18:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Tue May 26 00:50:59 UTC 2026 System load: 0.03 Processes: 110 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.18 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Tue May 26 00:50:59 2026 from 10.30.170.177 [?2004h[jenkins@releng-63164-265-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.49 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.49:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.49:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.49. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:52:06.153 16 switches: flows: 115041 115617 114327 113251 110286 113853 110746 110528 103249 104520 104715 103997 106151 104804 104896 105785 total = 29.029433 per ms 00:53:06.254 16 switches: flows: 127144 128541 129548 127142 122511 126089 124689 123437 115800 114573 116449 117658 118142 114984 117075 116145 total = 32.278210 per ms 00:54:06.355 16 switches: flows: 124089 123630 122659 121513 118448 121550 119156 120072 112385 112505 112637 111685 113403 113044 111838 112467 total = 31.132660 per ms 00:55:06.456 16 switches: flows: 131801 130745 128986 127322 123878 124943 124866 125001 117679 118658 119137 117374 120594 116924 117003 116631 total = 32.637840 per ms 00:56:06.556 16 switches: flows: 135729 131646 130691 128987 125352 126558 125559 126760 119037 118838 119464 119405 120816 118987 119215 119344 total = 33.051251 per ms 00:57:06.656 16 switches: flows: 136408 132717 130462 130553 127880 128598 129021 129218 121524 121442 122133 123094 125761 122337 121674 121356 total = 33.680052 per ms 00:58:06.757 16 switches: flows: 137894 135150 131361 131102 130660 129672 132211 130269 122960 122171 124014 124445 128219 125573 125030 122304 total = 34.160196 per ms 00:59:06.857 16 switches: flows: 138720 135588 132447 131927 131995 132068 133583 132800 124556 124900 126751 127302 129125 127514 127245 124447 total = 34.624936 per ms 01:00:06.958 16 switches: flows: 138229 135477 131798 132533 130524 131554 132940 132306 123932 126939 128373 127507 128894 127367 127798 123961 total = 34.610991 per ms 01:01:07.058 16 switches: flows: 137059 133544 131829 130350 131070 130270 129784 130070 123016 124686 126577 126642 126060 126601 124992 123236 total = 34.205945 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 31132.66/34624.94/33375.79/11181.89 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.49:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.49:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.49. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:52:06.153 16 switches: flows: 115041 115617 114327 113251 110286 113853 110746 110528 103249 104520 104715 103997 106151 104804 104896 105785 total = 29.029433 per ms 00:53:06.254 16 switches: flows: 127144 128541 129548 127142 122511 126089 124689 123437 115800 114573 116449 117658 118142 114984 117075 116145 total = 32.278210 per ms 00:54:06.355 16 switches: flows: 124089 123630 122659 121513 118448 121550 119156 120072 112385 112505 112637 111685 113403 113044 111838 112467 total = 31.132660 per ms 00:55:06.456 16 switches: flows: 131801 130745 128986 127322 123878 124943 124866 125001 117679 118658 119137 117374 120594 116924 117003 116631 total = 32.637840 per ms 00:56:06.556 16 switches: flows: 135729 131646 130691 128987 125352 126558 125559 126760 119037 118838 119464 119405 120816 118987 119215 119344 total = 33.051251 per ms 00:57:06.656 16 switches: flows: 136408 132717 130462 130553 127880 128598 129021 129218 121524 121442 122133 123094 125761 122337 121674 121356 total = 33.680052 per ms 00:58:06.757 16 switches: flows: 137894 135150 131361 131102 130660 129672 132211 130269 122960 122171 124014 124445 128219 125573 125030 122304 total = 34.160196 per ms 00:59:06.857 16 switches: flows: 138720 135588 132447 131927 131995 132068 133583 132800 124556 124900 126751 127302 129125 127514 127245 124447 total = 34.624936 per ms 01:00:06.958 16 switches: flows: 138229 135477 131798 132533 130524 131554 132940 132306 123932 126939 128373 127507 128894 127367 127798 123961 total = 34.610991 per ms 01:01:07.058 16 switches: flows: 137059 133544 131829 130350 131070 130270 129784 130070 123016 124686 126577 126642 126060 126601 124992 123236 total = 34.205945 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 31132.66/34624.94/33375.79/11181.89 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 31132.66/34624.94/33375.79/11181.89 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 31132.66/34624.94/33375.79/11181.89 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 31132.66/34624.94/33375.79/11181.89 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 31132.66 | 34624.94 | 33375.79 | 11181.89 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 31132.66 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 34624.94 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 33375.79 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 11181.89 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 31132.66 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 34624.94 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 33375.79 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 11181.89 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-05-26 01:01:07 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-05-26 01:01:07,-m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,31132.66,34624.94,33375.79,11181.89 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/latency.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/latency.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} ${latency_results_file} Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in default latency mode. Test parameters have defaults, but can be overridden on the pybot command line cbench latency Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = throughput.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.49 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.18" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 7 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.18:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Tue May 26 01:01:07 UTC 2026 System load: 1.01 Processes: 104 Usage of /: 19.7% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.18 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Tue May 26 00:51:00 2026 from 10.30.170.177 [?2004h[jenkins@releng-63164-265-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.49 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.49:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with ... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.49:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.49. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 01:02:12.876 16 switches: flows: 529677 524699 536039 522125 533209 525299 535269 527605 527689 520502 527620 511064 514543 526389 524924 518348 total = 140.083350 per ms 01:03:13.017 16 switches: flows: 527625 530621 534131 532024 536989 532979 530506 535889 529504 530203 527817 533336 534141 540243 539457 527922 total = 141.722370 per ms 01:04:13.119 16 switches: flows: 607779 603039 607024 601632 603960 604720 594883 602302 605761 608298 611522 609120 602561 610960 606934 597040 total = 161.020999 per ms 01:05:13.220 16 switches: flows: 581183 583189 582790 578980 579390 584949 581639 586356 578583 590125 587265 583420 572344 586534 585598 581080 total = 155.129848 per ms 01:06:13.321 16 switches: flows: 570065 568845 570126 579833 566251 567483 566259 568094 572420 570033 575364 567034 573304 566589 566071 569060 total = 151.691563 per ms 01:07:13.422 16 switches: flows: 601231 596590 597901 609376 599239 607559 601258 579885 599066 605755 604525 603250 601591 601418 600828 590352 total = 159.728427 per ms 01:08:13.524 16 switches: flows: 600066 611854 611470 623266 613786 614227 614415 621014 618359 614071 613471 616373 619989 616166 605662 616686 total = 163.572118 per ms 01:09:13.626 16 switches: flows: 589779 594464 586946 598353 590421 596637 582844 586396 586582 590818 589439 593723 595656 584481 590546 592208 total = 157.223876 per ms 01:10:13.727 16 switches: flows: 594486 612902 611190 606088 597217 605210 606353 605154 605579 611468 605870 613091 608216 601533 605948 603395 total = 161.290113 per ms 01:11:13.828 16 switches: flows: 588752 584093 589681 594010 587277 590808 589555 584911 596200 582361 592729 580063 594875 586137 585077 587247 total = 156.634304 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 141722.37/163572.12/156445.96/52517.78 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.49:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with ... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.49:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.49. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 01:02:12.876 16 switches: flows: 529677 524699 536039 522125 533209 525299 535269 527605 527689 520502 527620 511064 514543 526389 524924 518348 total = 140.083350 per ms 01:03:13.017 16 switches: flows: 527625 530621 534131 532024 536989 532979 530506 535889 529504 530203 527817 533336 534141 540243 539457 527922 total = 141.722370 per ms 01:04:13.119 16 switches: flows: 607779 603039 607024 601632 603960 604720 594883 602302 605761 608298 611522 609120 602561 610960 606934 597040 total = 161.020999 per ms 01:05:13.220 16 switches: flows: 581183 583189 582790 578980 579390 584949 581639 586356 578583 590125 587265 583420 572344 586534 585598 581080 total = 155.129848 per ms 01:06:13.321 16 switches: flows: 570065 568845 570126 579833 566251 567483 566259 568094 572420 570033 575364 567034 573304 566589 566071 569060 total = 151.691563 per ms 01:07:13.422 16 switches: flows: 601231 596590 597901 609376 599239 607559 601258 579885 599066 605755 604525 603250 601591 601418 600828 590352 total = 159.728427 per ms 01:08:13.524 16 switches: flows: 600066 611854 611470 623266 613786 614227 614415 621014 618359 614071 613471 616373 619989 616166 605662 616686 total = 163.572118 per ms 01:09:13.626 16 switches: flows: 589779 594464 586946 598353 590421 596637 582844 586396 586582 590818 589439 593723 595656 584481 590546 592208 total = 157.223876 per ms 01:10:13.727 16 switches: flows: 594486 612902 611190 606088 597217 605210 606353 605154 605579 611468 605870 613091 608216 601533 605948 603395 total = 161.290113 per ms 01:11:13.828 16 switches: flows: 588752 584093 589681 594010 587277 590808 589555 584911 596200 582361 592729 580063 594875 586137 585077 587247 total = 156.634304 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 141722.37/163572.12/156445.96/52517.78 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 141722.37/163572.12/156445.96/52517.78 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 141722.37/163572.12/156445.96/52517.78 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 141722.37/163572.12/156445.96/52517.78 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 141722.37 | 163572.12 | 156445.96 | 52517.78 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 141722.37 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 163572.12 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 156445.96 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 52517.78 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 141722.37 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 163572.12 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 156445.96 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 52517.78 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-05-26 01:11:13 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-05-26 01:11:13,-t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,141722.37,163572.12,156445.96,52517.78 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/throughput.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/throughput.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -t -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${throughput_threshold} ${throughput_results_file} Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in throughput mode (-t). Test parameters have defaults, but can be overridden on the pybot command line cbench throughput Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = bug.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.49 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.18" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 9 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.18:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Tue May 26 01:11:14 UTC 2026 System load: 0.48 Processes: 105 Usage of /: 19.7% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.18 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Tue May 26 01:01:07 2026 from 10.30.170.177 [?2004h[jenkins@releng-63164-265-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.49 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.49:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.49:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.49. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 01:12:19.663 16 switches: flows: 130405 131053 130612 129789 130871 129409 129174 130937 128441 125278 125293 123803 125827 124223 124112 126760 total = 34.099783 per ms 01:13:19.764 16 switches: flows: 136431 136426 136209 134943 133254 134875 135363 130651 131545 129841 130379 130605 130333 132282 130154 129656 total = 35.323447 per ms 01:14:19.866 16 switches: flows: 137998 137267 136305 134908 134385 132448 137216 132365 132101 129938 130261 130859 131905 133035 130037 129803 total = 35.454597 per ms 01:15:19.967 16 switches: flows: 139641 135274 135060 134232 133969 133492 136549 132356 132408 127332 128827 130163 131658 131263 129716 131063 total = 35.324354 per ms 01:16:20.069 16 switches: flows: 134971 133401 132589 131990 130782 131374 135243 128794 126474 126424 126009 126812 129760 130554 127654 126918 total = 34.604498 per ms 01:17:20.170 16 switches: flows: 133928 132082 130823 131965 130673 130273 133372 130563 126503 126644 126127 127427 127951 129845 126256 128748 total = 34.495116 per ms 01:18:20.271 16 switches: flows: 137612 135408 135255 135728 134675 133407 136449 131647 131604 130332 130739 129662 133158 131737 130014 130735 total = 35.410220 per ms 01:19:20.372 16 switches: flows: 137904 134456 133890 134948 131879 132484 134915 132492 131682 128770 129302 130432 130901 132316 129526 130573 total = 35.215673 per ms 01:20:20.473 16 switches: flows: 140095 138542 138220 139227 135740 135738 138214 133010 133529 133096 132714 131576 134349 134827 132279 131753 total = 35.988335 per ms 01:21:20.575 16 switches: flows: 141633 137624 137534 138144 135676 139095 140798 135411 135718 132229 133162 132799 135770 135839 134317 134558 total = 36.277697 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 34495.12/36277.70/35343.77/11793.46 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.49:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.49:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.49. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 01:12:19.663 16 switches: flows: 130405 131053 130612 129789 130871 129409 129174 130937 128441 125278 125293 123803 125827 124223 124112 126760 total = 34.099783 per ms 01:13:19.764 16 switches: flows: 136431 136426 136209 134943 133254 134875 135363 130651 131545 129841 130379 130605 130333 132282 130154 129656 total = 35.323447 per ms 01:14:19.866 16 switches: flows: 137998 137267 136305 134908 134385 132448 137216 132365 132101 129938 130261 130859 131905 133035 130037 129803 total = 35.454597 per ms 01:15:19.967 16 switches: flows: 139641 135274 135060 134232 133969 133492 136549 132356 132408 127332 128827 130163 131658 131263 129716 131063 total = 35.324354 per ms 01:16:20.069 16 switches: flows: 134971 133401 132589 131990 130782 131374 135243 128794 126474 126424 126009 126812 129760 130554 127654 126918 total = 34.604498 per ms 01:17:20.170 16 switches: flows: 133928 132082 130823 131965 130673 130273 133372 130563 126503 126644 126127 127427 127951 129845 126256 128748 total = 34.495116 per ms 01:18:20.271 16 switches: flows: 137612 135408 135255 135728 134675 133407 136449 131647 131604 130332 130739 129662 133158 131737 130014 130735 total = 35.410220 per ms 01:19:20.372 16 switches: flows: 137904 134456 133890 134948 131879 132484 134915 132492 131682 128770 129302 130432 130901 132316 129526 130573 total = 35.215673 per ms 01:20:20.473 16 switches: flows: 140095 138542 138220 139227 135740 135738 138214 133010 133529 133096 132714 131576 134349 134827 132279 131753 total = 35.988335 per ms 01:21:20.575 16 switches: flows: 141633 137624 137534 138144 135676 139095 140798 135411 135718 132229 133162 132799 135770 135839 134317 134558 total = 36.277697 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 34495.12/36277.70/35343.77/11793.46 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 34495.12/36277.70/35343.77/11793.46 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 34495.12/36277.70/35343.77/11793.46 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 34495.12/36277.70/35343.77/11793.46 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 34495.12 | 36277.70 | 35343.77 | 11793.46 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 34495.12 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 36277.70 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 35343.77 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 11793.46 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 34495.12 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 36277.70 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 35343.77 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 11793.46 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-05-26 01:21:20 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-05-26 01:21:20,-m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,34495.12,36277.70,35343.77,11793.46 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/bug.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/bug.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} bug.csv Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. ${test_skipped} = False ${test_skipped} len(re.findall('SKIPPED', """${TEST_MESSAGE}""")) > 0 modules=re Evaluates the given expression in Python and returns the result. Jira tickets are {PROJECT}-{NUMBER} while Bugzilla tickets are {NUMBER} Displays the given messages in the log file as keyword arguments. ${match} Should Contain ${number} - Runs the specified keyword and returns the status as a Boolean value. ${bug_url} ${match} https://jira.opendaylight.org/browse/${number} https://bugs.opendaylight.org/show_bug.cgi?id=${number} Sets variable based on the given condition. ${msg} This test fails due to ${bug_url} Returns the given values which can then be assigned to a variables. ${newline} chr(10) Evaluates the given expression in Python and returns the result. ${msg}${newline}${newline}${TEST_MESSAGE} Sets message for the current test case. ${msg} Logs the given message with the given level. ${bug_url} Adds given ``tags`` for the current test or all tests in a suite. 6176 Report that a test failed due to a known Bugzilla bug whose number is provided as an argument. Not FAILED (incl. SKIPPED) test are not reported. This keyword must be used in the [Teardown] setting of the affected test or as the first line of the test if FastFail module is not being used. It reports the URL of the bug on console and also puts it into the Robot log file. cbench executed in latency mode to see if controller is healthy cbench latency Cbench Latency and Throughput tests can be run from an external cbench. If cbench is run with a medium number of switches or higher (e.g. 32+) the normal openflow operations seem to break. BUG: https://bugs.opendaylight.org/show_bug.cgi?id=2897 All Tests cbench latency throughput openflowplugin-cbench.txt