Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.170.28:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>log:set ERROR ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} log:set ${log_level} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.170.28 Note that this keyword will open&close new SSH connection, without switching back to previously current session. 3x 1s KarafKeywords.Issue Command On Karaf Console log:set ${log_level} Runs the specified keyword and retries if it fails. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/latency.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/latency.csv</a>'. ${latency_results_file} LATENCY_MIN,LATENCY_MAX,LATENCY_AVERAGE\n Appends the given content to the specified file. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/throughput.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/throughput.csv</a>'. ${throughput_results_file} THROUGHPUT_MIN,THROUGHPUT_MAX,THROUGHPUT_AVERAGE\n Appends the given content to the specified file. ${duration_in_ms} = 60000 ${duration_in_ms} ${duration_in_secs} * 1000 Evaluates the given expression in Python and returns the result. ${duration_in_ms} = 60000 ${duration_in_ms} Makes a variable available everywhere within the scope of the current suite. ${test_timeout} = 900.0 ${test_timeout} (${loops} * ${duration_in_secs}) * 1.5 Evaluates the given expression in Python and returns the result. ${test_timeout} = 900.0 ${test_timeout} Makes a variable available everywhere within the scope of the current suite. ${cbench_executable} Fails unless the given ``path`` points to an existing file. ${conn_id} = 2 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.171.157:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Tue May 19 02:55:02 UTC 2026 System load: 0.03 Processes: 113 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.171.157 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. [?2004h[jenkins@releng-63164-252-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. [chan 1] Opened sftp connection (server version 3) ${file} Fails if the given ``path`` does NOT point to an existing file. Closes the current connection. ${cbench_system} ${cbench_executable} Will create connection with public key and will PASS if the given ${file} exists, otherwise will FAIL ${loops} >= 2 If number of loops is less than 2, cbench will not run Fails if the given condition is not true. Not A Karaf App Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.170.28:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>feature:list -i | 0[C 0g[Krep odl-openflowplugin-drop-test ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.2 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.2 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.2 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.2 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} feature:list -i | grep ${feature_name} ${controller} ${karaf_port} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.170.28 Note that this keyword will open&close new SSH connection, without switching back to previously current session. ${output} ${feature_name} Fails if ``container`` does not contain ``item`` one or more times. ${output} odl-openflowplugin-drop-test Will Succeed if the given ${feature_name} is found in the output of "feature:list -i" Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.170.28:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>dropallpacketsrpc on ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} dropallpacketsrpc on Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.170.28 Note that this keyword will open&close new SSH connection, without switching back to previously current session. Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = latency.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.170.28 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.171.157" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 5 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.171.157:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Tue May 19 02:55:02 UTC 2026 System load: 0.03 Processes: 113 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.171.157 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Tue May 19 02:55:03 2026 from 10.30.171.8 [?2004h[jenkins@releng-63164-252-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.170.28 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.28:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.28:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.28. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:56:09.108 16 switches: flows: 104272 104827 104778 103956 102578 104008 102601 102433 100854 100309 99697 99045 99842 98601 100649 99953 total = 27.140050 per ms 02:57:09.208 16 switches: flows: 123484 123352 125497 125247 121578 122364 121274 122984 119802 119411 117567 118062 119556 116107 118101 117209 total = 32.139571 per ms 02:58:09.308 16 switches: flows: 120252 118729 121767 121610 117256 120575 120536 118783 115706 114900 114031 116048 115651 114877 115468 114141 total = 31.286458 per ms 02:59:09.409 16 switches: flows: 118581 118122 118975 119001 115102 117344 116500 117876 114039 113614 111069 112022 113182 112085 111846 112254 total = 30.642361 per ms 03:00:09.509 16 switches: flows: 114668 115978 115938 116357 113483 113682 115141 113825 111110 110609 108162 110118 112004 107868 108993 109269 total = 29.903509 per ms 03:01:09.609 16 switches: flows: 121996 123128 124401 124211 121021 119407 123025 120706 117573 116573 116245 115810 116555 114939 116534 118224 total = 31.786055 per ms 03:02:09.709 16 switches: flows: 108511 108312 108870 108886 106881 106569 106538 106051 103742 104678 101440 102786 102117 102901 103109 102462 total = 28.017445 per ms 03:03:09.810 16 switches: flows: 122788 122867 122644 121047 119237 121051 119190 121060 115846 115616 114397 116259 114300 115222 116738 115987 total = 31.518141 per ms 03:04:09.910 16 switches: flows: 120464 119501 120601 117174 117294 119615 117822 116773 112779 112974 111803 114545 112244 111631 115826 111828 total = 30.829586 per ms 03:05:10.011 16 switches: flows: 123947 122722 123393 121251 119901 122054 118989 120796 115681 115290 114312 117718 114569 114710 118158 115547 total = 31.597901 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 28017.44/32139.57/30857.89/10354.32 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.28:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.28:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.28. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:56:09.108 16 switches: flows: 104272 104827 104778 103956 102578 104008 102601 102433 100854 100309 99697 99045 99842 98601 100649 99953 total = 27.140050 per ms 02:57:09.208 16 switches: flows: 123484 123352 125497 125247 121578 122364 121274 122984 119802 119411 117567 118062 119556 116107 118101 117209 total = 32.139571 per ms 02:58:09.308 16 switches: flows: 120252 118729 121767 121610 117256 120575 120536 118783 115706 114900 114031 116048 115651 114877 115468 114141 total = 31.286458 per ms 02:59:09.409 16 switches: flows: 118581 118122 118975 119001 115102 117344 116500 117876 114039 113614 111069 112022 113182 112085 111846 112254 total = 30.642361 per ms 03:00:09.509 16 switches: flows: 114668 115978 115938 116357 113483 113682 115141 113825 111110 110609 108162 110118 112004 107868 108993 109269 total = 29.903509 per ms 03:01:09.609 16 switches: flows: 121996 123128 124401 124211 121021 119407 123025 120706 117573 116573 116245 115810 116555 114939 116534 118224 total = 31.786055 per ms 03:02:09.709 16 switches: flows: 108511 108312 108870 108886 106881 106569 106538 106051 103742 104678 101440 102786 102117 102901 103109 102462 total = 28.017445 per ms 03:03:09.810 16 switches: flows: 122788 122867 122644 121047 119237 121051 119190 121060 115846 115616 114397 116259 114300 115222 116738 115987 total = 31.518141 per ms 03:04:09.910 16 switches: flows: 120464 119501 120601 117174 117294 119615 117822 116773 112779 112974 111803 114545 112244 111631 115826 111828 total = 30.829586 per ms 03:05:10.011 16 switches: flows: 123947 122722 123393 121251 119901 122054 118989 120796 115681 115290 114312 117718 114569 114710 118158 115547 total = 31.597901 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 28017.44/32139.57/30857.89/10354.32 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 28017.44/32139.57/30857.89/10354.32 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 28017.44/32139.57/30857.89/10354.32 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 28017.44/32139.57/30857.89/10354.32 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 28017.44 | 32139.57 | 30857.89 | 10354.32 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 28017.44 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 32139.57 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 30857.89 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 10354.32 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 28017.44 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 32139.57 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 30857.89 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 10354.32 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-05-19 03:05:10 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-05-19 03:05:10,-m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,28017.44,32139.57,30857.89,10354.32 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/latency.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/latency.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} ${latency_results_file} Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in default latency mode. Test parameters have defaults, but can be overridden on the pybot command line cbench latency Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = throughput.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.170.28 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.171.157" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 7 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.171.157:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Tue May 19 03:05:10 UTC 2026 System load: 1.0 Processes: 104 Usage of /: 19.5% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.171.157 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Tue May 19 02:55:03 2026 from 10.30.171.8 [?2004h[jenkins@releng-63164-252-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.170.28 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.28:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with ... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.28:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.28. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 03:06:15.839 16 switches: flows: 532428 535696 535633 536751 547373 526280 532355 545347 524889 525533 516482 531172 527710 523166 528151 510594 total = 141.326000 per ms 03:07:15.942 16 switches: flows: 581737 599181 593008 596196 592697 588568 593280 592873 603286 593534 583949 599318 594335 589292 602916 586033 total = 157.899048 per ms 03:08:16.043 16 switches: flows: 575786 583225 584089 583919 581040 586077 578668 576341 587848 587824 574876 572356 587481 584596 588965 584853 total = 155.038607 per ms 03:09:16.143 16 switches: flows: 504603 486756 490275 487356 499480 383678 494366 489663 497261 504022 498190 504323 501542 504507 493875 510443 total = 130.620870 per ms 03:10:16.244 16 switches: flows: 584298 583854 580456 581978 576278 587618 585839 573981 581829 572484 573004 550458 595164 582916 585119 586328 total = 154.432895 per ms 03:11:16.345 16 switches: flows: 523851 535763 527475 524478 539067 528151 524673 533232 531334 536369 532883 537158 530739 533898 543438 534022 total = 141.704307 per ms 03:12:16.448 16 switches: flows: 580813 588219 588106 591595 585069 587746 590982 587018 592479 594699 584696 589905 588165 590610 586662 589061 total = 156.665164 per ms 03:13:16.548 16 switches: flows: 575358 570655 564020 572841 566475 572317 578474 575029 569102 567502 549353 569505 570650 564991 560633 553496 total = 151.087067 per ms 03:14:16.651 16 switches: flows: 538846 539201 538275 556557 545980 541684 536782 552216 540033 541969 544142 533723 546142 552354 546404 545151 total = 144.742364 per ms 03:15:16.752 16 switches: flows: 512889 514864 509255 513025 515085 516732 515952 510380 523081 518997 517600 521607 517830 520149 525409 515436 total = 137.573280 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 130620.87/157899.05/147751.51/50071.60 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.28:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with ... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.28:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.28. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 03:06:15.839 16 switches: flows: 532428 535696 535633 536751 547373 526280 532355 545347 524889 525533 516482 531172 527710 523166 528151 510594 total = 141.326000 per ms 03:07:15.942 16 switches: flows: 581737 599181 593008 596196 592697 588568 593280 592873 603286 593534 583949 599318 594335 589292 602916 586033 total = 157.899048 per ms 03:08:16.043 16 switches: flows: 575786 583225 584089 583919 581040 586077 578668 576341 587848 587824 574876 572356 587481 584596 588965 584853 total = 155.038607 per ms 03:09:16.143 16 switches: flows: 504603 486756 490275 487356 499480 383678 494366 489663 497261 504022 498190 504323 501542 504507 493875 510443 total = 130.620870 per ms 03:10:16.244 16 switches: flows: 584298 583854 580456 581978 576278 587618 585839 573981 581829 572484 573004 550458 595164 582916 585119 586328 total = 154.432895 per ms 03:11:16.345 16 switches: flows: 523851 535763 527475 524478 539067 528151 524673 533232 531334 536369 532883 537158 530739 533898 543438 534022 total = 141.704307 per ms 03:12:16.448 16 switches: flows: 580813 588219 588106 591595 585069 587746 590982 587018 592479 594699 584696 589905 588165 590610 586662 589061 total = 156.665164 per ms 03:13:16.548 16 switches: flows: 575358 570655 564020 572841 566475 572317 578474 575029 569102 567502 549353 569505 570650 564991 560633 553496 total = 151.087067 per ms 03:14:16.651 16 switches: flows: 538846 539201 538275 556557 545980 541684 536782 552216 540033 541969 544142 533723 546142 552354 546404 545151 total = 144.742364 per ms 03:15:16.752 16 switches: flows: 512889 514864 509255 513025 515085 516732 515952 510380 523081 518997 517600 521607 517830 520149 525409 515436 total = 137.573280 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 130620.87/157899.05/147751.51/50071.60 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 130620.87/157899.05/147751.51/50071.60 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 130620.87/157899.05/147751.51/50071.60 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 130620.87/157899.05/147751.51/50071.60 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 130620.87 | 157899.05 | 147751.51 | 50071.60 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 130620.87 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 157899.05 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 147751.51 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 50071.60 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 130620.87 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 157899.05 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 147751.51 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 50071.60 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-05-19 03:15:16 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-05-19 03:15:16,-t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,130620.87,157899.05,147751.51,50071.60 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/throughput.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/throughput.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -t -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${throughput_threshold} ${throughput_results_file} Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in throughput mode (-t). Test parameters have defaults, but can be overridden on the pybot command line cbench throughput Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = bug.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.170.28 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.171.157" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 9 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.171.157:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Tue May 19 03:15:17 UTC 2026 System load: 0.28 Processes: 105 Usage of /: 19.5% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.171.157 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Tue May 19 03:05:10 2026 from 10.30.171.8 [?2004h[jenkins@releng-63164-252-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.170.28 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.28:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.28:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.28. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 03:16:22.637 16 switches: flows: 114985 114389 121392 112742 112964 113809 112486 116707 116828 127043 111056 118832 112664 114166 110662 113153 total = 30.731300 per ms 03:17:22.737 16 switches: flows: 123374 122601 125893 120511 122331 122484 120964 124340 122992 125001 120457 122787 122160 121938 120020 119632 total = 32.570376 per ms 03:18:22.837 16 switches: flows: 123449 122242 123353 121067 121726 122982 120923 125316 123463 123885 121656 122980 122764 121296 119355 119579 total = 32.546207 per ms 03:19:22.937 16 switches: flows: 122515 119933 122442 119411 120727 120829 120021 122577 122387 121867 119323 121158 122061 118955 118090 117297 total = 32.106306 per ms 03:20:23.038 16 switches: flows: 120495 118521 122183 117046 118632 120148 119194 121591 119334 119908 118097 119570 119629 117779 117436 117054 total = 31.723993 per ms 03:21:23.138 16 switches: flows: 118055 115536 119274 115780 116852 119837 118924 116351 118054 117310 116892 115805 116947 114705 115244 116272 total = 31.145180 per ms 03:22:23.239 16 switches: flows: 121774 119713 124078 120017 120217 121660 121078 122120 123063 121174 120591 120409 121473 120500 118446 119136 total = 32.203466 per ms 03:23:23.341 16 switches: flows: 122137 120395 123874 120305 122096 120814 120116 123983 123330 123957 119847 121292 120498 120704 119591 119783 total = 32.323912 per ms 03:24:23.441 16 switches: flows: 123943 121607 124297 122285 122224 123221 122399 123531 124527 124075 120061 123026 121889 121911 120664 119057 total = 32.590843 per ms 03:25:23.541 16 switches: flows: 121424 120475 124439 118084 120449 122644 123191 120919 121273 123891 120172 120058 121232 120440 120942 122158 total = 32.309255 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 31145.18/32590.84/32168.84/10732.15 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.28:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.28:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.28. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 03:16:22.637 16 switches: flows: 114985 114389 121392 112742 112964 113809 112486 116707 116828 127043 111056 118832 112664 114166 110662 113153 total = 30.731300 per ms 03:17:22.737 16 switches: flows: 123374 122601 125893 120511 122331 122484 120964 124340 122992 125001 120457 122787 122160 121938 120020 119632 total = 32.570376 per ms 03:18:22.837 16 switches: flows: 123449 122242 123353 121067 121726 122982 120923 125316 123463 123885 121656 122980 122764 121296 119355 119579 total = 32.546207 per ms 03:19:22.937 16 switches: flows: 122515 119933 122442 119411 120727 120829 120021 122577 122387 121867 119323 121158 122061 118955 118090 117297 total = 32.106306 per ms 03:20:23.038 16 switches: flows: 120495 118521 122183 117046 118632 120148 119194 121591 119334 119908 118097 119570 119629 117779 117436 117054 total = 31.723993 per ms 03:21:23.138 16 switches: flows: 118055 115536 119274 115780 116852 119837 118924 116351 118054 117310 116892 115805 116947 114705 115244 116272 total = 31.145180 per ms 03:22:23.239 16 switches: flows: 121774 119713 124078 120017 120217 121660 121078 122120 123063 121174 120591 120409 121473 120500 118446 119136 total = 32.203466 per ms 03:23:23.341 16 switches: flows: 122137 120395 123874 120305 122096 120814 120116 123983 123330 123957 119847 121292 120498 120704 119591 119783 total = 32.323912 per ms 03:24:23.441 16 switches: flows: 123943 121607 124297 122285 122224 123221 122399 123531 124527 124075 120061 123026 121889 121911 120664 119057 total = 32.590843 per ms 03:25:23.541 16 switches: flows: 121424 120475 124439 118084 120449 122644 123191 120919 121273 123891 120172 120058 121232 120440 120942 122158 total = 32.309255 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 31145.18/32590.84/32168.84/10732.15 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 31145.18/32590.84/32168.84/10732.15 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 31145.18/32590.84/32168.84/10732.15 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 31145.18/32590.84/32168.84/10732.15 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 31145.18 | 32590.84 | 32168.84 | 10732.15 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 31145.18 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 32590.84 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 32168.84 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 10732.15 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 31145.18 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 32590.84 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 32168.84 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 10732.15 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-05-19 03:25:23 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-05-19 03:25:23,-m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,31145.18,32590.84,32168.84,10732.15 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/bug.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/bug.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} bug.csv Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. ${test_skipped} = False ${test_skipped} len(re.findall('SKIPPED', """${TEST_MESSAGE}""")) > 0 modules=re Evaluates the given expression in Python and returns the result. Jira tickets are {PROJECT}-{NUMBER} while Bugzilla tickets are {NUMBER} Displays the given messages in the log file as keyword arguments. ${match} Should Contain ${number} - Runs the specified keyword and returns the status as a Boolean value. ${bug_url} ${match} https://jira.opendaylight.org/browse/${number} https://bugs.opendaylight.org/show_bug.cgi?id=${number} Sets variable based on the given condition. ${msg} This test fails due to ${bug_url} Returns the given values which can then be assigned to a variables. ${newline} chr(10) Evaluates the given expression in Python and returns the result. ${msg}${newline}${newline}${TEST_MESSAGE} Sets message for the current test case. ${msg} Logs the given message with the given level. ${bug_url} Adds given ``tags`` for the current test or all tests in a suite. 6176 Report that a test failed due to a known Bugzilla bug whose number is provided as an argument. Not FAILED (incl. SKIPPED) test are not reported. This keyword must be used in the [Teardown] setting of the affected test or as the first line of the test if FastFail module is not being used. It reports the URL of the bug on console and also puts it into the Robot log file. cbench executed in latency mode to see if controller is healthy cbench latency Cbench Latency and Throughput tests can be run from an external cbench. If cbench is run with a medium number of switches or higher (e.g. 32+) the normal openflow operations seem to break. BUG: https://bugs.opendaylight.org/show_bug.cgi?id=2897 All Tests cbench latency throughput openflowplugin-cbench.txt