Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.29:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>log:set ERROR ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} log:set ${log_level} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.29 Note that this keyword will open&close new SSH connection, without switching back to previously current session. 3x 1s KarafKeywords.Issue Command On Karaf Console log:set ${log_level} Runs the specified keyword and retries if it fails. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/latency.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/latency.csv</a>'. ${latency_results_file} LATENCY_MIN,LATENCY_MAX,LATENCY_AVERAGE\n Appends the given content to the specified file. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/throughput.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/throughput.csv</a>'. ${throughput_results_file} THROUGHPUT_MIN,THROUGHPUT_MAX,THROUGHPUT_AVERAGE\n Appends the given content to the specified file. ${duration_in_ms} = 60000 ${duration_in_ms} ${duration_in_secs} * 1000 Evaluates the given expression in Python and returns the result. ${duration_in_ms} = 60000 ${duration_in_ms} Makes a variable available everywhere within the scope of the current suite. ${test_timeout} = 900.0 ${test_timeout} (${loops} * ${duration_in_secs}) * 1.5 Evaluates the given expression in Python and returns the result. ${test_timeout} = 900.0 ${test_timeout} Makes a variable available everywhere within the scope of the current suite. ${cbench_executable} Fails unless the given ``path`` points to an existing file. ${conn_id} = 2 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.171.220:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Thu Aug 6 00:47:18 UTC 2026 System load: 0.04 Processes: 113 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.171.220 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. [?2004h[jenkins@releng-63164-362-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. [chan 1] Opened sftp connection (server version 3) ${file} Fails if the given ``path`` does NOT point to an existing file. Closes the current connection. ${cbench_system} ${cbench_executable} Will create connection with public key and will PASS if the given ${file} exists, otherwise will FAIL ${loops} >= 2 If number of loops is less than 2, cbench will not run Fails if the given condition is not true. Not A Karaf App Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.29:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>feature:list -i | 0[C 0g[Krep odl-openflowplugin-drop-test ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.3 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.3 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.3 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.3 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} feature:list -i | grep ${feature_name} ${controller} ${karaf_port} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.29 Note that this keyword will open&close new SSH connection, without switching back to previously current session. ${output} ${feature_name} Fails if ``container`` does not contain ``item`` one or more times. ${output} odl-openflowplugin-drop-test Will Succeed if the given ${feature_name} is found in the output of "feature:list -i" Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.29:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>dropallpacketsrpc on ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} dropallpacketsrpc on Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.29 Note that this keyword will open&close new SSH connection, without switching back to previously current session. Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = latency.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.29 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.171.220" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 5 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.171.220:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Thu Aug 6 00:47:18 UTC 2026 System load: 0.04 Processes: 113 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.171.220 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Thu Aug 6 00:47:18 2026 from 10.30.170.67 [?2004h[jenkins@releng-63164-362-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.29 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 1. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.29:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.29:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.29. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:48:24.637 16 switches: flows: 103224 99602 100157 100545 102064 99666 100637 101267 98442 98135 97388 98534 97543 97693 98607 97559 total = 26.517717 per ms 00:49:24.737 16 switches: flows: 114239 111939 112132 110886 112046 110822 111425 111657 106776 109027 108266 108251 106980 107388 109518 106531 total = 29.249216 per ms 00:50:24.837 16 switches: flows: 120325 117203 114656 117643 118646 116780 114500 115847 113479 115580 113884 112992 114651 113323 112488 115601 total = 30.741966 per ms 00:51:24.938 16 switches: flows: 122883 120872 117762 119690 119191 116859 117894 119457 114444 117135 116599 115422 117473 115106 117011 114537 total = 31.319973 per ms 00:52:25.038 16 switches: flows: 111915 109625 108880 109564 108524 107922 109166 107677 105628 106121 105944 105803 106237 105603 107311 105387 total = 28.640644 per ms 00:53:25.138 16 switches: flows: 112134 110740 112019 109685 110092 111062 111460 108598 107180 108296 105535 105625 106720 105985 106760 106729 total = 28.928722 per ms controller msgbuf_read() = 0: closed connection ... exiting ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.29:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.29:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.29. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:48:24.637 16 switches: flows: 103224 99602 100157 100545 102064 99666 100637 101267 98442 98135 97388 98534 97543 97693 98607 97559 total = 26.517717 per ms 00:49:24.737 16 switches: flows: 114239 111939 112132 110886 112046 110822 111425 111657 106776 109027 108266 108251 106980 107388 109518 106531 total = 29.249216 per ms 00:50:24.837 16 switches: flows: 120325 117203 114656 117643 118646 116780 114500 115847 113479 115580 113884 112992 114651 113323 112488 115601 total = 30.741966 per ms 00:51:24.938 16 switches: flows: 122883 120872 117762 119690 119191 116859 117894 119457 114444 117135 116599 115422 117473 115106 117011 114537 total = 31.319973 per ms 00:52:25.038 16 switches: flows: 111915 109625 108880 109564 108524 107922 109166 107677 105628 106121 105944 105803 106237 105603 107311 105387 total = 28.640644 per ms 00:53:25.138 16 switches: flows: 112134 110740 112019 109685 110092 111062 111460 108598 107180 108296 105535 105625 106720 105985 106760 106729 total = 28.928722 per ms controller msgbuf_read() = 0: closed connection ... exiting ${output} Logs the given message with the given level. 'cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.29:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.29. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:48:24.637 16 switches: flows: 103224 99602 100157 100545 102064 99666 100637 101267 98442 98135 97388 98534 97543 97693 98607 97559 total = 26.517717 per ms 00:49:24.737 16 switches: flows: 114239 111939 112132 110886 112046 110822 111425 111657 106776 109027 108266 108251 106980 107388 109518 106531 total = 29.249216 per ms 00:50:24.837 16 switches: flows: 120325 117203 114656 117643 118646 116780 114500 115847 113479 115580 113884 112992 114651 113323 112488 115601 total = 30.741966 per ms 00:51:24.938 16 switches: flows: 122883 120872 117762 119690 119191 116859 117894 119457 114444 117135 116599 115422 117473 115106 117011 114537 total = 31.319973 per ms 00:52:25.038 16 switches: flows: 111915 109625 108880 109564 108524 107922 109166 107677 105628 106121 105944 105803 106237 105603 107311 105387 total = 28.640644 per ms 00:53:25.138 16 switches: flows: 112134 110740 112019 109685 110092 111062 111460 108598 107180 108296 105535 105625 106720 105985 106760 106729 total = 28.928722 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 'cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.29:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.29. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:48:24.637 16 switches: flows: 103224 99602 100157 100545 102064 99666 100637 101267 98442 98135 97388 98534 97543 97693 98607 97559 total = 26.517717 per ms 00:49:24.737 16 switches: flows: 114239 111939 112132 110886 112046 110822 111425 111657 106776 109027 108266 108251 106980 107388 109518 106531 total = 29.249216 per ms 00:50:24.837 16 switches: flows: 120325 117203 114656 117643 118646 116780 114500 115847 113479 115580 113884 112992 114651 113323 112488 115601 total = 30.741966 per ms 00:51:24.938 16 switches: flows: 122883 120872 117762 119690 119191 116859 117894 119457 114444 117135 116599 115422 117473 115106 117011 114537 total = 31.319973 per ms 00:52:25.038 16 switches: flows: 111915 109625 108880 109564 108524 107922 109166 107677 105628 106121 105944 105803 106237 105603 107311 105387 total = 28.640644 per ms 00:53:25.138 16 switches: flows: 112134 110740 112019 109685 110092 111062 111460 108598 107180 108296 105535 105625 106720 105985 106760 106729 total = 28.928722 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. ${results_list[5]} Logs the given message with the given level. ${results_list[7]} Logs the given message with the given level. @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. ${i} 0 ${num_stats} ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} d,m,s Returns the given time in the requested format. CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} ${latency_results_file} 'cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.29:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.29. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:48:24.637 16 switches: flows: 103224 99602 100157 100545 102064 99666 100637 101267 98442 98135 97388 98534 97543 97693 98607 97559 total = 26.517717 per ms 00:49:24.737 16 switches: flows: 114239 111939 112132 110886 112046 110822 111425 111657 106776 109027 108266 108251 106980 107388 109518 106531 total = 29.249216 per ms 00:50:24.837 16 switches: flows: 120325 117203 114656 117643 118646 116780 114500 115847 113479 115580 113884 112992 114651 113323 112488 115601 total = 30.741966 per ms 00:51:24.938 16 switches: flows: 122883 120872 117762 119690 119191 116859 117894 119457 114444 117135 116599 115422 117473 115106 117011 114537 total = 31.319973 per ms 00:52:25.038 16 switches: flows: 111915 109625 108880 109564 108524 107922 109166 107677 105628 106121 105944 105803 106237 105603 107311 105387 total = 28.640644 per ms 00:53:25.138 16 switches: flows: 112134 110740 112019 109685 110092 111062 111460 108598 107180 108296 105535 105625 106720 105985 106760 106729 total = 28.928722 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in default latency mode. Test parameters have defaults, but can be overridden on the pybot command line cbench latency 'cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.29:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.29. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:48:24.637 16 switches: flows: 103224 99602 100157 100545 102064 99666 100637 101267 98442 98135 97388 98534 97543 97693 98607 97559 total = 26.517717 per ms 00:49:24.737 16 switches: flows: 114239 111939 112132 110886 112046 110822 111425 111657 106776 109027 108266 108251 106980 107388 109518 106531 total = 29.249216 per ms 00:50:24.837 16 switches: flows: 120325 117203 114656 117643 118646 116780 114500 115847 113479 115580 113884 112992 114651 113323 112488 115601 total = 30.741966 per ms 00:51:24.938 16 switches: flows: 122883 120872 117762 119690 119191 116859 117894 119457 114444 117135 116599 115422 117473 115106 117011 114537 total = 31.319973 per ms 00:52:25.038 16 switches: flows: 111915 109625 108880 109564 108524 107922 109166 107677 105628 106121 105944 105803 106237 105603 107311 105387 total = 28.640644 per ms 00:53:25.138 16 switches: flows: 112134 110740 112019 109685 110092 111062 111460 108598 107180 108296 105535 105625 106720 105985 106760 106729 total = 28.928722 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = throughput.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.29 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.171.220" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 7 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.171.220:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Thu Aug 6 00:53:57 UTC 2026 System load: 1.01 Processes: 108 Usage of /: 20.0% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.171.220 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Thu Aug 6 00:47:19 2026 from 10.30.170.67 [?2004h[jenkins@releng-63164-362-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.29 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 1. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.29:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with ... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.29:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.29. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:55:02.867 16 switches: flows: 519979 544582 540462 536861 543428 518663 524807 529749 508556 516421 485264 533223 526406 531850 522040 525691 total = 140.133033 per ms controller msgbuf_read() = -1: msgbuf_read: Connection reset by peer ... exiting ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.29:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with ... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.29:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.29. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:55:02.867 16 switches: flows: 519979 544582 540462 536861 543428 518663 524807 529749 508556 516421 485264 533223 526406 531850 522040 525691 total = 140.133033 per ms controller msgbuf_read() = -1: msgbuf_read: Connection reset by peer ... exiting ${output} Logs the given message with the given level. 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.29:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.29. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:55:02.867 16 switches: flows: 519979 544582 540462 536861 543428 518663 524807 529749 508556 516421 485264 533223 526406 531850 522040 525691 total = 140.133033 per ms controller msgbuf_read() = -1: msgbuf_read: Connection reset by peer ... exiting' does not contain 'RESULT' ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.29:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.29. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:55:02.867 16 switches: flows: 519979 544582 540462 536861 543428 518663 524807 529749 508556 516421 485264 533223 526406 531850 522040 525691 total = 140.133033 per ms controller msgbuf_read() = -1: msgbuf_read: Connection reset by peer ... exiting' does not contain 'RESULT' ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. ${results_list[5]} Logs the given message with the given level. ${results_list[7]} Logs the given message with the given level. @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. ${i} 0 ${num_stats} ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} d,m,s Returns the given time in the requested format. CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. ${min} ${max} ${average} ${average_threshold} ${output_filename} -t -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${throughput_threshold} ${throughput_results_file} 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.29:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.29. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:55:02.867 16 switches: flows: 519979 544582 540462 536861 543428 518663 524807 529749 508556 516421 485264 533223 526406 531850 522040 525691 total = 140.133033 per ms controller msgbuf_read() = -1: msgbuf_read: Connection reset by peer ... exiting' does not contain 'RESULT' ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in throughput mode (-t). Test parameters have defaults, but can be overridden on the pybot command line cbench throughput 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.29:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.29. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:55:02.867 16 switches: flows: 519979 544582 540462 536861 543428 518663 524807 529749 508556 516421 485264 533223 526406 531850 522040 525691 total = 140.133033 per ms controller msgbuf_read() = -1: msgbuf_read: Connection reset by peer ... exiting' does not contain 'RESULT' Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = bug.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.29 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.171.220" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 9 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.171.220:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Thu Aug 6 00:56:05 UTC 2026 System load: 1.54 Processes: 105 Usage of /: 20.0% of 38.58GB Users logged in: 0 Memory usage: 5% IPv4 address for ens3: 10.30.171.220 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Thu Aug 6 00:53:57 2026 from 10.30.170.67 [?2004h[jenkins@releng-63164-362-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.29 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.29:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.29:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.29. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:57:11.342 16 switches: flows: 111828 112577 113687 110900 111676 113645 112393 114764 110760 113034 110262 110205 110059 110380 111446 109375 total = 29.783183 per ms 00:58:11.442 16 switches: flows: 118824 120100 120722 118592 117322 118669 117707 120205 116797 118274 115764 116451 117348 115517 118300 115416 total = 31.381116 per ms 00:59:11.543 16 switches: flows: 115346 115976 116598 114045 114255 115431 114730 115101 114415 112910 112758 112567 112196 110572 111647 112045 total = 30.292396 per ms 01:00:11.643 16 switches: flows: 114171 118783 117885 117996 115008 116451 117518 116419 115589 115211 116190 117121 116412 112309 112745 113719 total = 30.840562 per ms 01:01:11.743 16 switches: flows: 112620 114683 115134 111650 113645 115754 115252 114676 113740 110724 110684 112483 113095 110440 110743 111171 total = 30.058029 per ms 01:02:11.844 16 switches: flows: 113981 117765 114967 116403 115390 117330 116970 114588 116111 115049 114295 114376 114691 114154 114611 112334 total = 30.665719 per ms 01:03:11.944 16 switches: flows: 113847 116788 114750 115228 114670 113114 114177 113596 115197 112159 113773 113270 112809 112054 113069 110994 total = 30.274367 per ms 01:04:12.044 16 switches: flows: 111898 115289 113425 113134 112182 112373 111816 113256 112785 111723 112405 112160 111170 110824 111980 110363 total = 29.896370 per ms 01:05:12.145 16 switches: flows: 108852 112189 109237 109198 108463 108925 109061 110051 109781 108458 108775 107608 107067 107661 108649 107498 total = 28.975999 per ms 01:06:12.245 16 switches: flows: 109142 112251 110977 111779 109544 111080 110646 111718 110565 109258 108461 108793 109769 108850 110215 109489 total = 29.326662 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 28976.00/31381.12/30190.14/10087.69 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.29:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.29:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.29. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:57:11.342 16 switches: flows: 111828 112577 113687 110900 111676 113645 112393 114764 110760 113034 110262 110205 110059 110380 111446 109375 total = 29.783183 per ms 00:58:11.442 16 switches: flows: 118824 120100 120722 118592 117322 118669 117707 120205 116797 118274 115764 116451 117348 115517 118300 115416 total = 31.381116 per ms 00:59:11.543 16 switches: flows: 115346 115976 116598 114045 114255 115431 114730 115101 114415 112910 112758 112567 112196 110572 111647 112045 total = 30.292396 per ms 01:00:11.643 16 switches: flows: 114171 118783 117885 117996 115008 116451 117518 116419 115589 115211 116190 117121 116412 112309 112745 113719 total = 30.840562 per ms 01:01:11.743 16 switches: flows: 112620 114683 115134 111650 113645 115754 115252 114676 113740 110724 110684 112483 113095 110440 110743 111171 total = 30.058029 per ms 01:02:11.844 16 switches: flows: 113981 117765 114967 116403 115390 117330 116970 114588 116111 115049 114295 114376 114691 114154 114611 112334 total = 30.665719 per ms 01:03:11.944 16 switches: flows: 113847 116788 114750 115228 114670 113114 114177 113596 115197 112159 113773 113270 112809 112054 113069 110994 total = 30.274367 per ms 01:04:12.044 16 switches: flows: 111898 115289 113425 113134 112182 112373 111816 113256 112785 111723 112405 112160 111170 110824 111980 110363 total = 29.896370 per ms 01:05:12.145 16 switches: flows: 108852 112189 109237 109198 108463 108925 109061 110051 109781 108458 108775 107608 107067 107661 108649 107498 total = 28.975999 per ms 01:06:12.245 16 switches: flows: 109142 112251 110977 111779 109544 111080 110646 111718 110565 109258 108461 108793 109769 108850 110215 109489 total = 29.326662 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 28976.00/31381.12/30190.14/10087.69 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 28976.00/31381.12/30190.14/10087.69 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 28976.00/31381.12/30190.14/10087.69 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 28976.00/31381.12/30190.14/10087.69 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 28976.00 | 31381.12 | 30190.14 | 10087.69 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 28976.00 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 31381.12 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 30190.14 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 10087.69 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 28976.00 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 31381.12 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 30190.14 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 10087.69 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-08-06 01:06:12 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-08-06 01:06:12,-m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,28976.00,31381.12,30190.14,10087.69 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/bug.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/bug.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} bug.csv Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. ${test_skipped} = False ${test_skipped} len(re.findall('SKIPPED', """${TEST_MESSAGE}""")) > 0 modules=re Evaluates the given expression in Python and returns the result. Jira tickets are {PROJECT}-{NUMBER} while Bugzilla tickets are {NUMBER} Displays the given messages in the log file as keyword arguments. ${match} Should Contain ${number} - Runs the specified keyword and returns the status as a Boolean value. ${bug_url} ${match} https://jira.opendaylight.org/browse/${number} https://bugs.opendaylight.org/show_bug.cgi?id=${number} Sets variable based on the given condition. ${msg} This test fails due to ${bug_url} Returns the given values which can then be assigned to a variables. ${newline} chr(10) Evaluates the given expression in Python and returns the result. ${msg}${newline}${newline}${TEST_MESSAGE} Sets message for the current test case. ${msg} Logs the given message with the given level. ${bug_url} Adds given ``tags`` for the current test or all tests in a suite. 6176 Report that a test failed due to a known Bugzilla bug whose number is provided as an argument. Not FAILED (incl. SKIPPED) test are not reported. This keyword must be used in the [Teardown] setting of the affected test or as the first line of the test if FastFail module is not being used. It reports the URL of the bug on console and also puts it into the Robot log file. cbench executed in latency mode to see if controller is healthy cbench latency Cbench Latency and Throughput tests can be run from an external cbench. If cbench is run with a medium number of switches or higher (e.g. 32+) the normal openflow operations seem to break. BUG: https://bugs.opendaylight.org/show_bug.cgi?id=2897 All Tests cbench latency throughput openflowplugin-cbench.txt