Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.170.112:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>log:set ERROR ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} log:set ${log_level} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.170.112 Note that this keyword will open&close new SSH connection, without switching back to previously current session. 3x 1s KarafKeywords.Issue Command On Karaf Console log:set ${log_level} Runs the specified keyword and retries if it fails. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/latency.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/latency.csv</a>'. ${latency_results_file} LATENCY_MIN,LATENCY_MAX,LATENCY_AVERAGE\n Appends the given content to the specified file. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/throughput.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/throughput.csv</a>'. ${throughput_results_file} THROUGHPUT_MIN,THROUGHPUT_MAX,THROUGHPUT_AVERAGE\n Appends the given content to the specified file. ${duration_in_ms} = 60000 ${duration_in_ms} ${duration_in_secs} * 1000 Evaluates the given expression in Python and returns the result. ${duration_in_ms} = 60000 ${duration_in_ms} Makes a variable available everywhere within the scope of the current suite. ${test_timeout} = 900.0 ${test_timeout} (${loops} * ${duration_in_secs}) * 1.5 Evaluates the given expression in Python and returns the result. ${test_timeout} = 900.0 ${test_timeout} Makes a variable available everywhere within the scope of the current suite. ${cbench_executable} Fails unless the given ``path`` points to an existing file. ${conn_id} = 2 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.171.120:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Thu May 14 03:13:00 UTC 2026 System load: 0.05 Processes: 112 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.171.120 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. [?2004h[jenkins@releng-63164-242-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. [chan 1] Opened sftp connection (server version 3) ${file} Fails if the given ``path`` does NOT point to an existing file. Closes the current connection. ${cbench_system} ${cbench_executable} Will create connection with public key and will PASS if the given ${file} exists, otherwise will FAIL ${loops} >= 2 If number of loops is less than 2, cbench will not run Fails if the given condition is not true. Not A Karaf App Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.170.112:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>feature:list -i | 0[C 0g[Krep odl-openflowplugin-drop-test ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.2 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.2 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.2 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.2 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} feature:list -i | grep ${feature_name} ${controller} ${karaf_port} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.170.112 Note that this keyword will open&close new SSH connection, without switching back to previously current session. ${output} ${feature_name} Fails if ``container`` does not contain ``item`` one or more times. ${output} odl-openflowplugin-drop-test Will Succeed if the given ${feature_name} is found in the output of "feature:list -i" Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.170.112:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>dropallpacketsrpc on ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} dropallpacketsrpc on Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.170.112 Note that this keyword will open&close new SSH connection, without switching back to previously current session. Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = latency.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.170.112 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.171.120" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 5 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.171.120:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Thu May 14 03:13:00 UTC 2026 System load: 0.05 Processes: 112 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.171.120 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Thu May 14 03:13:00 2026 from 10.30.171.62 [?2004h[jenkins@releng-63164-242-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.170.112 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.112:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.112:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.112. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 03:14:07.030 16 switches: flows: 109375 107044 106453 109896 107023 105540 108850 107612 106127 106130 105442 106394 106439 105674 104028 103893 total = 28.432000 per ms 03:15:07.132 16 switches: flows: 111376 110137 111059 109095 108698 107771 110667 110161 107828 108137 108472 107546 109075 107034 106914 106498 total = 28.959393 per ms 03:16:07.233 16 switches: flows: 118354 117036 115648 117845 116552 115961 118756 117967 115844 114986 114881 115996 114437 113815 114639 114199 total = 30.896732 per ms 03:17:07.334 16 switches: flows: 126552 123935 125489 124752 124328 122940 127017 125115 123468 125004 124128 122991 122747 122560 121362 120727 total = 32.996820 per ms 03:18:07.436 16 switches: flows: 122774 120619 120366 120058 118588 117904 122986 120956 119804 119801 119413 119526 119142 118059 118149 116904 total = 31.864241 per ms 03:19:07.538 16 switches: flows: 126914 124878 125365 124659 124833 122806 126552 124341 123889 125161 125001 123618 123185 121316 121604 121159 total = 33.032522 per ms 03:20:07.639 16 switches: flows: 122960 120787 120560 122295 119109 119261 120822 119126 117918 118447 118127 118375 118280 116375 117335 116559 total = 31.719296 per ms 03:21:07.740 16 switches: flows: 131820 129332 130243 130003 129996 126193 129394 128218 123213 122910 125079 125276 124847 123120 124140 123703 total = 33.735136 per ms 03:22:07.841 16 switches: flows: 130380 129734 130234 127814 129109 125658 127872 126782 124560 122606 124441 124127 123672 122243 122342 122022 total = 33.503982 per ms 03:23:07.942 16 switches: flows: 129791 128750 127372 128475 128758 125060 125793 127684 121650 126188 126268 122920 123728 123910 126117 122933 total = 33.533898 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 28959.39/33735.14/32249.11/10850.97 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.112:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.112:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.112. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 03:14:07.030 16 switches: flows: 109375 107044 106453 109896 107023 105540 108850 107612 106127 106130 105442 106394 106439 105674 104028 103893 total = 28.432000 per ms 03:15:07.132 16 switches: flows: 111376 110137 111059 109095 108698 107771 110667 110161 107828 108137 108472 107546 109075 107034 106914 106498 total = 28.959393 per ms 03:16:07.233 16 switches: flows: 118354 117036 115648 117845 116552 115961 118756 117967 115844 114986 114881 115996 114437 113815 114639 114199 total = 30.896732 per ms 03:17:07.334 16 switches: flows: 126552 123935 125489 124752 124328 122940 127017 125115 123468 125004 124128 122991 122747 122560 121362 120727 total = 32.996820 per ms 03:18:07.436 16 switches: flows: 122774 120619 120366 120058 118588 117904 122986 120956 119804 119801 119413 119526 119142 118059 118149 116904 total = 31.864241 per ms 03:19:07.538 16 switches: flows: 126914 124878 125365 124659 124833 122806 126552 124341 123889 125161 125001 123618 123185 121316 121604 121159 total = 33.032522 per ms 03:20:07.639 16 switches: flows: 122960 120787 120560 122295 119109 119261 120822 119126 117918 118447 118127 118375 118280 116375 117335 116559 total = 31.719296 per ms 03:21:07.740 16 switches: flows: 131820 129332 130243 130003 129996 126193 129394 128218 123213 122910 125079 125276 124847 123120 124140 123703 total = 33.735136 per ms 03:22:07.841 16 switches: flows: 130380 129734 130234 127814 129109 125658 127872 126782 124560 122606 124441 124127 123672 122243 122342 122022 total = 33.503982 per ms 03:23:07.942 16 switches: flows: 129791 128750 127372 128475 128758 125060 125793 127684 121650 126188 126268 122920 123728 123910 126117 122933 total = 33.533898 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 28959.39/33735.14/32249.11/10850.97 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 28959.39/33735.14/32249.11/10850.97 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 28959.39/33735.14/32249.11/10850.97 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 28959.39/33735.14/32249.11/10850.97 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 28959.39 | 33735.14 | 32249.11 | 10850.97 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 28959.39 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 33735.14 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 32249.11 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 10850.97 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 28959.39 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 33735.14 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 32249.11 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 10850.97 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-05-14 03:23:08 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-05-14 03:23:08,-m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,28959.39,33735.14,32249.11,10850.97 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/latency.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/latency.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} ${latency_results_file} Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in default latency mode. Test parameters have defaults, but can be overridden on the pybot command line cbench latency Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = throughput.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.170.112 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.171.120" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 7 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.171.120:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Thu May 14 03:23:08 UTC 2026 System load: 1.0 Processes: 106 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.171.120 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Thu May 14 03:13:01 2026 from 10.30.171.62 [?2004h[jenkins@releng-63164-242-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.170.112 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 1. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.112:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.112:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.112. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 03:24:13.741 16 switches: flows: 491188 447591 420815 495031 406571 416248 438601 413268 402296 380099 445174 446101 391486 482320 430892 406647 total = 115.238800 per ms 03:25:13.909 16 switches: flows: 417110 414197 468041 417155 441397 426370 464342 464254 415817 412409 413805 421364 446761 403641 430531 437816 total = 114.596443 per ms 03:26:14.010 16 switches: flows: 561149 576535 573969 578182 566257 559561 568515 568344 556521 563187 558153 552280 569567 567707 549369 559860 total = 150.233601 per ms 03:27:14.113 16 switches: flows: 583926 570790 559667 570392 569210 569530 572576 569583 571586 578833 574404 571393 571490 575405 580185 577880 total = 152.521273 per ms 03:28:14.214 16 switches: flows: 584487 543040 581556 584288 588295 586612 589216 581548 589087 583183 593036 584327 584145 579671 586122 587980 total = 155.181173 per ms 03:29:14.439 16 switches: flows: 576988 575207 564025 565353 568339 568395 575434 575301 568823 572187 548565 572392 573033 571897 572374 570018 total = 151.406468 per ms 03:30:14.541 16 switches: flows: 576209 577273 559275 572264 568657 574925 570650 568051 572924 568076 588993 559265 572673 570610 575683 573286 total = 152.223521 per ms 03:31:14.697 16 switches: flows: 551410 557334 559717 566812 558707 554608 562641 555450 565748 565739 549816 550708 550673 564984 528559 557024 total = 147.947614 per ms controller msgbuf_read() = 0: closed connection ... exiting ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.112:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.112:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.112. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 03:24:13.741 16 switches: flows: 491188 447591 420815 495031 406571 416248 438601 413268 402296 380099 445174 446101 391486 482320 430892 406647 total = 115.238800 per ms 03:25:13.909 16 switches: flows: 417110 414197 468041 417155 441397 426370 464342 464254 415817 412409 413805 421364 446761 403641 430531 437816 total = 114.596443 per ms 03:26:14.010 16 switches: flows: 561149 576535 573969 578182 566257 559561 568515 568344 556521 563187 558153 552280 569567 567707 549369 559860 total = 150.233601 per ms 03:27:14.113 16 switches: flows: 583926 570790 559667 570392 569210 569530 572576 569583 571586 578833 574404 571393 571490 575405 580185 577880 total = 152.521273 per ms 03:28:14.214 16 switches: flows: 584487 543040 581556 584288 588295 586612 589216 581548 589087 583183 593036 584327 584145 579671 586122 587980 total = 155.181173 per ms 03:29:14.439 16 switches: flows: 576988 575207 564025 565353 568339 568395 575434 575301 568823 572187 548565 572392 573033 571897 572374 570018 total = 151.406468 per ms 03:30:14.541 16 switches: flows: 576209 577273 559275 572264 568657 574925 570650 568051 572924 568076 588993 559265 572673 570610 575683 573286 total = 152.223521 per ms 03:31:14.697 16 switches: flows: 551410 557334 559717 566812 558707 554608 562641 555450 565748 565739 549816 550708 550673 564984 528559 557024 total = 147.947614 per ms controller msgbuf_read() = 0: closed connection ... exiting ${output} Logs the given message with the given level. 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.112:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.112. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 03:24:13.741 16 switches: flows: 491188 447591 420815 495031 406571 416248 438601 413268 402296 380099 445174 446101 391486 482320 430892 406647 total = 115.238800 per ms 03:25:13.909 16 switches: flows: 417110 414197 468041 417155 441397 426370 464342 464254 415817 412409 413805 421364 446761 403641 430531 437816 total = 114.596443 per ms 03:26:14.010 16 switches: flows: 561149 576535 573969 578182 566257 559561 568515 568344 556521 563187 558153 552280 569567 567707 549369 559860 total = 150.233601 per ms 03:27:14.113 16 switches: flows: 583926 570790 559667 570392 569210 569530 572576 569583 571586 578833 574404 571393 571490 575405 580185 577880 total = 152.521273 per ms 03:28:14.214 16 switches: flows: 584487 543040 581556 584288 588295 586612 589216 581548 589087 583183 593036 584327 584145 579671 586122 587980 total = 155.181173 per ms 03:29:14.439 16 switches: flows: 576988 575207 564025 565353 568339 568395 575434 575301 568823 572187 548565 572392 573033 571897 572374 570018 total = 151.406468 per ms 03:30:14.541 16 switches: flows: 576209 577273 559275 572264 568657 574925 570650 568051 572924 568076 588993 559265 572673 570610 575683 573286 total = 152.223521 per ms 03:31:14.697 16 switches: flows: 551410 557334 559717 566812 558707 554608 562641 555450 565748 565739 549816 550708 550673 564984 528559 557024 total = 147.947614 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.112:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.112. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 03:24:13.741 16 switches: flows: 491188 447591 420815 495031 406571 416248 438601 413268 402296 380099 445174 446101 391486 482320 430892 406647 total = 115.238800 per ms 03:25:13.909 16 switches: flows: 417110 414197 468041 417155 441397 426370 464342 464254 415817 412409 413805 421364 446761 403641 430531 437816 total = 114.596443 per ms 03:26:14.010 16 switches: flows: 561149 576535 573969 578182 566257 559561 568515 568344 556521 563187 558153 552280 569567 567707 549369 559860 total = 150.233601 per ms 03:27:14.113 16 switches: flows: 583926 570790 559667 570392 569210 569530 572576 569583 571586 578833 574404 571393 571490 575405 580185 577880 total = 152.521273 per ms 03:28:14.214 16 switches: flows: 584487 543040 581556 584288 588295 586612 589216 581548 589087 583183 593036 584327 584145 579671 586122 587980 total = 155.181173 per ms 03:29:14.439 16 switches: flows: 576988 575207 564025 565353 568339 568395 575434 575301 568823 572187 548565 572392 573033 571897 572374 570018 total = 151.406468 per ms 03:30:14.541 16 switches: flows: 576209 577273 559275 572264 568657 574925 570650 568051 572924 568076 588993 559265 572673 570610 575683 573286 total = 152.223521 per ms 03:31:14.697 16 switches: flows: 551410 557334 559717 566812 558707 554608 562641 555450 565748 565739 549816 550708 550673 564984 528559 557024 total = 147.947614 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. ${results_list[5]} Logs the given message with the given level. ${results_list[7]} Logs the given message with the given level. @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. ${i} 0 ${num_stats} ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} d,m,s Returns the given time in the requested format. CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. ${min} ${max} ${average} ${average_threshold} ${output_filename} -t -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${throughput_threshold} ${throughput_results_file} 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.112:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.112. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 03:24:13.741 16 switches: flows: 491188 447591 420815 495031 406571 416248 438601 413268 402296 380099 445174 446101 391486 482320 430892 406647 total = 115.238800 per ms 03:25:13.909 16 switches: flows: 417110 414197 468041 417155 441397 426370 464342 464254 415817 412409 413805 421364 446761 403641 430531 437816 total = 114.596443 per ms 03:26:14.010 16 switches: flows: 561149 576535 573969 578182 566257 559561 568515 568344 556521 563187 558153 552280 569567 567707 549369 559860 total = 150.233601 per ms 03:27:14.113 16 switches: flows: 583926 570790 559667 570392 569210 569530 572576 569583 571586 578833 574404 571393 571490 575405 580185 577880 total = 152.521273 per ms 03:28:14.214 16 switches: flows: 584487 543040 581556 584288 588295 586612 589216 581548 589087 583183 593036 584327 584145 579671 586122 587980 total = 155.181173 per ms 03:29:14.439 16 switches: flows: 576988 575207 564025 565353 568339 568395 575434 575301 568823 572187 548565 572392 573033 571897 572374 570018 total = 151.406468 per ms 03:30:14.541 16 switches: flows: 576209 577273 559275 572264 568657 574925 570650 568051 572924 568076 588993 559265 572673 570610 575683 573286 total = 152.223521 per ms 03:31:14.697 16 switches: flows: 551410 557334 559717 566812 558707 554608 562641 555450 565748 565739 549816 550708 550673 564984 528559 557024 total = 147.947614 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in throughput mode (-t). Test parameters have defaults, but can be overridden on the pybot command line cbench throughput 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.112:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.112. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 03:24:13.741 16 switches: flows: 491188 447591 420815 495031 406571 416248 438601 413268 402296 380099 445174 446101 391486 482320 430892 406647 total = 115.238800 per ms 03:25:13.909 16 switches: flows: 417110 414197 468041 417155 441397 426370 464342 464254 415817 412409 413805 421364 446761 403641 430531 437816 total = 114.596443 per ms 03:26:14.010 16 switches: flows: 561149 576535 573969 578182 566257 559561 568515 568344 556521 563187 558153 552280 569567 567707 549369 559860 total = 150.233601 per ms 03:27:14.113 16 switches: flows: 583926 570790 559667 570392 569210 569530 572576 569583 571586 578833 574404 571393 571490 575405 580185 577880 total = 152.521273 per ms 03:28:14.214 16 switches: flows: 584487 543040 581556 584288 588295 586612 589216 581548 589087 583183 593036 584327 584145 579671 586122 587980 total = 155.181173 per ms 03:29:14.439 16 switches: flows: 576988 575207 564025 565353 568339 568395 575434 575301 568823 572187 548565 572392 573033 571897 572374 570018 total = 151.406468 per ms 03:30:14.541 16 switches: flows: 576209 577273 559275 572264 568657 574925 570650 568051 572924 568076 588993 559265 572673 570610 575683 573286 total = 152.223521 per ms 03:31:14.697 16 switches: flows: 551410 557334 559717 566812 558707 554608 562641 555450 565748 565739 549816 550708 550673 564984 528559 557024 total = 147.947614 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = bug.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.170.112 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.171.120" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 9 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.171.120:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Thu May 14 03:31:50 UTC 2026 System load: 0.1 Processes: 106 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.171.120 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Thu May 14 03:23:08 2026 from 10.30.171.62 [?2004h[jenkins@releng-63164-242-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.170.112 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.112:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.112:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.112. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 03:32:55.745 16 switches: flows: 120646 119306 117829 119380 117250 113619 116448 115502 112479 115259 113570 115764 114232 114748 115293 113347 total = 30.911200 per ms 03:33:55.846 16 switches: flows: 125177 125287 124349 121851 120725 117128 120487 122554 115422 117147 117523 116291 117796 120394 119420 116500 total = 31.914220 per ms 03:34:55.946 16 switches: flows: 123837 122278 121291 117777 120568 117684 119467 119048 115049 116636 116026 118372 117188 117682 117325 118133 total = 31.586557 per ms 03:35:56.046 16 switches: flows: 119170 118023 118273 116815 119481 113779 117059 117116 112892 115738 114282 113248 113874 111095 116190 114427 total = 30.806247 per ms 03:36:56.147 16 switches: flows: 125512 122337 126119 125594 125363 123818 122706 124517 121190 122015 119797 118804 119034 119218 123581 122876 total = 32.653497 per ms 03:37:56.247 16 switches: flows: 124293 123170 126207 125112 127057 123451 120852 123190 120853 122655 118376 119178 119900 119248 123129 121284 total = 32.578181 per ms 03:38:56.347 16 switches: flows: 119136 118469 120839 120910 120274 117914 115574 116771 114449 116308 113914 114577 113177 113789 118752 117355 total = 31.151442 per ms 03:39:56.447 16 switches: flows: 125906 127458 125795 122921 124834 122962 122377 123807 123258 120086 118097 123014 117200 121795 122207 122993 total = 32.690609 per ms 03:40:56.548 16 switches: flows: 121106 121317 120887 117519 122182 118342 116829 119168 118486 114943 114296 117263 115971 114721 117699 118248 total = 31.430463 per ms 03:41:56.648 16 switches: flows: 114669 117027 117395 113369 116576 113974 113311 113222 113746 110625 108765 112523 108964 110986 111144 112671 total = 30.099166 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 30099.17/32690.61/31656.71/10586.08 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.112:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.112:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.112. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 03:32:55.745 16 switches: flows: 120646 119306 117829 119380 117250 113619 116448 115502 112479 115259 113570 115764 114232 114748 115293 113347 total = 30.911200 per ms 03:33:55.846 16 switches: flows: 125177 125287 124349 121851 120725 117128 120487 122554 115422 117147 117523 116291 117796 120394 119420 116500 total = 31.914220 per ms 03:34:55.946 16 switches: flows: 123837 122278 121291 117777 120568 117684 119467 119048 115049 116636 116026 118372 117188 117682 117325 118133 total = 31.586557 per ms 03:35:56.046 16 switches: flows: 119170 118023 118273 116815 119481 113779 117059 117116 112892 115738 114282 113248 113874 111095 116190 114427 total = 30.806247 per ms 03:36:56.147 16 switches: flows: 125512 122337 126119 125594 125363 123818 122706 124517 121190 122015 119797 118804 119034 119218 123581 122876 total = 32.653497 per ms 03:37:56.247 16 switches: flows: 124293 123170 126207 125112 127057 123451 120852 123190 120853 122655 118376 119178 119900 119248 123129 121284 total = 32.578181 per ms 03:38:56.347 16 switches: flows: 119136 118469 120839 120910 120274 117914 115574 116771 114449 116308 113914 114577 113177 113789 118752 117355 total = 31.151442 per ms 03:39:56.447 16 switches: flows: 125906 127458 125795 122921 124834 122962 122377 123807 123258 120086 118097 123014 117200 121795 122207 122993 total = 32.690609 per ms 03:40:56.548 16 switches: flows: 121106 121317 120887 117519 122182 118342 116829 119168 118486 114943 114296 117263 115971 114721 117699 118248 total = 31.430463 per ms 03:41:56.648 16 switches: flows: 114669 117027 117395 113369 116576 113974 113311 113222 113746 110625 108765 112523 108964 110986 111144 112671 total = 30.099166 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 30099.17/32690.61/31656.71/10586.08 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 30099.17/32690.61/31656.71/10586.08 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 30099.17/32690.61/31656.71/10586.08 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 30099.17/32690.61/31656.71/10586.08 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 30099.17 | 32690.61 | 31656.71 | 10586.08 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 30099.17 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 32690.61 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 31656.71 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 10586.08 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 30099.17 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 32690.61 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 31656.71 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 10586.08 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-05-14 03:41:56 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-05-14 03:41:56,-m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,30099.17,32690.61,31656.71,10586.08 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/bug.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/bug.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} bug.csv Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. ${test_skipped} = False ${test_skipped} len(re.findall('SKIPPED', """${TEST_MESSAGE}""")) > 0 modules=re Evaluates the given expression in Python and returns the result. Jira tickets are {PROJECT}-{NUMBER} while Bugzilla tickets are {NUMBER} Displays the given messages in the log file as keyword arguments. ${match} Should Contain ${number} - Runs the specified keyword and returns the status as a Boolean value. ${bug_url} ${match} https://jira.opendaylight.org/browse/${number} https://bugs.opendaylight.org/show_bug.cgi?id=${number} Sets variable based on the given condition. ${msg} This test fails due to ${bug_url} Returns the given values which can then be assigned to a variables. ${newline} chr(10) Evaluates the given expression in Python and returns the result. ${msg}${newline}${newline}${TEST_MESSAGE} Sets message for the current test case. ${msg} Logs the given message with the given level. ${bug_url} Adds given ``tags`` for the current test or all tests in a suite. 6176 Report that a test failed due to a known Bugzilla bug whose number is provided as an argument. Not FAILED (incl. SKIPPED) test are not reported. This keyword must be used in the [Teardown] setting of the affected test or as the first line of the test if FastFail module is not being used. It reports the URL of the bug on console and also puts it into the Robot log file. cbench executed in latency mode to see if controller is healthy cbench latency Cbench Latency and Throughput tests can be run from an external cbench. If cbench is run with a medium number of switches or higher (e.g. 32+) the normal openflow operations seem to break. BUG: https://bugs.opendaylight.org/show_bug.cgi?id=2897 All Tests cbench latency throughput openflowplugin-cbench.txt