Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.20:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>log:set ERROR ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} log:set ${log_level} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.20 Note that this keyword will open&close new SSH connection, without switching back to previously current session. 3x 1s KarafKeywords.Issue Command On Karaf Console log:set ${log_level} Runs the specified keyword and retries if it fails. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-titanium/latency.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-titanium/latency.csv</a>'. ${latency_results_file} LATENCY_MIN,LATENCY_MAX,LATENCY_AVERAGE\n Appends the given content to the specified file. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-titanium/throughput.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-titanium/throughput.csv</a>'. ${throughput_results_file} THROUGHPUT_MIN,THROUGHPUT_MAX,THROUGHPUT_AVERAGE\n Appends the given content to the specified file. ${duration_in_ms} = 60000 ${duration_in_ms} ${duration_in_secs} * 1000 Evaluates the given expression in Python and returns the result. ${duration_in_ms} = 60000 ${duration_in_ms} Makes a variable available everywhere within the scope of the current suite. ${test_timeout} = 900.0 ${test_timeout} (${loops} * ${duration_in_secs}) * 1.5 Evaluates the given expression in Python and returns the result. ${test_timeout} = 900.0 ${test_timeout} Makes a variable available everywhere within the scope of the current suite. ${cbench_executable} Fails unless the given ``path`` points to an existing file. ${conn_id} = 2 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.133:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Tue Aug 4 01:50:16 UTC 2026 System load: 0.06 Processes: 111 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.133 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. [?2004h[jenkins@releng-48317-800-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. [chan 1] Opened sftp connection (server version 3) ${file} Fails if the given ``path`` does NOT point to an existing file. Closes the current connection. ${cbench_system} ${cbench_executable} Will create connection with public key and will PASS if the given ${file} exists, otherwise will FAIL ${loops} >= 2 If number of loops is less than 2, cbench will not run Fails if the given condition is not true. Not A Karaf App Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.20:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>feature:list -i | 0[C 0g[Krep odl-openflowplugin-drop-test ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.20.2 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.20.2 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.20.2 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.20.2 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} feature:list -i | grep ${feature_name} ${controller} ${karaf_port} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.20 Note that this keyword will open&close new SSH connection, without switching back to previously current session. ${output} ${feature_name} Fails if ``container`` does not contain ``item`` one or more times. ${output} odl-openflowplugin-drop-test Will Succeed if the given ${feature_name} is found in the output of "feature:list -i" Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.20:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>dropallpacketsrpc on ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} dropallpacketsrpc on Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.20 Note that this keyword will open&close new SSH connection, without switching back to previously current session. Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = latency.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.20 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.133" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 5 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.133:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Tue Aug 4 01:50:16 UTC 2026 System load: 0.06 Processes: 111 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.133 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Tue Aug 4 01:50:16 2026 from 10.30.170.60 [?2004h[jenkins@releng-48317-800-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.20 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.20:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.20:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.20. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 01:51:22.782 16 switches: flows: 109833 109073 111967 109508 109241 110198 112397 110664 107056 108320 106337 107862 106619 105608 105425 106310 total = 28.940300 per ms 01:52:22.883 16 switches: flows: 119644 119807 122404 117519 118989 120141 119903 118988 117523 118013 114583 117919 116074 114050 113587 115362 total = 31.356101 per ms 01:53:22.984 16 switches: flows: 121173 120681 121445 119365 119649 118709 118002 119542 116567 117192 116285 117176 115751 114577 113882 117892 total = 31.412358 per ms 01:54:23.084 16 switches: flows: 123354 126077 125205 121265 121037 124761 122616 123958 121379 118243 121478 121257 121127 117551 116683 117288 total = 32.333955 per ms 01:55:23.184 16 switches: flows: 124403 126050 124323 123418 121566 125062 127172 126225 121799 119477 122428 121393 121904 119222 120659 120436 total = 32.704345 per ms 01:56:23.285 16 switches: flows: 124663 128556 125321 122716 123640 126488 126946 126560 122963 121744 121890 122188 124147 120311 120122 120185 total = 32.919015 per ms 01:57:23.385 16 switches: flows: 126147 128181 126043 125534 124595 126967 127704 126640 124738 123152 122758 124457 123223 121770 122465 122343 total = 33.223147 per ms 01:58:23.485 16 switches: flows: 125473 128498 125365 124567 124904 126509 126611 125652 123026 121031 122812 123279 122380 119996 120686 121083 total = 32.976172 per ms 01:59:23.586 16 switches: flows: 127170 130299 127412 126565 125633 126860 129667 126664 125877 122376 124910 124825 126330 122246 123132 121787 total = 33.473108 per ms 02:00:23.686 16 switches: flows: 127144 127457 126705 123943 122632 126946 125830 123752 123349 120335 123828 123906 120687 120042 120603 120684 total = 32.909144 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 31356.10/33473.11/32589.71/10886.37 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.20:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.20:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.20. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 01:51:22.782 16 switches: flows: 109833 109073 111967 109508 109241 110198 112397 110664 107056 108320 106337 107862 106619 105608 105425 106310 total = 28.940300 per ms 01:52:22.883 16 switches: flows: 119644 119807 122404 117519 118989 120141 119903 118988 117523 118013 114583 117919 116074 114050 113587 115362 total = 31.356101 per ms 01:53:22.984 16 switches: flows: 121173 120681 121445 119365 119649 118709 118002 119542 116567 117192 116285 117176 115751 114577 113882 117892 total = 31.412358 per ms 01:54:23.084 16 switches: flows: 123354 126077 125205 121265 121037 124761 122616 123958 121379 118243 121478 121257 121127 117551 116683 117288 total = 32.333955 per ms 01:55:23.184 16 switches: flows: 124403 126050 124323 123418 121566 125062 127172 126225 121799 119477 122428 121393 121904 119222 120659 120436 total = 32.704345 per ms 01:56:23.285 16 switches: flows: 124663 128556 125321 122716 123640 126488 126946 126560 122963 121744 121890 122188 124147 120311 120122 120185 total = 32.919015 per ms 01:57:23.385 16 switches: flows: 126147 128181 126043 125534 124595 126967 127704 126640 124738 123152 122758 124457 123223 121770 122465 122343 total = 33.223147 per ms 01:58:23.485 16 switches: flows: 125473 128498 125365 124567 124904 126509 126611 125652 123026 121031 122812 123279 122380 119996 120686 121083 total = 32.976172 per ms 01:59:23.586 16 switches: flows: 127170 130299 127412 126565 125633 126860 129667 126664 125877 122376 124910 124825 126330 122246 123132 121787 total = 33.473108 per ms 02:00:23.686 16 switches: flows: 127144 127457 126705 123943 122632 126946 125830 123752 123349 120335 123828 123906 120687 120042 120603 120684 total = 32.909144 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 31356.10/33473.11/32589.71/10886.37 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 31356.10/33473.11/32589.71/10886.37 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 31356.10/33473.11/32589.71/10886.37 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 31356.10/33473.11/32589.71/10886.37 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 31356.10 | 33473.11 | 32589.71 | 10886.37 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 31356.10 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 33473.11 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 32589.71 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 10886.37 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 31356.10 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 33473.11 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 32589.71 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 10886.37 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-08-04 02:00:23 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-08-04 02:00:23,-m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,31356.10,33473.11,32589.71,10886.37 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-titanium/latency.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-titanium/latency.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} ${latency_results_file} Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in default latency mode. Test parameters have defaults, but can be overridden on the pybot command line cbench latency Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = throughput.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.20 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.133" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 7 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.133:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Tue Aug 4 02:00:23 UTC 2026 System load: 1.04 Processes: 105 Usage of /: 19.8% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.133 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Tue Aug 4 01:50:17 2026 from 10.30.170.60 [?2004h[jenkins@releng-48317-800-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.20 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 1. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.20:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with ... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.20:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.20. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:01:29.495 16 switches: flows: 558378 549659 546520 541880 559510 557446 556442 554495 545461 549750 554173 546548 543114 544654 534426 535371 total = 146.297117 per ms 02:02:29.596 16 switches: flows: 499749 508936 515795 504055 507619 501367 508521 511641 512848 513512 509776 512966 504156 509613 502747 506924 total = 135.275756 per ms 02:03:29.698 16 switches: flows: 523287 514232 513051 513410 524988 515452 514877 516890 517217 519134 521117 522826 515126 525565 517179 519934 total = 138.003847 per ms 02:04:29.800 16 switches: flows: 511392 499597 501010 498057 506255 504222 510538 515949 515274 515209 514297 502638 523535 481805 504376 496202 total = 134.778522 per ms 02:05:36.996 16 switches: flows: 517548 526962 525318 525561 524615 525890 525514 521365 526976 527006 524003 524572 531101 529290 526930 524068 total = 125.106313 per ms 02:06:37.099 16 switches: flows: 579764 575693 587486 585122 584763 580643 395000 582527 585469 586737 575986 419676 584058 584288 591687 589144 total = 149.549100 per ms 02:07:37.200 16 switches: flows: 569309 567451 561762 563148 558983 557436 560326 566075 568280 560312 559915 568207 567760 558814 560399 546797 total = 149.662909 per ms controller msgbuf_read() = 0: closed connection ... exiting ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.20:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with ... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.20:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.20. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:01:29.495 16 switches: flows: 558378 549659 546520 541880 559510 557446 556442 554495 545461 549750 554173 546548 543114 544654 534426 535371 total = 146.297117 per ms 02:02:29.596 16 switches: flows: 499749 508936 515795 504055 507619 501367 508521 511641 512848 513512 509776 512966 504156 509613 502747 506924 total = 135.275756 per ms 02:03:29.698 16 switches: flows: 523287 514232 513051 513410 524988 515452 514877 516890 517217 519134 521117 522826 515126 525565 517179 519934 total = 138.003847 per ms 02:04:29.800 16 switches: flows: 511392 499597 501010 498057 506255 504222 510538 515949 515274 515209 514297 502638 523535 481805 504376 496202 total = 134.778522 per ms 02:05:36.996 16 switches: flows: 517548 526962 525318 525561 524615 525890 525514 521365 526976 527006 524003 524572 531101 529290 526930 524068 total = 125.106313 per ms 02:06:37.099 16 switches: flows: 579764 575693 587486 585122 584763 580643 395000 582527 585469 586737 575986 419676 584058 584288 591687 589144 total = 149.549100 per ms 02:07:37.200 16 switches: flows: 569309 567451 561762 563148 558983 557436 560326 566075 568280 560312 559915 568207 567760 558814 560399 546797 total = 149.662909 per ms controller msgbuf_read() = 0: closed connection ... exiting ${output} Logs the given message with the given level. 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.20:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.20. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:01:29.495 16 switches: flows: 558378 549659 546520 541880 559510 557446 556442 554495 545461 549750 554173 546548 543114 544654 534426 535371 total = 146.297117 per ms 02:02:29.596 16 switches: flows: 499749 508936 515795 504055 507619 501367 508521 511641 512848 513512 509776 512966 504156 509613 502747 506924 total = 135.275756 per ms 02:03:29.698 16 switches: flows: 523287 514232 513051 513410 524988 515452 514877 516890 517217 519134 521117 522826 515126 525565 517179 519934 total = 138.003847 per ms 02:04:29.800 16 switches: flows: 511392 499597 501010 498057 506255 504222 510538 515949 515274 515209 514297 502638 523535 481805 504376 496202 total = 134.778522 per ms 02:05:36.996 16 switches: flows: 517548 526962 525318 525561 524615 525890 525514 521365 526976 527006 524003 524572 531101 529290 526930 524068 total = 125.106313 per ms 02:06:37.099 16 switches: flows: 579764 575693 587486 585122 584763 580643 395000 582527 585469 586737 575986 419676 584058 584288 591687 589144 total = 149.549100 per ms 02:07:37.200 16 switches: flows: 569309 567451 561762 563148 558983 557436 560326 566075 568280 560312 559915 568207 567760 558814 560399 546797 total = 149.662909 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.20:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.20. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:01:29.495 16 switches: flows: 558378 549659 546520 541880 559510 557446 556442 554495 545461 549750 554173 546548 543114 544654 534426 535371 total = 146.297117 per ms 02:02:29.596 16 switches: flows: 499749 508936 515795 504055 507619 501367 508521 511641 512848 513512 509776 512966 504156 509613 502747 506924 total = 135.275756 per ms 02:03:29.698 16 switches: flows: 523287 514232 513051 513410 524988 515452 514877 516890 517217 519134 521117 522826 515126 525565 517179 519934 total = 138.003847 per ms 02:04:29.800 16 switches: flows: 511392 499597 501010 498057 506255 504222 510538 515949 515274 515209 514297 502638 523535 481805 504376 496202 total = 134.778522 per ms 02:05:36.996 16 switches: flows: 517548 526962 525318 525561 524615 525890 525514 521365 526976 527006 524003 524572 531101 529290 526930 524068 total = 125.106313 per ms 02:06:37.099 16 switches: flows: 579764 575693 587486 585122 584763 580643 395000 582527 585469 586737 575986 419676 584058 584288 591687 589144 total = 149.549100 per ms 02:07:37.200 16 switches: flows: 569309 567451 561762 563148 558983 557436 560326 566075 568280 560312 559915 568207 567760 558814 560399 546797 total = 149.662909 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. ${results_list[5]} Logs the given message with the given level. ${results_list[7]} Logs the given message with the given level. @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. ${i} 0 ${num_stats} ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} d,m,s Returns the given time in the requested format. CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. ${min} ${max} ${average} ${average_threshold} ${output_filename} -t -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${throughput_threshold} ${throughput_results_file} 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.20:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.20. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:01:29.495 16 switches: flows: 558378 549659 546520 541880 559510 557446 556442 554495 545461 549750 554173 546548 543114 544654 534426 535371 total = 146.297117 per ms 02:02:29.596 16 switches: flows: 499749 508936 515795 504055 507619 501367 508521 511641 512848 513512 509776 512966 504156 509613 502747 506924 total = 135.275756 per ms 02:03:29.698 16 switches: flows: 523287 514232 513051 513410 524988 515452 514877 516890 517217 519134 521117 522826 515126 525565 517179 519934 total = 138.003847 per ms 02:04:29.800 16 switches: flows: 511392 499597 501010 498057 506255 504222 510538 515949 515274 515209 514297 502638 523535 481805 504376 496202 total = 134.778522 per ms 02:05:36.996 16 switches: flows: 517548 526962 525318 525561 524615 525890 525514 521365 526976 527006 524003 524572 531101 529290 526930 524068 total = 125.106313 per ms 02:06:37.099 16 switches: flows: 579764 575693 587486 585122 584763 580643 395000 582527 585469 586737 575986 419676 584058 584288 591687 589144 total = 149.549100 per ms 02:07:37.200 16 switches: flows: 569309 567451 561762 563148 558983 557436 560326 566075 568280 560312 559915 568207 567760 558814 560399 546797 total = 149.662909 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in throughput mode (-t). Test parameters have defaults, but can be overridden on the pybot command line cbench throughput 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.20:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.20. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:01:29.495 16 switches: flows: 558378 549659 546520 541880 559510 557446 556442 554495 545461 549750 554173 546548 543114 544654 534426 535371 total = 146.297117 per ms 02:02:29.596 16 switches: flows: 499749 508936 515795 504055 507619 501367 508521 511641 512848 513512 509776 512966 504156 509613 502747 506924 total = 135.275756 per ms 02:03:29.698 16 switches: flows: 523287 514232 513051 513410 524988 515452 514877 516890 517217 519134 521117 522826 515126 525565 517179 519934 total = 138.003847 per ms 02:04:29.800 16 switches: flows: 511392 499597 501010 498057 506255 504222 510538 515949 515274 515209 514297 502638 523535 481805 504376 496202 total = 134.778522 per ms 02:05:36.996 16 switches: flows: 517548 526962 525318 525561 524615 525890 525514 521365 526976 527006 524003 524572 531101 529290 526930 524068 total = 125.106313 per ms 02:06:37.099 16 switches: flows: 579764 575693 587486 585122 584763 580643 395000 582527 585469 586737 575986 419676 584058 584288 591687 589144 total = 149.549100 per ms 02:07:37.200 16 switches: flows: 569309 567451 561762 563148 558983 557436 560326 566075 568280 560312 559915 568207 567760 558814 560399 546797 total = 149.662909 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = bug.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.20 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.133" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 9 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.133:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Tue Aug 4 02:08:11 UTC 2026 System load: 0.29 Processes: 104 Usage of /: 19.8% of 38.58GB Users logged in: 0 Memory usage: 5% IPv4 address for ens3: 10.30.170.133 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Tue Aug 4 02:00:24 2026 from 10.30.170.60 [?2004h[jenkins@releng-48317-800-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.20 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.20:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.20:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.20. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:09:17.365 16 switches: flows: 104787 109074 104061 107470 104529 104433 104078 105907 106017 103897 105466 103745 104042 106621 105840 104709 total = 28.077933 per ms 02:10:17.466 16 switches: flows: 124743 126949 122081 127457 123874 122398 121600 124464 126355 121543 123165 121654 123601 124758 123702 123320 total = 32.972705 per ms 02:11:17.566 16 switches: flows: 116479 118939 116947 117910 115864 113697 117219 115209 117097 113403 115678 115148 115087 118047 114513 115076 total = 30.886994 per ms 02:12:17.666 16 switches: flows: 119235 121269 119345 121291 119312 119478 117840 119223 121589 116794 120806 115650 121733 120984 118655 119772 total = 31.829815 per ms 02:13:17.766 16 switches: flows: 124246 126858 123340 124389 123082 122326 122214 123221 124166 122363 122042 120467 123330 124329 121918 124218 total = 32.820377 per ms 02:14:17.867 16 switches: flows: 124090 126437 122772 125707 122428 121921 121186 121763 124255 121758 122527 122085 121934 124111 121918 123504 total = 32.751956 per ms 02:15:17.969 16 switches: flows: 124993 127001 124760 126530 123875 124023 121761 123177 125152 121704 124099 121579 124289 125576 124157 125293 total = 33.076366 per ms 02:16:18.069 16 switches: flows: 124457 127757 125386 126685 122560 123222 123394 124687 125551 123000 123883 120478 124902 125211 124126 125965 total = 33.132426 per ms 02:17:18.170 16 switches: flows: 125028 128397 123658 125880 124210 122505 123534 123509 125956 120846 124150 120636 124840 124300 123355 124953 total = 33.040738 per ms 02:18:18.270 16 switches: flows: 119080 121424 118600 120779 119492 117006 117581 116283 120142 115474 117843 115107 117230 118907 117985 118899 total = 31.477986 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 30886.99/33132.43/32443.26/10842.54 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.20:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.20:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.20. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:09:17.365 16 switches: flows: 104787 109074 104061 107470 104529 104433 104078 105907 106017 103897 105466 103745 104042 106621 105840 104709 total = 28.077933 per ms 02:10:17.466 16 switches: flows: 124743 126949 122081 127457 123874 122398 121600 124464 126355 121543 123165 121654 123601 124758 123702 123320 total = 32.972705 per ms 02:11:17.566 16 switches: flows: 116479 118939 116947 117910 115864 113697 117219 115209 117097 113403 115678 115148 115087 118047 114513 115076 total = 30.886994 per ms 02:12:17.666 16 switches: flows: 119235 121269 119345 121291 119312 119478 117840 119223 121589 116794 120806 115650 121733 120984 118655 119772 total = 31.829815 per ms 02:13:17.766 16 switches: flows: 124246 126858 123340 124389 123082 122326 122214 123221 124166 122363 122042 120467 123330 124329 121918 124218 total = 32.820377 per ms 02:14:17.867 16 switches: flows: 124090 126437 122772 125707 122428 121921 121186 121763 124255 121758 122527 122085 121934 124111 121918 123504 total = 32.751956 per ms 02:15:17.969 16 switches: flows: 124993 127001 124760 126530 123875 124023 121761 123177 125152 121704 124099 121579 124289 125576 124157 125293 total = 33.076366 per ms 02:16:18.069 16 switches: flows: 124457 127757 125386 126685 122560 123222 123394 124687 125551 123000 123883 120478 124902 125211 124126 125965 total = 33.132426 per ms 02:17:18.170 16 switches: flows: 125028 128397 123658 125880 124210 122505 123534 123509 125956 120846 124150 120636 124840 124300 123355 124953 total = 33.040738 per ms 02:18:18.270 16 switches: flows: 119080 121424 118600 120779 119492 117006 117581 116283 120142 115474 117843 115107 117230 118907 117985 118899 total = 31.477986 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 30886.99/33132.43/32443.26/10842.54 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 30886.99/33132.43/32443.26/10842.54 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 30886.99/33132.43/32443.26/10842.54 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 30886.99/33132.43/32443.26/10842.54 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 30886.99 | 33132.43 | 32443.26 | 10842.54 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 30886.99 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 33132.43 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 32443.26 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 10842.54 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 30886.99 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 33132.43 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 32443.26 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 10842.54 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-08-04 02:18:18 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-08-04 02:18:18,-m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,30886.99,33132.43,32443.26,10842.54 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-titanium/bug.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-titanium/bug.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} bug.csv Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. ${test_skipped} = False ${test_skipped} len(re.findall('SKIPPED', """${TEST_MESSAGE}""")) > 0 modules=re Evaluates the given expression in Python and returns the result. Jira tickets are {PROJECT}-{NUMBER} while Bugzilla tickets are {NUMBER} Displays the given messages in the log file as keyword arguments. ${match} Should Contain ${number} - Runs the specified keyword and returns the status as a Boolean value. ${bug_url} ${match} https://jira.opendaylight.org/browse/${number} https://bugs.opendaylight.org/show_bug.cgi?id=${number} Sets variable based on the given condition. ${msg} This test fails due to ${bug_url} Returns the given values which can then be assigned to a variables. ${newline} chr(10) Evaluates the given expression in Python and returns the result. ${msg}${newline}${newline}${TEST_MESSAGE} Sets message for the current test case. ${msg} Logs the given message with the given level. ${bug_url} Adds given ``tags`` for the current test or all tests in a suite. 6176 Report that a test failed due to a known Bugzilla bug whose number is provided as an argument. Not FAILED (incl. SKIPPED) test are not reported. This keyword must be used in the [Teardown] setting of the affected test or as the first line of the test if FastFail module is not being used. It reports the URL of the bug on console and also puts it into the Robot log file. cbench executed in latency mode to see if controller is healthy cbench latency Cbench Latency and Throughput tests can be run from an external cbench. If cbench is run with a medium number of switches or higher (e.g. 32+) the normal openflow operations seem to break. BUG: https://bugs.opendaylight.org/show_bug.cgi?id=2897 All Tests cbench latency throughput openflowplugin-cbench.txt