Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.117:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>log:set ERROR ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} log:set ${log_level} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.117 Note that this keyword will open&close new SSH connection, without switching back to previously current session. 3x 1s KarafKeywords.Issue Command On Karaf Console log:set ${log_level} Runs the specified keyword and retries if it fails. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-titanium/latency.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-titanium/latency.csv</a>'. ${latency_results_file} LATENCY_MIN,LATENCY_MAX,LATENCY_AVERAGE\n Appends the given content to the specified file. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-titanium/throughput.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-titanium/throughput.csv</a>'. ${throughput_results_file} THROUGHPUT_MIN,THROUGHPUT_MAX,THROUGHPUT_AVERAGE\n Appends the given content to the specified file. ${duration_in_ms} = 60000 ${duration_in_ms} ${duration_in_secs} * 1000 Evaluates the given expression in Python and returns the result. ${duration_in_ms} = 60000 ${duration_in_ms} Makes a variable available everywhere within the scope of the current suite. ${test_timeout} = 900.0 ${test_timeout} (${loops} * ${duration_in_secs}) * 1.5 Evaluates the given expression in Python and returns the result. ${test_timeout} = 900.0 ${test_timeout} Makes a variable available everywhere within the scope of the current suite. ${cbench_executable} Fails unless the given ``path`` points to an existing file. ${conn_id} = 2 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.76:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Sun Jul 19 04:42:43 UTC 2026 System load: 0.11 Processes: 111 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.76 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. [?2004h[jenkins@releng-48317-784-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. [chan 1] Opened sftp connection (server version 3) ${file} Fails if the given ``path`` does NOT point to an existing file. Closes the current connection. ${cbench_system} ${cbench_executable} Will create connection with public key and will PASS if the given ${file} exists, otherwise will FAIL ${loops} >= 2 If number of loops is less than 2, cbench will not run Fails if the given condition is not true. Not A Karaf App Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.117:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>feature:list -i | 0[C 0g[Krep odl-openflowplugin-drop-test ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.20.2 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.20.2 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.20.2 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.20.2 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} feature:list -i | grep ${feature_name} ${controller} ${karaf_port} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.117 Note that this keyword will open&close new SSH connection, without switching back to previously current session. ${output} ${feature_name} Fails if ``container`` does not contain ``item`` one or more times. ${output} odl-openflowplugin-drop-test Will Succeed if the given ${feature_name} is found in the output of "feature:list -i" Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.117:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>dropallpacketsrpc on ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} dropallpacketsrpc on Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.117 Note that this keyword will open&close new SSH connection, without switching back to previously current session. Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = latency.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.117 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.76" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 5 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.76:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Sun Jul 19 04:42:43 UTC 2026 System load: 0.11 Processes: 111 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.76 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Sun Jul 19 04:42:43 2026 from 10.30.170.74 [?2004h[jenkins@releng-48317-784-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.117 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.117:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.117:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.117. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 04:43:50.025 16 switches: flows: 80870 81579 80325 81284 77828 78089 79103 78726 79050 80024 80452 79049 76219 75060 78414 78223 total = 21.071583 per ms 04:44:50.127 16 switches: flows: 103751 101513 101219 99990 98578 103084 101661 100504 100638 100001 98865 98169 96800 98547 100660 98267 total = 26.659617 per ms 04:45:50.227 16 switches: flows: 108545 108417 111003 109341 108718 109044 107634 111420 106393 107690 104755 104962 101327 103048 107743 105727 total = 28.548486 per ms 04:46:50.328 16 switches: flows: 118730 119258 121378 121377 121482 121891 120607 120527 118632 118820 115315 116510 112261 114990 118386 115580 total = 31.543059 per ms 04:47:50.428 16 switches: flows: 120906 121112 124603 123189 122036 122018 121472 123744 120628 120435 117952 117071 114196 115771 119906 117396 total = 31.987184 per ms 04:48:50.528 16 switches: flows: 123079 122625 123372 123150 122379 124382 123045 123205 121008 120429 119288 118476 117520 116208 120398 117567 total = 32.215030 per ms 04:49:50.630 16 switches: flows: 124773 123831 123603 123071 121737 123904 122754 124377 119709 121991 119998 118793 116878 116908 120147 118671 total = 32.298501 per ms 04:50:50.730 16 switches: flows: 125691 122422 122741 124524 121667 123178 123232 124527 120612 122770 121635 118828 118524 119969 120237 117731 total = 32.417382 per ms 04:51:50.830 16 switches: flows: 114697 115508 115441 114064 112321 113759 113312 113430 111226 112925 112311 109393 107740 110344 111008 109759 total = 29.904053 per ms 04:52:50.931 16 switches: flows: 122605 124823 124824 120833 120065 124311 121565 123108 121108 118611 116788 120422 117507 117170 120362 118498 total = 32.156326 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 26659.62/32417.38/30858.85/10466.44 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.117:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.117:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.117. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 04:43:50.025 16 switches: flows: 80870 81579 80325 81284 77828 78089 79103 78726 79050 80024 80452 79049 76219 75060 78414 78223 total = 21.071583 per ms 04:44:50.127 16 switches: flows: 103751 101513 101219 99990 98578 103084 101661 100504 100638 100001 98865 98169 96800 98547 100660 98267 total = 26.659617 per ms 04:45:50.227 16 switches: flows: 108545 108417 111003 109341 108718 109044 107634 111420 106393 107690 104755 104962 101327 103048 107743 105727 total = 28.548486 per ms 04:46:50.328 16 switches: flows: 118730 119258 121378 121377 121482 121891 120607 120527 118632 118820 115315 116510 112261 114990 118386 115580 total = 31.543059 per ms 04:47:50.428 16 switches: flows: 120906 121112 124603 123189 122036 122018 121472 123744 120628 120435 117952 117071 114196 115771 119906 117396 total = 31.987184 per ms 04:48:50.528 16 switches: flows: 123079 122625 123372 123150 122379 124382 123045 123205 121008 120429 119288 118476 117520 116208 120398 117567 total = 32.215030 per ms 04:49:50.630 16 switches: flows: 124773 123831 123603 123071 121737 123904 122754 124377 119709 121991 119998 118793 116878 116908 120147 118671 total = 32.298501 per ms 04:50:50.730 16 switches: flows: 125691 122422 122741 124524 121667 123178 123232 124527 120612 122770 121635 118828 118524 119969 120237 117731 total = 32.417382 per ms 04:51:50.830 16 switches: flows: 114697 115508 115441 114064 112321 113759 113312 113430 111226 112925 112311 109393 107740 110344 111008 109759 total = 29.904053 per ms 04:52:50.931 16 switches: flows: 122605 124823 124824 120833 120065 124311 121565 123108 121108 118611 116788 120422 117507 117170 120362 118498 total = 32.156326 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 26659.62/32417.38/30858.85/10466.44 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 26659.62/32417.38/30858.85/10466.44 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 26659.62/32417.38/30858.85/10466.44 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 26659.62/32417.38/30858.85/10466.44 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 26659.62 | 32417.38 | 30858.85 | 10466.44 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 26659.62 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 32417.38 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 30858.85 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 10466.44 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 26659.62 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 32417.38 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 30858.85 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 10466.44 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-07-19 04:52:50 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-07-19 04:52:50,-m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,26659.62,32417.38,30858.85,10466.44 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-titanium/latency.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-titanium/latency.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} ${latency_results_file} Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in default latency mode. Test parameters have defaults, but can be overridden on the pybot command line cbench latency Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = throughput.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.117 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.76" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 7 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.76:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Sun Jul 19 04:52:51 UTC 2026 System load: 1.0 Processes: 104 Usage of /: 19.8% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.76 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Sun Jul 19 04:42:44 2026 from 10.30.170.74 [?2004h[jenkins@releng-48317-784-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.117 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 1. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.117:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.117:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.117. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 04:53:56.729 16 switches: flows: 494608 518585 501708 486535 493182 500357 475737 495536 488693 470894 489897 488843 462492 479935 501823 495205 total = 130.733833 per ms 04:54:56.830 16 switches: flows: 497460 487952 504078 499953 512222 507271 516611 504970 502913 499909 493941 504295 493786 510801 467428 501511 total = 133.193599 per ms 04:55:56.933 16 switches: flows: 286933 291494 277641 296682 282676 271807 295402 290958 303299 156083 297733 273601 298791 281308 283280 280697 total = 74.346580 per ms 04:56:57.034 16 switches: flows: 577717 565186 575263 565891 581868 588144 584995 570439 569134 577575 568428 568569 570141 565413 566360 574323 total = 152.566730 per ms 04:57:57.136 16 switches: flows: 520111 520810 517928 519225 520940 520156 521192 513672 520253 519188 515698 514427 531397 523850 523105 522051 total = 138.500684 per ms 04:58:57.239 16 switches: flows: 418676 410930 474743 430187 488965 467269 463524 470945 477626 480093 393252 423132 453642 470345 430180 417245 total = 119.310931 per ms 04:59:57.341 16 switches: flows: 511560 533671 542286 526545 519480 505038 507864 529736 508400 533673 505027 521338 526145 525947 535287 540039 total = 139.298157 per ms controller msgbuf_read() = 0: closed connection ... exiting ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.117:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.117:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.117. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 04:53:56.729 16 switches: flows: 494608 518585 501708 486535 493182 500357 475737 495536 488693 470894 489897 488843 462492 479935 501823 495205 total = 130.733833 per ms 04:54:56.830 16 switches: flows: 497460 487952 504078 499953 512222 507271 516611 504970 502913 499909 493941 504295 493786 510801 467428 501511 total = 133.193599 per ms 04:55:56.933 16 switches: flows: 286933 291494 277641 296682 282676 271807 295402 290958 303299 156083 297733 273601 298791 281308 283280 280697 total = 74.346580 per ms 04:56:57.034 16 switches: flows: 577717 565186 575263 565891 581868 588144 584995 570439 569134 577575 568428 568569 570141 565413 566360 574323 total = 152.566730 per ms 04:57:57.136 16 switches: flows: 520111 520810 517928 519225 520940 520156 521192 513672 520253 519188 515698 514427 531397 523850 523105 522051 total = 138.500684 per ms 04:58:57.239 16 switches: flows: 418676 410930 474743 430187 488965 467269 463524 470945 477626 480093 393252 423132 453642 470345 430180 417245 total = 119.310931 per ms 04:59:57.341 16 switches: flows: 511560 533671 542286 526545 519480 505038 507864 529736 508400 533673 505027 521338 526145 525947 535287 540039 total = 139.298157 per ms controller msgbuf_read() = 0: closed connection ... exiting ${output} Logs the given message with the given level. 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.117:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.117. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 04:53:56.729 16 switches: flows: 494608 518585 501708 486535 493182 500357 475737 495536 488693 470894 489897 488843 462492 479935 501823 495205 total = 130.733833 per ms 04:54:56.830 16 switches: flows: 497460 487952 504078 499953 512222 507271 516611 504970 502913 499909 493941 504295 493786 510801 467428 501511 total = 133.193599 per ms 04:55:56.933 16 switches: flows: 286933 291494 277641 296682 282676 271807 295402 290958 303299 156083 297733 273601 298791 281308 283280 280697 total = 74.346580 per ms 04:56:57.034 16 switches: flows: 577717 565186 575263 565891 581868 588144 584995 570439 569134 577575 568428 568569 570141 565413 566360 574323 total = 152.566730 per ms 04:57:57.136 16 switches: flows: 520111 520810 517928 519225 520940 520156 521192 513672 520253 519188 515698 514427 531397 523850 523105 522051 total = 138.500684 per ms 04:58:57.239 16 switches: flows: 418676 410930 474743 430187 488965 467269 463524 470945 477626 480093 393252 423132 453642 470345 430180 417245 total = 119.310931 per ms 04:59:57.341 16 switches: flows: 511560 533671 542286 526545 519480 505038 507864 529736 508400 533673 505027 521338 526145 525947 535287 540039 total = 139.298157 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.117:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.117. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 04:53:56.729 16 switches: flows: 494608 518585 501708 486535 493182 500357 475737 495536 488693 470894 489897 488843 462492 479935 501823 495205 total = 130.733833 per ms 04:54:56.830 16 switches: flows: 497460 487952 504078 499953 512222 507271 516611 504970 502913 499909 493941 504295 493786 510801 467428 501511 total = 133.193599 per ms 04:55:56.933 16 switches: flows: 286933 291494 277641 296682 282676 271807 295402 290958 303299 156083 297733 273601 298791 281308 283280 280697 total = 74.346580 per ms 04:56:57.034 16 switches: flows: 577717 565186 575263 565891 581868 588144 584995 570439 569134 577575 568428 568569 570141 565413 566360 574323 total = 152.566730 per ms 04:57:57.136 16 switches: flows: 520111 520810 517928 519225 520940 520156 521192 513672 520253 519188 515698 514427 531397 523850 523105 522051 total = 138.500684 per ms 04:58:57.239 16 switches: flows: 418676 410930 474743 430187 488965 467269 463524 470945 477626 480093 393252 423132 453642 470345 430180 417245 total = 119.310931 per ms 04:59:57.341 16 switches: flows: 511560 533671 542286 526545 519480 505038 507864 529736 508400 533673 505027 521338 526145 525947 535287 540039 total = 139.298157 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. ${results_list[5]} Logs the given message with the given level. ${results_list[7]} Logs the given message with the given level. @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. ${i} 0 ${num_stats} ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} d,m,s Returns the given time in the requested format. CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. ${min} ${max} ${average} ${average_threshold} ${output_filename} -t -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${throughput_threshold} ${throughput_results_file} 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.117:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.117. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 04:53:56.729 16 switches: flows: 494608 518585 501708 486535 493182 500357 475737 495536 488693 470894 489897 488843 462492 479935 501823 495205 total = 130.733833 per ms 04:54:56.830 16 switches: flows: 497460 487952 504078 499953 512222 507271 516611 504970 502913 499909 493941 504295 493786 510801 467428 501511 total = 133.193599 per ms 04:55:56.933 16 switches: flows: 286933 291494 277641 296682 282676 271807 295402 290958 303299 156083 297733 273601 298791 281308 283280 280697 total = 74.346580 per ms 04:56:57.034 16 switches: flows: 577717 565186 575263 565891 581868 588144 584995 570439 569134 577575 568428 568569 570141 565413 566360 574323 total = 152.566730 per ms 04:57:57.136 16 switches: flows: 520111 520810 517928 519225 520940 520156 521192 513672 520253 519188 515698 514427 531397 523850 523105 522051 total = 138.500684 per ms 04:58:57.239 16 switches: flows: 418676 410930 474743 430187 488965 467269 463524 470945 477626 480093 393252 423132 453642 470345 430180 417245 total = 119.310931 per ms 04:59:57.341 16 switches: flows: 511560 533671 542286 526545 519480 505038 507864 529736 508400 533673 505027 521338 526145 525947 535287 540039 total = 139.298157 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in throughput mode (-t). Test parameters have defaults, but can be overridden on the pybot command line cbench throughput 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.117:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.117. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 04:53:56.729 16 switches: flows: 494608 518585 501708 486535 493182 500357 475737 495536 488693 470894 489897 488843 462492 479935 501823 495205 total = 130.733833 per ms 04:54:56.830 16 switches: flows: 497460 487952 504078 499953 512222 507271 516611 504970 502913 499909 493941 504295 493786 510801 467428 501511 total = 133.193599 per ms 04:55:56.933 16 switches: flows: 286933 291494 277641 296682 282676 271807 295402 290958 303299 156083 297733 273601 298791 281308 283280 280697 total = 74.346580 per ms 04:56:57.034 16 switches: flows: 577717 565186 575263 565891 581868 588144 584995 570439 569134 577575 568428 568569 570141 565413 566360 574323 total = 152.566730 per ms 04:57:57.136 16 switches: flows: 520111 520810 517928 519225 520940 520156 521192 513672 520253 519188 515698 514427 531397 523850 523105 522051 total = 138.500684 per ms 04:58:57.239 16 switches: flows: 418676 410930 474743 430187 488965 467269 463524 470945 477626 480093 393252 423132 453642 470345 430180 417245 total = 119.310931 per ms 04:59:57.341 16 switches: flows: 511560 533671 542286 526545 519480 505038 507864 529736 508400 533673 505027 521338 526145 525947 535287 540039 total = 139.298157 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = bug.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.117 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.76" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 9 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.76:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Sun Jul 19 05:00:37 UTC 2026 System load: 0.19 Processes: 106 Usage of /: 19.8% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.76 Swap usage: 0% * Strictly confined Kubernetes makes edge and IoT secure. Learn how MicroK8s just raised the bar for easy, resilient and secure K8s cluster deployment. https://ubuntu.com/engage/secure-kubernetes-at-the-edge Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Sun Jul 19 04:52:51 2026 from 10.30.170.74 [?2004h[jenkins@releng-48317-784-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.117 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.117:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.117:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.117. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 05:01:43.547 16 switches: flows: 97456 105023 95785 96180 95692 95250 94827 96185 93049 94590 94014 94592 99508 92324 93534 93728 total = 25.528950 per ms 05:02:43.648 16 switches: flows: 117056 113336 115078 114382 114858 115540 114407 113754 111919 113903 113546 114772 112376 111736 113347 113368 total = 30.338930 per ms 05:03:43.749 16 switches: flows: 117802 114270 115164 114447 115635 115456 114810 115976 111772 115379 112908 114086 113418 111005 113763 114322 total = 30.452712 per ms 05:04:43.851 16 switches: flows: 113698 110916 111687 110304 111112 110695 111887 112233 109522 112102 110646 111618 109018 107999 111237 110112 total = 29.530452 per ms 05:05:43.952 16 switches: flows: 104154 101499 102487 102861 103944 103735 101568 102867 99864 102486 100796 101004 101209 100482 104035 99625 total = 27.164895 per ms 05:06:44.053 16 switches: flows: 110506 110236 108410 110572 109697 107932 110488 108150 107532 107866 108187 109585 106527 106202 108580 109490 total = 28.950990 per ms 05:07:44.154 16 switches: flows: 107509 105790 105609 105605 104866 104100 105403 105052 102658 104285 104572 103543 103149 101862 103686 104251 total = 27.819209 per ms 05:08:44.256 16 switches: flows: 103266 101773 101793 103736 103258 101414 102537 103648 101568 100930 101045 99853 100466 99362 101096 98967 total = 27.033385 per ms 05:09:44.357 16 switches: flows: 98882 98659 97583 98739 99410 97128 97065 99173 96194 96716 96305 96894 95870 94288 97453 96283 total = 25.900770 per ms 05:10:44.458 16 switches: flows: 84775 84344 84257 85987 85031 87067 86021 86594 84665 86294 84286 85494 84695 82655 84389 84762 total = 22.650775 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 22650.77/30452.71/27760.24/9542.49 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.117:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.117:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.117. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 05:01:43.547 16 switches: flows: 97456 105023 95785 96180 95692 95250 94827 96185 93049 94590 94014 94592 99508 92324 93534 93728 total = 25.528950 per ms 05:02:43.648 16 switches: flows: 117056 113336 115078 114382 114858 115540 114407 113754 111919 113903 113546 114772 112376 111736 113347 113368 total = 30.338930 per ms 05:03:43.749 16 switches: flows: 117802 114270 115164 114447 115635 115456 114810 115976 111772 115379 112908 114086 113418 111005 113763 114322 total = 30.452712 per ms 05:04:43.851 16 switches: flows: 113698 110916 111687 110304 111112 110695 111887 112233 109522 112102 110646 111618 109018 107999 111237 110112 total = 29.530452 per ms 05:05:43.952 16 switches: flows: 104154 101499 102487 102861 103944 103735 101568 102867 99864 102486 100796 101004 101209 100482 104035 99625 total = 27.164895 per ms 05:06:44.053 16 switches: flows: 110506 110236 108410 110572 109697 107932 110488 108150 107532 107866 108187 109585 106527 106202 108580 109490 total = 28.950990 per ms 05:07:44.154 16 switches: flows: 107509 105790 105609 105605 104866 104100 105403 105052 102658 104285 104572 103543 103149 101862 103686 104251 total = 27.819209 per ms 05:08:44.256 16 switches: flows: 103266 101773 101793 103736 103258 101414 102537 103648 101568 100930 101045 99853 100466 99362 101096 98967 total = 27.033385 per ms 05:09:44.357 16 switches: flows: 98882 98659 97583 98739 99410 97128 97065 99173 96194 96716 96305 96894 95870 94288 97453 96283 total = 25.900770 per ms 05:10:44.458 16 switches: flows: 84775 84344 84257 85987 85031 87067 86021 86594 84665 86294 84286 85494 84695 82655 84389 84762 total = 22.650775 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 22650.77/30452.71/27760.24/9542.49 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 22650.77/30452.71/27760.24/9542.49 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 22650.77/30452.71/27760.24/9542.49 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 22650.77/30452.71/27760.24/9542.49 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 22650.77 | 30452.71 | 27760.24 | 9542.49 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 22650.77 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 30452.71 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 27760.24 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 9542.49 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 22650.77 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 30452.71 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 27760.24 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 9542.49 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-07-19 05:10:44 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-07-19 05:10:44,-m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,22650.77,30452.71,27760.24,9542.49 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-titanium/bug.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-titanium/bug.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} bug.csv Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. ${test_skipped} = False ${test_skipped} len(re.findall('SKIPPED', """${TEST_MESSAGE}""")) > 0 modules=re Evaluates the given expression in Python and returns the result. Jira tickets are {PROJECT}-{NUMBER} while Bugzilla tickets are {NUMBER} Displays the given messages in the log file as keyword arguments. ${match} Should Contain ${number} - Runs the specified keyword and returns the status as a Boolean value. ${bug_url} ${match} https://jira.opendaylight.org/browse/${number} https://bugs.opendaylight.org/show_bug.cgi?id=${number} Sets variable based on the given condition. ${msg} This test fails due to ${bug_url} Returns the given values which can then be assigned to a variables. ${newline} chr(10) Evaluates the given expression in Python and returns the result. ${msg}${newline}${newline}${TEST_MESSAGE} Sets message for the current test case. ${msg} Logs the given message with the given level. ${bug_url} Adds given ``tags`` for the current test or all tests in a suite. 6176 Report that a test failed due to a known Bugzilla bug whose number is provided as an argument. Not FAILED (incl. SKIPPED) test are not reported. This keyword must be used in the [Teardown] setting of the affected test or as the first line of the test if FastFail module is not being used. It reports the URL of the bug on console and also puts it into the Robot log file. cbench executed in latency mode to see if controller is healthy cbench latency Cbench Latency and Throughput tests can be run from an external cbench. If cbench is run with a medium number of switches or higher (e.g. 32+) the normal openflow operations seem to break. BUG: https://bugs.opendaylight.org/show_bug.cgi?id=2897 All Tests cbench latency throughput openflowplugin-cbench.txt