Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.179:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>log:set ERROR ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} log:set ${log_level} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.179 Note that this keyword will open&close new SSH connection, without switching back to previously current session. 3x 1s KarafKeywords.Issue Command On Karaf Console log:set ${log_level} Runs the specified keyword and retries if it fails. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/latency.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/latency.csv</a>'. ${latency_results_file} LATENCY_MIN,LATENCY_MAX,LATENCY_AVERAGE\n Appends the given content to the specified file. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/throughput.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/throughput.csv</a>'. ${throughput_results_file} THROUGHPUT_MIN,THROUGHPUT_MAX,THROUGHPUT_AVERAGE\n Appends the given content to the specified file. ${duration_in_ms} = 60000 ${duration_in_ms} ${duration_in_secs} * 1000 Evaluates the given expression in Python and returns the result. ${duration_in_ms} = 60000 ${duration_in_ms} Makes a variable available everywhere within the scope of the current suite. ${test_timeout} = 900.0 ${test_timeout} (${loops} * ${duration_in_secs}) * 1.5 Evaluates the given expression in Python and returns the result. ${test_timeout} = 900.0 ${test_timeout} Makes a variable available everywhere within the scope of the current suite. ${cbench_executable} Fails unless the given ``path`` points to an existing file. ${conn_id} = 2 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.64:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Mon Aug 3 00:47:43 UTC 2026 System load: 0.05 Processes: 111 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.64 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. [?2004h[jenkins@releng-63164-359-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. [chan 1] Opened sftp connection (server version 3) ${file} Fails if the given ``path`` does NOT point to an existing file. Closes the current connection. ${cbench_system} ${cbench_executable} Will create connection with public key and will PASS if the given ${file} exists, otherwise will FAIL ${loops} >= 2 If number of loops is less than 2, cbench will not run Fails if the given condition is not true. Not A Karaf App Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.179:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>feature:list -i | 0[C 0g[Krep odl-openflowplugin-drop-test ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.3 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.3 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.3 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.3 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} feature:list -i | grep ${feature_name} ${controller} ${karaf_port} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.179 Note that this keyword will open&close new SSH connection, without switching back to previously current session. ${output} ${feature_name} Fails if ``container`` does not contain ``item`` one or more times. ${output} odl-openflowplugin-drop-test Will Succeed if the given ${feature_name} is found in the output of "feature:list -i" Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.179:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>dropallpacketsrpc on ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} dropallpacketsrpc on Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.179 Note that this keyword will open&close new SSH connection, without switching back to previously current session. Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = latency.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.179 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.64" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 5 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.64:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Mon Aug 3 00:47:43 UTC 2026 System load: 0.05 Processes: 111 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.64 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Mon Aug 3 00:47:44 2026 from 10.30.170.49 [?2004h[jenkins@releng-63164-359-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.179 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 1. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.179:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.179:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.179. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:48:50.431 16 switches: flows: 94645 95621 96067 96549 94757 95036 94439 95464 93195 92452 91336 92429 92657 92847 91329 94768 total = 25.059850 per ms 00:49:50.532 16 switches: flows: 109789 111164 113044 110221 110207 110869 110486 110690 110028 111329 107069 110160 106957 106323 107086 107105 total = 29.160105 per ms 00:50:50.633 16 switches: flows: 113269 111756 114807 111908 113242 113176 112027 113924 114047 111822 108365 112579 110268 108529 109108 111661 total = 29.791747 per ms 00:51:50.733 16 switches: flows: 115620 116585 117643 116062 116176 116404 115080 117259 115755 115548 112317 115232 113064 110786 111490 115210 total = 30.619422 per ms 00:52:50.834 16 switches: flows: 114344 115746 116257 114496 115927 116157 116017 114233 114796 114849 112770 115025 112197 111620 111431 113859 total = 30.444490 per ms 00:53:50.935 16 switches: flows: 114799 115757 116109 115172 115396 115624 115111 113595 115905 115338 113215 114908 112599 110922 111096 113527 total = 30.433721 per ms 00:54:51.036 16 switches: flows: 114819 115812 117245 114434 116667 114436 115444 113894 115051 115202 112377 114459 111933 111364 111640 114534 total = 30.437690 per ms 00:55:51.137 16 switches: flows: 110245 111768 112479 111590 112440 110104 111318 110922 111599 111781 109047 110335 108216 109591 108044 110828 total = 29.455931 per ms 00:56:51.237 16 switches: flows: 45495 46130 45270 44344 42186 44558 44837 44585 44841 40924 43786 44520 44313 43028 44053 44247 total = 11.765649 per ms controller msgbuf_read() = -1: msgbuf_read: Connection reset by peer ... exiting ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.179:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.179:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.179. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:48:50.431 16 switches: flows: 94645 95621 96067 96549 94757 95036 94439 95464 93195 92452 91336 92429 92657 92847 91329 94768 total = 25.059850 per ms 00:49:50.532 16 switches: flows: 109789 111164 113044 110221 110207 110869 110486 110690 110028 111329 107069 110160 106957 106323 107086 107105 total = 29.160105 per ms 00:50:50.633 16 switches: flows: 113269 111756 114807 111908 113242 113176 112027 113924 114047 111822 108365 112579 110268 108529 109108 111661 total = 29.791747 per ms 00:51:50.733 16 switches: flows: 115620 116585 117643 116062 116176 116404 115080 117259 115755 115548 112317 115232 113064 110786 111490 115210 total = 30.619422 per ms 00:52:50.834 16 switches: flows: 114344 115746 116257 114496 115927 116157 116017 114233 114796 114849 112770 115025 112197 111620 111431 113859 total = 30.444490 per ms 00:53:50.935 16 switches: flows: 114799 115757 116109 115172 115396 115624 115111 113595 115905 115338 113215 114908 112599 110922 111096 113527 total = 30.433721 per ms 00:54:51.036 16 switches: flows: 114819 115812 117245 114434 116667 114436 115444 113894 115051 115202 112377 114459 111933 111364 111640 114534 total = 30.437690 per ms 00:55:51.137 16 switches: flows: 110245 111768 112479 111590 112440 110104 111318 110922 111599 111781 109047 110335 108216 109591 108044 110828 total = 29.455931 per ms 00:56:51.237 16 switches: flows: 45495 46130 45270 44344 42186 44558 44837 44585 44841 40924 43786 44520 44313 43028 44053 44247 total = 11.765649 per ms controller msgbuf_read() = -1: msgbuf_read: Connection reset by peer ... exiting ${output} Logs the given message with the given level. 'cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.179:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.179. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:48:50.431 16 switches: flows: 94645 95621 96067 96549 94757 95036 94439 95464 93195 92452 91336 92429 92657 92847 91329 94768 total = 25.059850 per ms 00:49:50.532 16 switches: flows: 109789 111164 113044 110221 110207 110869 110486 110690 110028 111329 107069 110160 106957 106323 107086 107105 total = 29.160105 per ms 00:50:50.633 16 switches: flows: 113269 111756 114807 111908 113242 113176 112027 113924 114047 111822 108365 112579 110268 108529 109108 111661 total = 29.791747 per ms 00:51:50.733 16 switches: flows: 115620 116585 117643 116062 116176 116404 115080 117259 115755 115548 112317 115232 113064 110786 111490 115210 total = 30.619422 per ms 00:52:50.834 16 switches: flows: 114344 115746 116257 114496 115927 116157 116017 114233 114796 114849 112770 115025 112197 111620 111431 113859 total = 30.444490 per ms 00:53:50.935 16 switches: flows: 114799 115757 116109 115172 115396 115624 115111 113595 115905 115338 113215 114908 112599 110922 111096 113527 total = 30.433721 per ms 00:54:51.036 16 switches: flows: 114819 115812 117245 114434 116667 114436 115444 113894 115051 115202 112377 114459 111933 111364 111640 114534 total = 30.437690 per ms 00:55:51.137 16 switches: flows: 110245 111768 112479 111590 112440 110104 111318 110922 111599 111781 109047 110335 108216 109591 108044 110828 total = 29.455931 per ms 00:56:51.237 16 switches: flows: 45495 46130 45270 44344 42186 44558 44837 44585 44841 40924 43786 44520 44313 43028 44053 44247 total = 11.765649 per ms controller msgbuf_read() = -1: msgbuf_read: Connection reset by peer ... exiting' does not contain 'RESULT' ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 'cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.179:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.179. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:48:50.431 16 switches: flows: 94645 95621 96067 96549 94757 95036 94439 95464 93195 92452 91336 92429 92657 92847 91329 94768 total = 25.059850 per ms 00:49:50.532 16 switches: flows: 109789 111164 113044 110221 110207 110869 110486 110690 110028 111329 107069 110160 106957 106323 107086 107105 total = 29.160105 per ms [ Message content over the limit has been removed. ] 00:51:50.733 16 switches: flows: 115620 116585 117643 116062 116176 116404 115080 117259 115755 115548 112317 115232 113064 110786 111490 115210 total = 30.619422 per ms 00:52:50.834 16 switches: flows: 114344 115746 116257 114496 115927 116157 116017 114233 114796 114849 112770 115025 112197 111620 111431 113859 total = 30.444490 per ms 00:53:50.935 16 switches: flows: 114799 115757 116109 115172 115396 115624 115111 113595 115905 115338 113215 114908 112599 110922 111096 113527 total = 30.433721 per ms 00:54:51.036 16 switches: flows: 114819 115812 117245 114434 116667 114436 115444 113894 115051 115202 112377 114459 111933 111364 111640 114534 total = 30.437690 per ms 00:55:51.137 16 switches: flows: 110245 111768 112479 111590 112440 110104 111318 110922 111599 111781 109047 110335 108216 109591 108044 110828 total = 29.455931 per ms 00:56:51.237 16 switches: flows: 45495 46130 45270 44344 42186 44558 44837 44585 44841 40924 43786 44520 44313 43028 44053 44247 total = 11.765649 per ms controller msgbuf_read() = -1: msgbuf_read: Connection reset by peer ... exiting' does not contain 'RESULT' ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. ${results_list[5]} Logs the given message with the given level. ${results_list[7]} Logs the given message with the given level. @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. ${i} 0 ${num_stats} ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} d,m,s Returns the given time in the requested format. CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} ${latency_results_file} 'cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.179:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.179. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:48:50.431 16 switches: flows: 94645 95621 96067 96549 94757 95036 94439 95464 93195 92452 91336 92429 92657 92847 91329 94768 total = 25.059850 per ms 00:49:50.532 16 switches: flows: 109789 111164 113044 110221 110207 110869 110486 110690 110028 111329 107069 110160 106957 106323 107086 107105 total = 29.160105 per ms [ Message content over the limit has been removed. ] 00:51:50.733 16 switches: flows: 115620 116585 117643 116062 116176 116404 115080 117259 115755 115548 112317 115232 113064 110786 111490 115210 total = 30.619422 per ms 00:52:50.834 16 switches: flows: 114344 115746 116257 114496 115927 116157 116017 114233 114796 114849 112770 115025 112197 111620 111431 113859 total = 30.444490 per ms 00:53:50.935 16 switches: flows: 114799 115757 116109 115172 115396 115624 115111 113595 115905 115338 113215 114908 112599 110922 111096 113527 total = 30.433721 per ms 00:54:51.036 16 switches: flows: 114819 115812 117245 114434 116667 114436 115444 113894 115051 115202 112377 114459 111933 111364 111640 114534 total = 30.437690 per ms 00:55:51.137 16 switches: flows: 110245 111768 112479 111590 112440 110104 111318 110922 111599 111781 109047 110335 108216 109591 108044 110828 total = 29.455931 per ms 00:56:51.237 16 switches: flows: 45495 46130 45270 44344 42186 44558 44837 44585 44841 40924 43786 44520 44313 43028 44053 44247 total = 11.765649 per ms controller msgbuf_read() = -1: msgbuf_read: Connection reset by peer ... exiting' does not contain 'RESULT' ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in default latency mode. Test parameters have defaults, but can be overridden on the pybot command line cbench latency 'cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.179:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.179. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:48:50.431 16 switches: flows: 94645 95621 96067 96549 94757 95036 94439 95464 93195 92452 91336 92429 92657 92847 91329 94768 total = 25.059850 per ms 00:49:50.532 16 switches: flows: 109789 111164 113044 110221 110207 110869 110486 110690 110028 111329 107069 110160 106957 106323 107086 107105 total = 29.160105 per ms [ Message content over the limit has been removed. ] 00:51:50.733 16 switches: flows: 115620 116585 117643 116062 116176 116404 115080 117259 115755 115548 112317 115232 113064 110786 111490 115210 total = 30.619422 per ms 00:52:50.834 16 switches: flows: 114344 115746 116257 114496 115927 116157 116017 114233 114796 114849 112770 115025 112197 111620 111431 113859 total = 30.444490 per ms 00:53:50.935 16 switches: flows: 114799 115757 116109 115172 115396 115624 115111 113595 115905 115338 113215 114908 112599 110922 111096 113527 total = 30.433721 per ms 00:54:51.036 16 switches: flows: 114819 115812 117245 114434 116667 114436 115444 113894 115051 115202 112377 114459 111933 111364 111640 114534 total = 30.437690 per ms 00:55:51.137 16 switches: flows: 110245 111768 112479 111590 112440 110104 111318 110922 111599 111781 109047 110335 108216 109591 108044 110828 total = 29.455931 per ms 00:56:51.237 16 switches: flows: 45495 46130 45270 44344 42186 44558 44837 44585 44841 40924 43786 44520 44313 43028 44053 44247 total = 11.765649 per ms controller msgbuf_read() = -1: msgbuf_read: Connection reset by peer ... exiting' does not contain 'RESULT' Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = throughput.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.179 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.64" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 7 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.64:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Mon Aug 3 00:57:09 UTC 2026 System load: 1.36 Processes: 106 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.64 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Mon Aug 3 00:47:45 2026 from 10.30.170.49 [?2004h[jenkins@releng-63164-359-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.179 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.179:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.179:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.179. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:58:14.790 16 switches: flows: 461027 469797 452844 452233 464414 438066 454824 455528 442227 444270 455621 452069 439023 460614 448693 447168 total = 120.640300 per ms 00:59:15.621 16 switches: flows: 497681 506283 490825 497970 499749 508654 494605 507476 509102 494206 501612 488127 503636 497046 506421 496581 total = 131.513161 per ms 01:00:15.723 16 switches: flows: 619372 616900 627685 616781 629242 622185 628800 624101 620586 625006 627229 619526 628734 619959 630687 630697 total = 166.178732 per ms 01:01:15.825 16 switches: flows: 557514 562768 563089 550341 555547 554122 545201 554134 480319 545077 546879 550155 556574 549691 551987 549808 total = 145.975409 per ms 01:02:15.927 16 switches: flows: 631270 622557 624847 632566 632823 632765 630182 625876 622486 640730 635966 614201 637545 615252 617635 628974 total = 167.146334 per ms 01:03:16.323 16 switches: flows: 635395 637275 634045 630624 634462 635543 633394 634315 633485 636636 640117 636433 637577 623637 634001 635466 total = 168.098240 per ms 01:04:16.566 16 switches: flows: 622443 610444 576640 611334 606799 616489 611829 625871 611958 617744 623120 612813 625330 620993 621185 614085 total = 163.157326 per ms 01:05:17.867 16 switches: flows: 562131 560530 559469 553829 556037 557860 558844 554251 554617 552508 557457 557958 552041 549562 551937 551744 total = 145.036138 per ms 01:06:17.969 16 switches: flows: 629258 465901 621887 632000 630472 636668 578251 633780 638081 516520 636043 631531 629003 635170 627195 631187 total = 162.607143 per ms 01:07:18.096 16 switches: flows: 585627 575470 569098 583364 573243 568675 587397 577788 579027 570427 579747 589459 586324 540509 585172 580039 total = 153.534627 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 131513.16/168098.24/155916.35/53338.88 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.179:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.179:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.179. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:58:14.790 16 switches: flows: 461027 469797 452844 452233 464414 438066 454824 455528 442227 444270 455621 452069 439023 460614 448693 447168 total = 120.640300 per ms 00:59:15.621 16 switches: flows: 497681 506283 490825 497970 499749 508654 494605 507476 509102 494206 501612 488127 503636 497046 506421 496581 total = 131.513161 per ms 01:00:15.723 16 switches: flows: 619372 616900 627685 616781 629242 622185 628800 624101 620586 625006 627229 619526 628734 619959 630687 630697 total = 166.178732 per ms 01:01:15.825 16 switches: flows: 557514 562768 563089 550341 555547 554122 545201 554134 480319 545077 546879 550155 556574 549691 551987 549808 total = 145.975409 per ms 01:02:15.927 16 switches: flows: 631270 622557 624847 632566 632823 632765 630182 625876 622486 640730 635966 614201 637545 615252 617635 628974 total = 167.146334 per ms 01:03:16.323 16 switches: flows: 635395 637275 634045 630624 634462 635543 633394 634315 633485 636636 640117 636433 637577 623637 634001 635466 total = 168.098240 per ms 01:04:16.566 16 switches: flows: 622443 610444 576640 611334 606799 616489 611829 625871 611958 617744 623120 612813 625330 620993 621185 614085 total = 163.157326 per ms 01:05:17.867 16 switches: flows: 562131 560530 559469 553829 556037 557860 558844 554251 554617 552508 557457 557958 552041 549562 551937 551744 total = 145.036138 per ms 01:06:17.969 16 switches: flows: 629258 465901 621887 632000 630472 636668 578251 633780 638081 516520 636043 631531 629003 635170 627195 631187 total = 162.607143 per ms 01:07:18.096 16 switches: flows: 585627 575470 569098 583364 573243 568675 587397 577788 579027 570427 579747 589459 586324 540509 585172 580039 total = 153.534627 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 131513.16/168098.24/155916.35/53338.88 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 131513.16/168098.24/155916.35/53338.88 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 131513.16/168098.24/155916.35/53338.88 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 131513.16/168098.24/155916.35/53338.88 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 131513.16 | 168098.24 | 155916.35 | 53338.88 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 131513.16 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 168098.24 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 155916.35 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 53338.88 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 131513.16 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 168098.24 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 155916.35 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 53338.88 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-08-03 01:07:18 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-08-03 01:07:18,-t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,131513.16,168098.24,155916.35,53338.88 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/throughput.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/throughput.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -t -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${throughput_threshold} ${throughput_results_file} Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in throughput mode (-t). Test parameters have defaults, but can be overridden on the pybot command line cbench throughput Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = bug.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.179 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.64" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 9 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.64:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Mon Aug 3 01:07:18 UTC 2026 System load: 0.19 Processes: 105 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.64 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Mon Aug 3 00:57:09 2026 from 10.30.170.49 [?2004h[jenkins@releng-63164-359-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.179 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.179:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.179:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.179. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 01:08:24.050 16 switches: flows: 93331 93966 92275 91193 93498 93183 93327 92232 91972 92082 91566 92392 91598 90649 90133 91607 total = 24.583400 per ms 01:09:24.151 16 switches: flows: 101339 101268 99124 99698 101179 100891 101687 98410 99216 100300 97870 100658 99703 100124 99310 97947 total = 26.600917 per ms 01:10:24.251 16 switches: flows: 94639 93957 92092 93807 92068 93276 93019 94122 92503 92218 92703 93042 91971 92870 92351 92599 total = 24.745966 per ms 01:11:24.352 16 switches: flows: 94530 93943 94408 94581 94728 93843 95124 92604 94913 93905 94049 92583 92532 94042 91575 93490 total = 24.972418 per ms 01:12:24.452 16 switches: flows: 96453 93698 92979 94131 94665 95145 94595 93519 94073 92806 92820 92710 93552 95829 92448 95301 total = 25.036926 per ms 01:13:24.552 16 switches: flows: 90384 88657 86073 87265 86900 89250 87907 87238 88049 84871 85236 85739 85995 88777 86049 86288 total = 23.205885 per ms 01:14:24.653 16 switches: flows: 94181 93245 92712 93995 92129 92859 93835 91551 93902 92389 92928 92789 91699 90704 92014 92085 total = 24.675681 per ms 01:15:24.753 16 switches: flows: 97241 97704 97136 96821 98608 98844 100155 95520 95964 96894 96650 98331 96077 96016 96376 95481 total = 25.853801 per ms 01:16:24.853 16 switches: flows: 102705 102018 101161 102921 102436 102175 102911 101373 100364 102559 101862 100948 100846 100315 99773 99697 total = 27.022593 per ms 01:17:24.954 16 switches: flows: 102059 102293 102087 99960 100069 102411 100882 102152 100876 101010 100808 100292 100514 98430 99083 100864 total = 26.851694 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 23205.88/27022.59/25440.65/8561.42 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.179:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.179:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.179. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 01:08:24.050 16 switches: flows: 93331 93966 92275 91193 93498 93183 93327 92232 91972 92082 91566 92392 91598 90649 90133 91607 total = 24.583400 per ms 01:09:24.151 16 switches: flows: 101339 101268 99124 99698 101179 100891 101687 98410 99216 100300 97870 100658 99703 100124 99310 97947 total = 26.600917 per ms 01:10:24.251 16 switches: flows: 94639 93957 92092 93807 92068 93276 93019 94122 92503 92218 92703 93042 91971 92870 92351 92599 total = 24.745966 per ms 01:11:24.352 16 switches: flows: 94530 93943 94408 94581 94728 93843 95124 92604 94913 93905 94049 92583 92532 94042 91575 93490 total = 24.972418 per ms 01:12:24.452 16 switches: flows: 96453 93698 92979 94131 94665 95145 94595 93519 94073 92806 92820 92710 93552 95829 92448 95301 total = 25.036926 per ms 01:13:24.552 16 switches: flows: 90384 88657 86073 87265 86900 89250 87907 87238 88049 84871 85236 85739 85995 88777 86049 86288 total = 23.205885 per ms 01:14:24.653 16 switches: flows: 94181 93245 92712 93995 92129 92859 93835 91551 93902 92389 92928 92789 91699 90704 92014 92085 total = 24.675681 per ms 01:15:24.753 16 switches: flows: 97241 97704 97136 96821 98608 98844 100155 95520 95964 96894 96650 98331 96077 96016 96376 95481 total = 25.853801 per ms 01:16:24.853 16 switches: flows: 102705 102018 101161 102921 102436 102175 102911 101373 100364 102559 101862 100948 100846 100315 99773 99697 total = 27.022593 per ms 01:17:24.954 16 switches: flows: 102059 102293 102087 99960 100069 102411 100882 102152 100876 101010 100808 100292 100514 98430 99083 100864 total = 26.851694 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 23205.88/27022.59/25440.65/8561.42 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 23205.88/27022.59/25440.65/8561.42 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 23205.88/27022.59/25440.65/8561.42 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 23205.88/27022.59/25440.65/8561.42 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 23205.88 | 27022.59 | 25440.65 | 8561.42 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 23205.88 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 27022.59 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 25440.65 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 8561.42 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 23205.88 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 27022.59 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 25440.65 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 8561.42 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-08-03 01:17:25 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-08-03 01:17:25,-m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,23205.88,27022.59,25440.65,8561.42 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/bug.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/bug.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} bug.csv Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. ${test_skipped} = False ${test_skipped} len(re.findall('SKIPPED', """${TEST_MESSAGE}""")) > 0 modules=re Evaluates the given expression in Python and returns the result. Jira tickets are {PROJECT}-{NUMBER} while Bugzilla tickets are {NUMBER} Displays the given messages in the log file as keyword arguments. ${match} Should Contain ${number} - Runs the specified keyword and returns the status as a Boolean value. ${bug_url} ${match} https://jira.opendaylight.org/browse/${number} https://bugs.opendaylight.org/show_bug.cgi?id=${number} Sets variable based on the given condition. ${msg} This test fails due to ${bug_url} Returns the given values which can then be assigned to a variables. ${newline} chr(10) Evaluates the given expression in Python and returns the result. ${msg}${newline}${newline}${TEST_MESSAGE} Sets message for the current test case. ${msg} Logs the given message with the given level. ${bug_url} Adds given ``tags`` for the current test or all tests in a suite. 6176 Report that a test failed due to a known Bugzilla bug whose number is provided as an argument. Not FAILED (incl. SKIPPED) test are not reported. This keyword must be used in the [Teardown] setting of the affected test or as the first line of the test if FastFail module is not being used. It reports the URL of the bug on console and also puts it into the Robot log file. cbench executed in latency mode to see if controller is healthy cbench latency Cbench Latency and Throughput tests can be run from an external cbench. If cbench is run with a medium number of switches or higher (e.g. 32+) the normal openflow operations seem to break. BUG: https://bugs.opendaylight.org/show_bug.cgi?id=2897 All Tests cbench latency throughput openflowplugin-cbench.txt