${SuiteFastFail} = False ${SuiteFastFail} False Makes a variable available everywhere within the scope of the current suite. Set suite to not fail fast. ${already_done} = False ${already_done} \${ClusterManagement__has_setup_run} False Returns variable value or ``default`` if the variable does not exist. ${ClusterManagement__has_setup_run} = True \${ClusterManagement__has_setup_run} True Makes a variable available everywhere within the scope of the current suite. ${cluster_size} = 0 ${cluster_size} \${NUM_ODL_SYSTEM} 1 Returns variable value or ``default`` if the variable does not exist. ${cluster_size} Converts the given item to an integer number. ${status} = PASS ${possibly_int_of_members} = 0 ${status} ${possibly_int_of_members} BuiltIn.Convert_To_Integer ${cluster_size} Runs the given keyword with the given arguments and ignores possible error. ${int_of_members} = 0 ${int_of_members} '${status}' != 'PASS' ${1} ${possibly_int_of_members} Sets variable based on the given condition. @{member_index_list} = [ ] @{member_index_list} Returns a list containing given items. @{session_list} = [ ] @{session_list} Returns a list containing given items. &{index_to_ip_mapping} = { } &{index_to_ip_mapping} Creates and returns a dictionary based on the given ``items``. ${index} ${member_index_list} ${session_list} ${index_to_ip_mapping} http_timeout=${http_timeout} http_retries=${http_retries} Add a corresponding item based on index into the last three arguments. Create the Http session whose alias is added to list. ${index} 1 ${int_of_members+1} ${ClusterManagement__member_index_list} = [] \${ClusterManagement__member_index_list} ${member_index_list} Makes a variable available everywhere within the scope of the current suite. ${ClusterManagement__index_to_ip_mapping} = {} \${ClusterManagement__index_to_ip_mapping} ${index_to_ip_mapping} Makes a variable available everywhere within the scope of the current suite. ${ClusterManagement__session_list} = [] \${ClusterManagement__session_list} ${session_list} Makes a variable available everywhere within the scope of the current suite. int_of_members=${int_of_members} http_timeout=${http_timeout} http_retries=${http_retries} Construct index list, session list and IP mapping, publish them as suite variables. http_timeout=${http_timeout} Detect repeated call, or detect number of members and initialize derived suite variables. Http sessions are created with parameters to not waste time when ODL is no accepting connections properly. Not A Karaf App ${return_list_reference} = [] ${return_list_reference} """${given_list}""" != "" ${given_list} ${ClusterManagement__member_index_list} Sets variable based on the given condition. ${return_list_copy} = [] ${return_list_copy} @{return_list_reference} Returns a list containing given items. ${return_list_copy} ${index_list} = [] ${index_list} given_list=${member_index_list} Utility to allow ${EMPTY} as default argument value, as the internal list is computed at runtime. This keyword always returns a (shallow) copy of given or default list, so operations with the returned list should not affect other lists. Also note that this keyword does not consider empty list to be ${EMPTY}. command=${command} member_index=${index} Obtain IP, call Utils and return output. This keeps previous ssh session active. ${index} @{index_list} iptables -I INPUT -p tcp --dport ${KARAF_SHELL_PORT} -j ACCEPT; iptables-save Cycle through indices (or all), run command on each. First connections to Karaf console may fail, so WUKS is used. TODO: Track as a Bug. Displays the given messages in the log file as keyword arguments. BuiltIn.Wait_Until_Keyword_Succeeds 3s 1s Open_Controller_Karaf_Console_On_Background member_index=${index} Runs the given keyword with the given arguments and ignores possible error. ${index} @{ClusterManagement__member_index_list} http_timeout=${http_timeout} Initialize ClusterManagement. Open ssh karaf connections to each ODL. Not A Karaf App Not A Karaf App ${return_list_reference} = [] ${return_list_reference} """${given_list}""" != "" ${given_list} ${ClusterManagement__member_index_list} Sets variable based on the given condition. ${return_list_copy} = [] ${return_list_copy} @{return_list_reference} Returns a list containing given items. ${return_list_copy} ${index_list} = [] ${index_list} given_list=${member_index_list} Utility to allow ${EMPTY} as default argument value, as the internal list is computed at runtime. This keyword always returns a (shallow) copy of given or default list, so operations with the returned list should not affect other lists. Also note that this keyword does not consider empty list to be ${EMPTY}. ${status} ${output} Execute_Controller_Karaf_Command_With_Retry_On_Background log:log "ROBOT MESSAGE: ${message}" member_index=${index} Runs the given keyword with the given arguments and ignores possible error. ${output} Fails the test with the given message and optionally alters its tags. ${index} @{index_list} Starting suite ${SUITE_SOURCE} ${member_index_list} Make sure this resource is initialized. Send a message into the controller's karaf log file on every node listed (or all). By default, failure while processing a node is silently ignored, unless ${tolerate_failure} is False. Log suite name to karaf log, useful in suite setup. KarafKeywords.Log_Test_Suite_Start_To_Controller_Karaf Runs the given keyword with the given arguments and ignores possible error. Prepare both FailFast and Karaf logging, log that the caller suite has started. This keyword is to be used in suite setup, and without it the other keywords may not work properly. Creating Session using : alias=default, url=http://:8181, headers={}, cookies={}, auth=<requests.auth.HTTPBasicAuth object at 0x74679a4001d0>, timeout=5, proxies=None, verify=False, debug=0 default url=${url} auth=${auth} timeout=${timeout} max_retries=${max_retries} Create Session: create a HTTP session to a server Create "default" session to ${url} with authentication and connection parameters. This Keyword is in this Resource only so that user do not need to call RequestsLibrary directly. Creating Session using : alias=default, url=http://:8181, headers={}, cookies={}, auth=<requests.auth.HTTPBasicAuth object at 0x74679a6cf3d0>, timeout=5, proxies=None, verify=False, debug=0 default url=${url} auth=${auth} timeout=${timeout} max_retries=${max_retries} Create Session: create a HTTP session to a server Create "default" session to ${url} with authentication and connection parameters. This Keyword is in this Resource only so that user do not need to call RequestsLibrary directly. ${keyword} ${args} ${kwargs} ${sc_fail} = ['BuiltIn.Fail', [], {}] ${sc_fail} BuiltIn.Fail Turn keyword with given arguments into a scalar closure. ${ScalarClosures__fail} = ['BuiltIn.Fail', [], {}] ${ScalarClosures__fail} ${sc_fail} Makes a variable available everywhere within the scope of the current suite. ${keyword} ${args} ${kwargs} ${sc_identity} = ['BuiltIn.Set_Variable', ['placeholder'], {}] ${sc_identity} BuiltIn.Set_Variable placeholder Turn keyword with given arguments into a scalar closure. ${ScalarClosures__identity} = ['BuiltIn.Set_Variable', ['placeholder'], {}] ${ScalarClosures__identity} ${sc_identity} Makes a variable available everywhere within the scope of the current suite. Resource setup. Create closures and assign them to suite variables. Call dependency setup. Perhaps needed. ${keyword} ${args} ${kwargs} ${counter} = ['Get_Change_Count', [], {}] ${counter} Get_Change_Count Turn keyword with given arguments into a scalar closure. ${ChangeCounter__getter} = ['Get_Change_Count', [], {}] ${ChangeCounter__getter} ${counter} Makes a variable available everywhere within the scope of the current suite. Initialize dependency libraries. ${keyword} ${args} ${kwargs} ${sc_fail} = ['BuiltIn.Fail', [], {}] ${sc_fail} BuiltIn.Fail Turn keyword with given arguments into a scalar closure. ${ScalarClosures__fail} = ['BuiltIn.Fail', [], {}] ${ScalarClosures__fail} ${sc_fail} Makes a variable available everywhere within the scope of the current suite. ${keyword} ${args} ${kwargs} ${sc_identity} = ['BuiltIn.Set_Variable', ['placeholder'], {}] ${sc_identity} BuiltIn.Set_Variable placeholder Turn keyword with given arguments into a scalar closure. ${ScalarClosures__identity} = ['BuiltIn.Set_Variable', ['placeholder'], {}] ${ScalarClosures__identity} ${sc_identity} Makes a variable available everywhere within the scope of the current suite. Resource setup. Create closures and assign them to suite variables. Call dependency setup. Perhaps needed. Call dependency setups and construct suite variables. Creating Session using : alias=operational, url=http://:8181, headers={}, cookies={}, auth=<requests.auth.HTTPBasicAuth object at 0x74679a5f0950>, timeout=125, proxies=None, verify=False, debug=0 operational http://${ODL_SYSTEM_IP}:${RESTCONFPORT} auth=${AUTH} timeout=125 max_retries=0 Create Session: create a HTTP session to a server prompt=${TOOLS_SYSTEM_PROMPT} Update the default `configuration`. ${TOOLS_SYSTEM_IP} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into ':22' as 'jenkins'. OSError: [Errno 16] Device or resource busy ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. OSError: [Errno 16] Device or resource busy Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. user=${user} password=${password} delay=${delay} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. OSError: [Errno 16] Device or resource busy Returning from the enclosing user keyword. Flexible SSH Login user=${user} password=${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Call Flexible SSH Login, but with default values suitable for Mininet machine. OSError: [Errno 16] Device or resource busy Verify current SSH connection leads to machine with python working. Fatal fail otherwise. target_dir=. Tests whether ipaddr module is present on ssh-connected machine, Puts ipaddr.py to target_dir if not. /w/workspace/bgpcep-csit-1node-bgp-ingest-mixed-all-vanadium/test/csit/suites/bgpcep/bgpingest/../../../../tools/fastbgp/play.py Uploads file(s) from the local machine to the remote machine. ${timeout} ${TEST_DURATION_MULTIPLIER_CHANGE_COUNT_SINGLE} * (${COUNT_CHANGE_COUNT_SINGLE} * 9.0 / 10000 + 20) Evaluates the given expression in Python and returns the result. ${bgp_filling_timeout} ${timeout} Makes a variable available everywhere within the scope of the current suite. ${bgp_emptying_timeout} ${bgp_filling_timeout*3.0/4} Makes a variable available everywhere within the scope of the current suite. Setup imported resources, SSH-login to tools system, create HTTP session, put Python tool to tools system. OSError: [Errno 16] Device or resource busy Wait for example-ipv4-topology to come up and empty. Give large timeout for case when BGP boots slower than restconf. critical Parent suite setup failed: OSError: [Errno 16] Device or resource busy Configure BGP peer module with initiate-connection set to false. Parent suite setup failed: OSError: [Errno 16] Device or resource busy Configure data change counter to count transactions in example-ipv4-topology instead of example-linkstate-topology. Parent suite setup failed: OSError: [Errno 16] Device or resource busy Data change counter might have been slower to start than ipv4 topology, wait for it. Parent suite setup failed: OSError: [Errno 16] Device or resource busy Start Python speaker to connect to ODL. Parent suite setup failed: OSError: [Errno 16] Device or resource busy Wait until example-ipv4-topology becomes stable. This is done by checking the change counter. Parent suite setup failed: OSError: [Errno 16] Device or resource busy Count the routes in example-ipv4-topology and fail if the count is not correct. critical Parent suite setup failed: OSError: [Errno 16] Device or resource busy Abort the Python speaker. Also, attempt to stop failing fast. critical Parent suite setup failed: OSError: [Errno 16] Device or resource busy Store results for plotting Parent suite setup failed: OSError: [Errno 16] Device or resource busy Wait until example-ipv4-topology becomes stable again. critical Parent suite setup failed: OSError: [Errno 16] Device or resource busy Example-ipv4-topology should be empty now. critical Parent suite setup failed: OSError: [Errno 16] Device or resource busy Start Python speaker in listening mode. Parent suite setup failed: OSError: [Errno 16] Device or resource busy Replace BGP peer config module, now with initiate-connection set to true. Parent suite setup failed: OSError: [Errno 16] Device or resource busy Wait until example-ipv4-topology becomes stable. Parent suite setup failed: OSError: [Errno 16] Device or resource busy Count the routes in example-ipv4-topology and fail if the count is not correct. critical Parent suite setup failed: OSError: [Errno 16] Device or resource busy Abort the Python speaker. Also, attempt to stop failing fast. critical Parent suite setup failed: OSError: [Errno 16] Device or resource busy Store results for plotting Parent suite setup failed: OSError: [Errno 16] Device or resource busy Wait until example-ipv4-topology becomes stable again. critical Parent suite setup failed: OSError: [Errno 16] Device or resource busy Example-ipv4-topology should be empty now. critical Parent suite setup failed: OSError: [Errno 16] Device or resource busy Configure data change counter back to count transactions affecting example-linkstate-topology. Parent suite setup failed: OSError: [Errno 16] Device or resource busy Revert the BGP configuration to the original state: without any configured peers. Parent suite setup failed: OSError: [Errno 16] Device or resource busy Executing command 'ps -elf | egrep python | egrep 'play.py' | egrep -v grep'. ${processes} = None Connection not open ${processes} ps -elf | egrep python | egrep ${filter} | egrep -v grep Executes ``command`` on the remote machine and returns its outputs. Connection not open ${processes} ${processes} = None ${processes} ${filter} Only searches for the list of processes, in case something else than kill has to be done with them. Connection not open None ${processes} Logs the given message with the given level. ${arg_length} = None Could not get length of 'None'. ${arg_length} ${pself_lines} Returns and logs the length of the given item as an integer. Could not get length of 'None'. Executing command 'echo 'None' | awk '{print "kill -9",$4}''. ${commands} = None Connection not open ${commands} echo '${pself_lines}' | awk '{print "kill -${signal}",$4}' Executes ``command`` on the remote machine and returns its outputs. Connection not open None ${commands} Logs the given message with the given level. Executing command 'echo 'set -exu; None' | sudo sh'. ${stdout} = None ${stderr} = None Connection not open ${stdout} ${stderr} echo 'set -exu; ${commands}' | sudo sh return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Connection not open ${processes} Kill processes by PIDs from given list (no-op if the list is empty), using specified signal. Log the kill commands used. Several failures occurred: 1) Could not get length of 'None'. 2) Connection not open 3) Connection not open 'play\.py' The main keyword. Search for processes, Log the list of them, kill them. Several failures occurred: 1) Connection not open 2) Could not get length of 'None'. 3) Connection not open 4) Connection not open KillPythonTool.Search_And_Kill_Remote_Python 'play\.py' Runs the given keyword with the given arguments and ignores possible error. index=1 host= alias=None port=22 timeout=10 seconds newline= prompt=> term_type=vt100 width=80 height=24 path_separator=/ encoding=UTF-8 escape_ansi=False encoding_errors=strict ${current_connection} = index=1 host= alias=None port=22 timeout=10 seconds newline= prompt=> term_type=vt100 width=80 height=24 path_separator=/ encoding=UTF-8 escape_ansi=False encoding_errors=strict ${current_connection} Returns information about the connection. ${odl_connection} = 2 ${odl_connection} ${ip_address} prompt=${ODL_SYSTEM_PROMPT} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into ':22' as 'jenkins'. OSError: [Errno 16] Device or resource busy ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. OSError: [Errno 16] Device or resource busy Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. user=${user} password=${password} delay=${delay} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. OSError: [Errno 16] Device or resource busy Returning from the enclosing user keyword. Flexible SSH Login user=${user} password=${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Call Flexible SSH Login, but with default values suitable for Controller machine. OSError: [Errno 16] Device or resource busy ${odl_connection} ${ip_address} Open a connection to the ODL system at and return its identifier. OSError: [Errno 16] Device or resource busy Cannot open session, you need to establish a connection first. sar -A -f /var/log/sa/sa* Writes the given ``text`` on the remote machine and appends a newline. Cannot open session, you need to establish a connection first. ${output} = None Cannot open session, you need to establish a connection first. ${output} Consumes and returns the server output until the prompt is found. Cannot open session, you need to establish a connection first. None ${output} Logs the given message with the given level. Closes the current connection. ${output} ${connection_index} Switches the active connection by index or alias. Returning from the enclosing user keyword. ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_connection.index} Restore active SSH connection in SSHLibrary to given index. Store current connection index, open new connection to ip_address. Run command to get sysstat results from script, which is running on all children nodes. Returns cpu, network, memory usage statistics from the node for each 10 minutes that node was running. Used for debug purposes. Returns whole output of sysstat. Several failures occurred: 1) OSError: [Errno 16] Device or resource busy 2) Cannot open session, you need to establish a connection first. 3) Cannot open session, you need to establish a connection first. Utils.Get_Sysstat_Statistics Runs the given keyword with the given arguments and ignores possible error. Deleting All Sessions Removes all the session objects Closes all open connections. Make sure Python tool was killed and tear down imported Resources. BGP performance of ingesting from 1 iBGP peer, data change counter is used. Copyright (c) 2015 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html This suite uses play.py as single iBGP peer. The suite only looks at example-ipv4-topology, so RIB is not examined. This suite requires odl-bgpcep-data-change-counter to be installed so make sure it is added to "install-features" of any jobs that are going to invoke it. The suite consists of two halves, differing on which side initiates BGP connection. Data change counter is a lightweight way to detect "work is being done". WaitUtils provide a nice Keyword to wait for stability, but it needs initial value, that is why Store_Change_Count appears just before work-inducing action. The time for Wait_For_Stable_* cases to finish is the main performance metric. After waiting for stability is done, full check on number of prefixes present is performed. Brief description how to configure BGP peer can be found here: https://wiki.opendaylight.org/view/BGP_LS_PCEP:User_Guide#BGP_Peer http://docs.opendaylight.org/en/stable-boron/user-guide/bgp-user-guide.html#bgp-peering TODO: Currently, if a bug causes zero increase of data changes, affected test cases will wait for max time. Reconsider. If zero increase is allowed as stable, higher number of repetitions should be required. Additionally this test suite is not compatible with Helium and Hydrogen releases as they don't include data change counter feature. Use the other version of the suite (singlepeer_prefixcount.robot) to test them. Suite setup failed: OSError: [Errno 16] Device or resource busy ${SuiteFastFail} = False ${SuiteFastFail} False Makes a variable available everywhere within the scope of the current suite. Set suite to not fail fast. ${already_done} = False ${already_done} \${ClusterManagement__has_setup_run} False Returns variable value or ``default`` if the variable does not exist. ${ClusterManagement__has_setup_run} = True \${ClusterManagement__has_setup_run} True Makes a variable available everywhere within the scope of the current suite. ${cluster_size} = 0 ${cluster_size} \${NUM_ODL_SYSTEM} 1 Returns variable value or ``default`` if the variable does not exist. ${cluster_size} Converts the given item to an integer number. ${status} = PASS ${possibly_int_of_members} = 0 ${status} ${possibly_int_of_members} BuiltIn.Convert_To_Integer ${cluster_size} Runs the given keyword with the given arguments and ignores possible error. ${int_of_members} = 0 ${int_of_members} '${status}' != 'PASS' ${1} ${possibly_int_of_members} Sets variable based on the given condition. @{member_index_list} = [ ] @{member_index_list} Returns a list containing given items. @{session_list} = [ ] @{session_list} Returns a list containing given items. &{index_to_ip_mapping} = { } &{index_to_ip_mapping} Creates and returns a dictionary based on the given ``items``. ${index} ${member_index_list} ${session_list} ${index_to_ip_mapping} http_timeout=${http_timeout} http_retries=${http_retries} Add a corresponding item based on index into the last three arguments. Create the Http session whose alias is added to list. ${index} 1 ${int_of_members+1} ${ClusterManagement__member_index_list} = [] \${ClusterManagement__member_index_list} ${member_index_list} Makes a variable available everywhere within the scope of the current suite. ${ClusterManagement__index_to_ip_mapping} = {} \${ClusterManagement__index_to_ip_mapping} ${index_to_ip_mapping} Makes a variable available everywhere within the scope of the current suite. ${ClusterManagement__session_list} = [] \${ClusterManagement__session_list} ${session_list} Makes a variable available everywhere within the scope of the current suite. int_of_members=${int_of_members} http_timeout=${http_timeout} http_retries=${http_retries} Construct index list, session list and IP mapping, publish them as suite variables. http_timeout=${http_timeout} Detect repeated call, or detect number of members and initialize derived suite variables. Http sessions are created with parameters to not waste time when ODL is no accepting connections properly. Not A Karaf App ${return_list_reference} = [] ${return_list_reference} """${given_list}""" != "" ${given_list} ${ClusterManagement__member_index_list} Sets variable based on the given condition. ${return_list_copy} = [] ${return_list_copy} @{return_list_reference} Returns a list containing given items. ${return_list_copy} ${index_list} = [] ${index_list} given_list=${member_index_list} Utility to allow ${EMPTY} as default argument value, as the internal list is computed at runtime. This keyword always returns a (shallow) copy of given or default list, so operations with the returned list should not affect other lists. Also note that this keyword does not consider empty list to be ${EMPTY}. command=${command} member_index=${index} Obtain IP, call Utils and return output. This keeps previous ssh session active. ${index} @{index_list} iptables -I INPUT -p tcp --dport ${KARAF_SHELL_PORT} -j ACCEPT; iptables-save Cycle through indices (or all), run command on each. First connections to Karaf console may fail, so WUKS is used. TODO: Track as a Bug. Displays the given messages in the log file as keyword arguments. BuiltIn.Wait_Until_Keyword_Succeeds 3s 1s Open_Controller_Karaf_Console_On_Background member_index=${index} Runs the given keyword with the given arguments and ignores possible error. ${index} @{ClusterManagement__member_index_list} http_timeout=${http_timeout} Initialize ClusterManagement. Open ssh karaf connections to each ODL. Not A Karaf App Not A Karaf App ${return_list_reference} = [] ${return_list_reference} """${given_list}""" != "" ${given_list} ${ClusterManagement__member_index_list} Sets variable based on the given condition. ${return_list_copy} = [] ${return_list_copy} @{return_list_reference} Returns a list containing given items. ${return_list_copy} ${index_list} = [] ${index_list} given_list=${member_index_list} Utility to allow ${EMPTY} as default argument value, as the internal list is computed at runtime. This keyword always returns a (shallow) copy of given or default list, so operations with the returned list should not affect other lists. Also note that this keyword does not consider empty list to be ${EMPTY}. ${status} ${output} Execute_Controller_Karaf_Command_With_Retry_On_Background log:log "ROBOT MESSAGE: ${message}" member_index=${index} Runs the given keyword with the given arguments and ignores possible error. ${output} Fails the test with the given message and optionally alters its tags. ${index} @{index_list} Starting suite ${SUITE_SOURCE} ${member_index_list} Make sure this resource is initialized. Send a message into the controller's karaf log file on every node listed (or all). By default, failure while processing a node is silently ignored, unless ${tolerate_failure} is False. Log suite name to karaf log, useful in suite setup. KarafKeywords.Log_Test_Suite_Start_To_Controller_Karaf Runs the given keyword with the given arguments and ignores possible error. Prepare both FailFast and Karaf logging, log that the caller suite has started. This keyword is to be used in suite setup, and without it the other keywords may not work properly. Creating Session using : alias=default, url=http://:8181, headers={}, cookies={}, auth=<requests.auth.HTTPBasicAuth object at 0x74679a4b9bd0>, timeout=5, proxies=None, verify=False, debug=0 default url=${url} auth=${auth} timeout=${timeout} max_retries=${max_retries} Create Session: create a HTTP session to a server Create "default" session to ${url} with authentication and connection parameters. This Keyword is in this Resource only so that user do not need to call RequestsLibrary directly. ${keyword} ${args} ${kwargs} ${sc_fail} = ['BuiltIn.Fail', [], {}] ${sc_fail} BuiltIn.Fail Turn keyword with given arguments into a scalar closure. ${ScalarClosures__fail} = ['BuiltIn.Fail', [], {}] ${ScalarClosures__fail} ${sc_fail} Makes a variable available everywhere within the scope of the current suite. ${keyword} ${args} ${kwargs} ${sc_identity} = ['BuiltIn.Set_Variable', ['placeholder'], {}] ${sc_identity} BuiltIn.Set_Variable placeholder Turn keyword with given arguments into a scalar closure. ${ScalarClosures__identity} = ['BuiltIn.Set_Variable', ['placeholder'], {}] ${ScalarClosures__identity} ${sc_identity} Makes a variable available everywhere within the scope of the current suite. Resource setup. Create closures and assign them to suite variables. Call dependency setup. Perhaps needed. Call dependency setups and construct suite variables. Creating Session using : alias=operational, url=http://:8181, headers={}, cookies={}, auth=<requests.auth.HTTPBasicAuth object at 0x74679a4e6a90>, timeout=125, proxies=None, verify=False, debug=0 operational http://${ODL_SYSTEM_IP}:${RESTCONFPORT} auth=${AUTH} timeout=125 max_retries=0 Create Session: create a HTTP session to a server prompt=${TOOLS_SYSTEM_PROMPT} Update the default `configuration`. ${TOOLS_SYSTEM_IP} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into ':22' as 'jenkins'. OSError: [Errno 16] Device or resource busy ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. OSError: [Errno 16] Device or resource busy Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. user=${user} password=${password} delay=${delay} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. OSError: [Errno 16] Device or resource busy Returning from the enclosing user keyword. Flexible SSH Login user=${user} password=${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Call Flexible SSH Login, but with default values suitable for Mininet machine. OSError: [Errno 16] Device or resource busy Verify current SSH connection leads to machine with python working. Fatal fail otherwise. target_dir=. Tests whether ipaddr module is present on ssh-connected machine, Puts ipaddr.py to target_dir if not. /w/workspace/bgpcep-csit-1node-bgp-ingest-mixed-all-vanadium/test/csit/suites/bgpcep/bgpingest/../../../../tools/fastbgp/play.py Uploads file(s) from the local machine to the remote machine. ${timeout} ${TEST_DURATION_MULTIPLIER_PREFIX_COUNT_SINGLE} * (${COUNT_PREFIX_COUNT_SINGLE} * 9.0 / 10000 + 20) Evaluates the given expression in Python and returns the result. ${bgp_filling_timeout} ${timeout} Makes a variable available everywhere within the scope of the current suite. Setup imported resources, SSH-login to tools system, create HTTP session, put Python tool to tools system. OSError: [Errno 16] Device or resource busy Wait for example-ipv4-topology to come up and empty. Give large timeout for case when BGP boots slower than restconf. critical Parent suite setup failed: OSError: [Errno 16] Device or resource busy Configure BGP peer module with initiate-connection set to false. Parent suite setup failed: OSError: [Errno 16] Device or resource busy Start Python speaker to connect to ODL. Parent suite setup failed: OSError: [Errno 16] Device or resource busy Wait until example-ipv4-topology becomes stable. This is done by checking stability of prefix count. Parent suite setup failed: OSError: [Errno 16] Device or resource busy Count the routes in example-ipv4-topology and fail if the count is not correct. critical Parent suite setup failed: OSError: [Errno 16] Device or resource busy Abort the Python speaker. Also, attempt to stop failing fast. critical Parent suite setup failed: OSError: [Errno 16] Device or resource busy Store results for plotting Parent suite setup failed: OSError: [Errno 16] Device or resource busy Wait until example-ipv4-topology becomes stable again. critical Parent suite setup failed: OSError: [Errno 16] Device or resource busy Example-ipv4-topology should be empty now. critical Parent suite setup failed: OSError: [Errno 16] Device or resource busy Start Python speaker in listening mode. Parent suite setup failed: OSError: [Errno 16] Device or resource busy Replace BGP peer config module, now with initiate-connection set to true. Parent suite setup failed: OSError: [Errno 16] Device or resource busy Wait until example-ipv4-topology becomes stable. Parent suite setup failed: OSError: [Errno 16] Device or resource busy Count the routes in example-ipv4-topology and fail if the count is not correct. critical Parent suite setup failed: OSError: [Errno 16] Device or resource busy Abort the Python speaker. Also, attempt to stop failing fast. critical Parent suite setup failed: OSError: [Errno 16] Device or resource busy Store results for plotting Parent suite setup failed: OSError: [Errno 16] Device or resource busy Wait until example-ipv4-topology becomes stable again. critical Parent suite setup failed: OSError: [Errno 16] Device or resource busy Example-ipv4-topology should be empty now. critical Parent suite setup failed: OSError: [Errno 16] Device or resource busy Revert the BGP configuration to the original state: without any configured peers. Parent suite setup failed: OSError: [Errno 16] Device or resource busy Executing command 'ps -elf | egrep python | egrep 'play.py' | egrep -v grep'. ${processes} = None Connection not open ${processes} ps -elf | egrep python | egrep ${filter} | egrep -v grep Executes ``command`` on the remote machine and returns its outputs. Connection not open ${processes} ${processes} = None ${processes} ${filter} Only searches for the list of processes, in case something else than kill has to be done with them. Connection not open None ${processes} Logs the given message with the given level. ${arg_length} = None Could not get length of 'None'. ${arg_length} ${pself_lines} Returns and logs the length of the given item as an integer. Could not get length of 'None'. Executing command 'echo 'None' | awk '{print "kill -9",$4}''. ${commands} = None Connection not open ${commands} echo '${pself_lines}' | awk '{print "kill -${signal}",$4}' Executes ``command`` on the remote machine and returns its outputs. Connection not open None ${commands} Logs the given message with the given level. Executing command 'echo 'set -exu; None' | sudo sh'. ${stdout} = None ${stderr} = None Connection not open ${stdout} ${stderr} echo 'set -exu; ${commands}' | sudo sh return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Connection not open ${processes} Kill processes by PIDs from given list (no-op if the list is empty), using specified signal. Log the kill commands used. Several failures occurred: 1) Could not get length of 'None'. 2) Connection not open 3) Connection not open 'play\.py' The main keyword. Search for processes, Log the list of them, kill them. Several failures occurred: 1) Connection not open 2) Could not get length of 'None'. 3) Connection not open 4) Connection not open KillPythonTool.Search_And_Kill_Remote_Python 'play\.py' Runs the given keyword with the given arguments and ignores possible error. index=1 host= alias=None port=22 timeout=10 seconds newline= prompt=> term_type=vt100 width=80 height=24 path_separator=/ encoding=UTF-8 escape_ansi=False encoding_errors=strict ${current_connection} = index=1 host= alias=None port=22 timeout=10 seconds newline= prompt=> term_type=vt100 width=80 height=24 path_separator=/ encoding=UTF-8 escape_ansi=False encoding_errors=strict ${current_connection} Returns information about the connection. ${odl_connection} = 2 ${odl_connection} ${ip_address} prompt=${ODL_SYSTEM_PROMPT} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into ':22' as 'jenkins'. OSError: [Errno 16] Device or resource busy ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. OSError: [Errno 16] Device or resource busy Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. user=${user} password=${password} delay=${delay} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. OSError: [Errno 16] Device or resource busy Returning from the enclosing user keyword. Flexible SSH Login user=${user} password=${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Call Flexible SSH Login, but with default values suitable for Controller machine. OSError: [Errno 16] Device or resource busy ${odl_connection} ${ip_address} Open a connection to the ODL system at and return its identifier. OSError: [Errno 16] Device or resource busy Cannot open session, you need to establish a connection first. sar -A -f /var/log/sa/sa* Writes the given ``text`` on the remote machine and appends a newline. Cannot open session, you need to establish a connection first. ${output} = None Cannot open session, you need to establish a connection first. ${output} Consumes and returns the server output until the prompt is found. Cannot open session, you need to establish a connection first. None ${output} Logs the given message with the given level. Closes the current connection. ${output} ${connection_index} Switches the active connection by index or alias. Returning from the enclosing user keyword. ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_connection.index} Restore active SSH connection in SSHLibrary to given index. Store current connection index, open new connection to ip_address. Run command to get sysstat results from script, which is running on all children nodes. Returns cpu, network, memory usage statistics from the node for each 10 minutes that node was running. Used for debug purposes. Returns whole output of sysstat. Several failures occurred: 1) OSError: [Errno 16] Device or resource busy 2) Cannot open session, you need to establish a connection first. 3) Cannot open session, you need to establish a connection first. Utils.Get_Sysstat_Statistics Runs the given keyword with the given arguments and ignores possible error. Deleting All Sessions Removes all the session objects Closes all open connections. Make sure Python tool was killed and tear down imported Resources. BGP performance of ingesting from 1 iBGP peer, data change counter is NOT used. Copyright (c) 2015 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html This suite uses play.py as single iBGP peer. The suite only looks at example-ipv4-topology, so RIB is not examined. The suite consists of two halves, differing on which side initiates BGP connection. State of "work is being done" is detected by increasing value of prefixes in topology. The time for Wait_For_Stable_* cases to finish is the main performance metric. After waiting for stability is done, full check on number of prefixes present is performed. Brief description how to configure BGP peer can be found here: https://wiki.opendaylight.org/view/BGP_LS_PCEP:User_Guide#BGP_Peer http://docs.opendaylight.org/en/stable-boron/user-guide/bgp-user-guide.html#bgp-peering TODO: Currently, if a bug causes prefix count to remain at zero, affected test cases will wait for max time. Reconsider. If zero is allowed as stable, higher period or repetitions would be required. The prefix counting is quite heavyweight and may induce large variation in time. Try the other version of the suite (singlepeer_changecount.robot) to get better precision. Suite setup failed: OSError: [Errno 16] Device or resource busy All Tests critical bgpcep-bgp-ingest-mixed.txt bgpcep-bgp-ingest-mixed.txt.Singlepeer Changecount bgpcep-bgp-ingest-mixed.txt.Singlepeer Prefixcount Error in file '/w/workspace/bgpcep-csit-1node-bgp-ingest-mixed-all-vanadium/test/csit/libraries/BGPSpeaker.robot' on line 27: Suite 'bgpcep-bgp-ingest-mixed.txt.Singlepeer Changecount' has already imported library 'SSHLibrary' with different arguments. This import is ignored. Error in file '/w/workspace/bgpcep-csit-1node-bgp-ingest-mixed-all-vanadium/test/csit/libraries/RemoteBash.robot' on line 25: Suite 'bgpcep-bgp-ingest-mixed.txt.Singlepeer Changecount' has already imported library 'SSHLibrary' with different arguments. This import is ignored. Error in file '/w/workspace/bgpcep-csit-1node-bgp-ingest-mixed-all-vanadium/test/csit/libraries/SSHKeywords.robot' on line 16: Suite 'bgpcep-bgp-ingest-mixed.txt.Singlepeer Changecount' has already imported library 'SSHLibrary' with different arguments. This import is ignored. Error in file '/w/workspace/bgpcep-csit-1node-bgp-ingest-mixed-all-vanadium/test/csit/libraries/Utils.robot' on line 4: Suite 'bgpcep-bgp-ingest-mixed.txt.Singlepeer Changecount' has already imported library 'SSHLibrary' with different arguments. This import is ignored. Error in file '/w/workspace/bgpcep-csit-1node-bgp-ingest-mixed-all-vanadium/test/csit/libraries/KarafKeywords.robot' on line 9: Suite 'bgpcep-bgp-ingest-mixed.txt.Singlepeer Changecount' has already imported library 'SSHLibrary' with different arguments. This import is ignored. Error in file '/w/workspace/bgpcep-csit-1node-bgp-ingest-mixed-all-vanadium/test/csit/libraries/BGPSpeaker.robot' on line 27: Suite 'bgpcep-bgp-ingest-mixed.txt.Singlepeer Prefixcount' has already imported library 'SSHLibrary' with different arguments. This import is ignored. Error in file '/w/workspace/bgpcep-csit-1node-bgp-ingest-mixed-all-vanadium/test/csit/libraries/RemoteBash.robot' on line 25: Suite 'bgpcep-bgp-ingest-mixed.txt.Singlepeer Prefixcount' has already imported library 'SSHLibrary' with different arguments. This import is ignored. Error in file '/w/workspace/bgpcep-csit-1node-bgp-ingest-mixed-all-vanadium/test/csit/libraries/SSHKeywords.robot' on line 16: Suite 'bgpcep-bgp-ingest-mixed.txt.Singlepeer Prefixcount' has already imported library 'SSHLibrary' with different arguments. This import is ignored. Error in file '/w/workspace/bgpcep-csit-1node-bgp-ingest-mixed-all-vanadium/test/csit/libraries/Utils.robot' on line 4: Suite 'bgpcep-bgp-ingest-mixed.txt.Singlepeer Prefixcount' has already imported library 'SSHLibrary' with different arguments. This import is ignored. Error in file '/w/workspace/bgpcep-csit-1node-bgp-ingest-mixed-all-vanadium/test/csit/libraries/KarafKeywords.robot' on line 9: Suite 'bgpcep-bgp-ingest-mixed.txt.Singlepeer Prefixcount' has already imported library 'SSHLibrary' with different arguments. This import is ignored.