${value} = 1658.4 ${value} ${REQUEST_COUNT}/10+20 Evaluates the given expression in Python and returns the result. ${value} = 1658.4 s ${value} \${${name}} ${value} Returns variable value or ``default`` if the variable does not exist. ${TESTTOOL_DEVICE_TIMEOUT} = 1658.4 s \${${name}} ${value} Makes a variable available everywhere within the scope of the current suite. TESTTOOL_DEVICE_TIMEOUT ${value} s Set a default value for an user configurable variable. This keyword is needed if your default value is calculated using a complex expression which needs BuiltIn.Evaluate or even more complex keywords. It sets the variable ${name} (the name of the variable MUST be specified WITHOUT the ${} syntactic sugar due to limitations of Robot Framework) to 1658.4 but only if the variable ${name} was not set previously. This keyword is intended for user configurable variables which are supposed to be set only with pybot -v; calling this keyword on a variable that was already set by another keyword will silently turn the call into a NOP and thus is a bug in the suite or resource trying to call this keyword. ${SuiteFastFail} = False ${SuiteFastFail} False Makes a variable available everywhere within the scope of the current suite. Set suite to not fail fast. ${already_done} = False ${already_done} \${ClusterManagement__has_setup_run} False Returns variable value or ``default`` if the variable does not exist. ${ClusterManagement__has_setup_run} = True \${ClusterManagement__has_setup_run} True Makes a variable available everywhere within the scope of the current suite. ${cluster_size} = 0 ${cluster_size} \${NUM_ODL_SYSTEM} 1 Returns variable value or ``default`` if the variable does not exist. ${cluster_size} Converts the given item to an integer number. ${status} = PASS ${possibly_int_of_members} = 0 ${status} ${possibly_int_of_members} BuiltIn.Convert_To_Integer ${cluster_size} Runs the given keyword with the given arguments and ignores possible error. ${int_of_members} = 0 ${int_of_members} '${status}' != 'PASS' ${1} ${possibly_int_of_members} Sets variable based on the given condition. @{member_index_list} = [ ] @{member_index_list} Returns a list containing given items. @{session_list} = [ ] @{session_list} Returns a list containing given items. &{index_to_ip_mapping} = { } &{index_to_ip_mapping} Creates and returns a dictionary based on the given ``items``. ${index} ${member_index_list} ${session_list} ${index_to_ip_mapping} http_timeout=${http_timeout} http_retries=${http_retries} Add a corresponding item based on index into the last three arguments. Create the Http session whose alias is added to list. ${index} 1 ${int_of_members+1} ${ClusterManagement__member_index_list} = [] \${ClusterManagement__member_index_list} ${member_index_list} Makes a variable available everywhere within the scope of the current suite. ${ClusterManagement__index_to_ip_mapping} = {} \${ClusterManagement__index_to_ip_mapping} ${index_to_ip_mapping} Makes a variable available everywhere within the scope of the current suite. ${ClusterManagement__session_list} = [] \${ClusterManagement__session_list} ${session_list} Makes a variable available everywhere within the scope of the current suite. int_of_members=${int_of_members} http_timeout=${http_timeout} http_retries=${http_retries} Construct index list, session list and IP mapping, publish them as suite variables. http_timeout=${http_timeout} Detect repeated call, or detect number of members and initialize derived suite variables. Http sessions are created with parameters to not waste time when ODL is no accepting connections properly. Not A Karaf App ${return_list_reference} = [] ${return_list_reference} """${given_list}""" != "" ${given_list} ${ClusterManagement__member_index_list} Sets variable based on the given condition. ${return_list_copy} = [] ${return_list_copy} @{return_list_reference} Returns a list containing given items. ${return_list_copy} ${index_list} = [] ${index_list} given_list=${member_index_list} Utility to allow ${EMPTY} as default argument value, as the internal list is computed at runtime. This keyword always returns a (shallow) copy of given or default list, so operations with the returned list should not affect other lists. Also note that this keyword does not consider empty list to be ${EMPTY}. command=${command} member_index=${index} Obtain IP, call Utils and return output. This keeps previous ssh session active. ${index} @{index_list} iptables -I INPUT -p tcp --dport ${KARAF_SHELL_PORT} -j ACCEPT; iptables-save Cycle through indices (or all), run command on each. First connections to Karaf console may fail, so WUKS is used. TODO: Track as a Bug. Displays the given messages in the log file as keyword arguments. BuiltIn.Wait_Until_Keyword_Succeeds 3s 1s Open_Controller_Karaf_Console_On_Background member_index=${index} Runs the given keyword with the given arguments and ignores possible error. ${index} @{ClusterManagement__member_index_list} http_timeout=${http_timeout} Initialize ClusterManagement. Open ssh karaf connections to each ODL. Not A Karaf App Not A Karaf App ${return_list_reference} = [] ${return_list_reference} """${given_list}""" != "" ${given_list} ${ClusterManagement__member_index_list} Sets variable based on the given condition. ${return_list_copy} = [] ${return_list_copy} @{return_list_reference} Returns a list containing given items. ${return_list_copy} ${index_list} = [] ${index_list} given_list=${member_index_list} Utility to allow ${EMPTY} as default argument value, as the internal list is computed at runtime. This keyword always returns a (shallow) copy of given or default list, so operations with the returned list should not affect other lists. Also note that this keyword does not consider empty list to be ${EMPTY}. ${status} ${output} Execute_Controller_Karaf_Command_With_Retry_On_Background log:log "ROBOT MESSAGE: ${message}" member_index=${index} Runs the given keyword with the given arguments and ignores possible error. ${output} Fails the test with the given message and optionally alters its tags. ${index} @{index_list} Starting suite ${SUITE_SOURCE} ${member_index_list} Make sure this resource is initialized. Send a message into the controller's karaf log file on every node listed (or all). By default, failure while processing a node is silently ignored, unless ${tolerate_failure} is False. Log suite name to karaf log, useful in suite setup. KarafKeywords.Log_Test_Suite_Start_To_Controller_Karaf Runs the given keyword with the given arguments and ignores possible error. Prepare both FailFast and Karaf logging, log that the caller suite has started. This keyword is to be used in suite setup, and without it the other keywords may not work properly. ${tmp} = {} ${tmp} Creates and returns a dictionary based on the given ``items``. ${NetconfKeywords__mounted_device_types} = {} ${NetconfKeywords__mounted_device_types} ${tmp} Makes a variable available everywhere within the scope of the current suite. Creating Session using : alias=default, url=http://:8181, headers={}, cookies={}, auth=<requests.auth.HTTPBasicAuth object at 0x7e91d279aad0>, timeout=2, proxies=None, verify=False, debug=0 default url=${url} auth=${auth} timeout=${timeout} max_retries=${max_retries} Create Session: create a HTTP session to a server timeout=2 Create "default" session to ${url} with authentication and connection parameters. This Keyword is in this Resource only so that user do not need to call RequestsLibrary directly. ${odl_connection} = 1 ${odl_connection} ${ip_address} prompt=${ODL_SYSTEM_PROMPT} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into ':22' as 'jenkins'. OSError: [Errno 16] Device or resource busy ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. OSError: [Errno 16] Device or resource busy Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. user=${user} password=${password} delay=${delay} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. OSError: [Errno 16] Device or resource busy Returning from the enclosing user keyword. Flexible SSH Login user=${user} password=${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Call Flexible SSH Login, but with default values suitable for Controller machine. OSError: [Errno 16] Device or resource busy ${odl_connection} ${odl} Open a connection to the ODL system at ${ip_address} and return its identifier. OSError: [Errno 16] Device or resource busy /w/workspace/netconf-csit-3node-clustering-scale-only-titanium/test/csit/libraries/../../tools/deployment/search.sh Uploads file(s) from the local machine to the remote machine. Closes the current connection. Open a connection to the tools system at ${ip_address} and return its identifier. Places search utility to ODL system, which will be needed for version detection. By default also initialize a SSH connection to Tools system, as following Keywords assume a working connection towards target system. OSError: [Errno 16] Device or resource busy Setup the environment for the other keywords of this Resource to work properly. OSError: [Errno 16] Device or resource busy Deploy RestPerfClient and determine the Java command to use to call it. Open a SSH connection through which the RestPerfClient will be invoked, deploy RestPerfClient and the data files it needs to do its work and initialize the internal state for the remaining keywords. ${testtool} Open a connection to the tools system at ${ip_address} and return its identifier. ${testtool} ${testtool} Makes a variable available everywhere within the scope of the current suite. node1 http://${ODL_SYSTEM_1_IP}:${RESTCONFPORT} headers=${HEADERS_XML} auth=${AUTH} Create Session: create a HTTP session to a server node2 http://${ODL_SYSTEM_2_IP}:${RESTCONFPORT} headers=${HEADERS_XML} auth=${AUTH} Create Session: create a HTTP session to a server Setup everything needed for the test cases. OSError: [Errno 16] Device or resource busy Deploy and start test tool, then wait for all its devices to become online. 1node critical netconf Parent suite setup failed: OSError: [Errno 16] Device or resource busy Configure the testtool device on Netconf connector, using node 1. 1node critical netconf Parent suite setup failed: OSError: [Errno 16] Device or resource busy Wait until the device becomes available through Netconf on node 1. 1node critical netconf Parent suite setup failed: OSError: [Errno 16] Device or resource busy Wait until the device data show up at node 2. 1node critical netconf Parent suite setup failed: OSError: [Errno 16] Device or resource busy Send some sample test data into the device through node 2 and check that the request went OK. 1node critical netconf Parent suite setup failed: OSError: [Errno 16] Device or resource busy Deploy and execute restperfclient, asking it to send the specified amount of requests to the netconf connector of the device through node 3. The duration of this test case is the main performance metric. 1node critical netconf Parent suite setup failed: OSError: [Errno 16] Device or resource busy Make sure there are no failed requests in the restperfclient log. This is a separate test case to distinguish between restperfclient failure and failed requests. Failed requests are rejected because we don't want to test performance of ODL rejecting our requests. If this test case fails, then the duration of Run_Restperfclient cannot be trusted to show the real performance of the cluster. 1node critical netconf Parent suite setup failed: OSError: [Errno 16] Device or resource busy Deconfigure the testtool device on Netconf connector using node 1. 1node critical netconf Parent suite setup failed: OSError: [Errno 16] Device or resource busy Deleting All Sessions Removes all the session objects Variable '${RestPerfClient__restperfclient}' not found. Did you mean: ${RestPerfClient__restperfclientlog} ${RestPerfClient__restperfclient} Switches the active connection by index or alias. Variable '${RestPerfClient__restperfclient}' not found. Did you mean: ${RestPerfClient__restperfclientlog} Closes the current connection. Free resources allocated during the RestPerfClient setup Variable '${RestPerfClient__restperfclient}' not found. Did you mean: ${RestPerfClient__restperfclientlog} Variable '${testtool}' not found. ${testtool} Switches the active connection by index or alias. Variable '${testtool}' not found. ${ctrl_c} = ${ctrl_c} chr(int(3)) Evaluates the given expression in Python and returns the result. No open connection. ${ctrl_c} Writes the given ``text`` on the remote machine without appending a newline. No open connection. Construct ctrl+c character and SSH-write it (without endline) to the current SSH connection. Do not read anything yet. No open connection. No open connection. Consumes and returns the server output until the prompt is found. No open connection. Variable '${testtool_log}' not found. ${testtool_log} Downloads file(s) from the remote machine to the local machine. Variable '${testtool_log}' not found. Stop testtool and download its log. Several failures occurred: 1) No open connection. 2) No open connection. 3) Variable '${testtool_log}' not found. NetconfKeywords.Stop_Testtool Runs the given keyword with the given arguments and ignores possible error. Teardown the test infrastructure, perform cleanup and release all resources. Several failures occurred: 1) Variable '${RestPerfClient__restperfclient}' not found. Did you mean: ${RestPerfClient__restperfclientlog} 2) Variable '${testtool}' not found. netconf-restperfclient update performance test suite (clustered setup). Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html Perform given count of update operations on device data mounted onto a netconf connector (using the netconf-testtool-restperfclient tool) and see how much time it took. More exactly, it sends the data to a restconf mountpoint of the netconf connector belonging to the device, which turns out to turn the first request sent to a "create" request and the remaining requests to "update" requests (due to how the testtool device behavior is implemented). The difference from the "single node" test suite (see ../scale/performance.robot) is that the device is configured and the data on it created using one node in the cluster and the update operations are issued on a different node. This forces the cluster nodes to communicate with each other about the data to be sent to the device. Suite setup failed: OSError: [Errno 16] Device or resource busy Also suite teardown failed: Several failures occurred: 1) Variable '${RestPerfClient__restperfclient}' not found. Did you mean: ${RestPerfClient__restperfclientlog} 2) Variable '${testtool}' not found. All Tests 1node critical netconf netconf-clustering-scale.txt Error in file '/w/workspace/netconf-csit-3node-clustering-scale-only-titanium/test/csit/libraries/KarafKeywords.robot' on line 9: Suite 'netconf-clustering-scale.txt' has already imported library 'SSHLibrary' with different arguments. This import is ignored. Error in file '/w/workspace/netconf-csit-3node-clustering-scale-only-titanium/test/csit/libraries/SSHKeywords.robot' on line 16: Suite 'netconf-clustering-scale.txt' has already imported library 'SSHLibrary' with different arguments. This import is ignored. Error in file '/w/workspace/netconf-csit-3node-clustering-scale-only-titanium/test/csit/libraries/Utils.robot' on line 4: Suite 'netconf-clustering-scale.txt' has already imported library 'SSHLibrary' with different arguments. This import is ignored. Error in file '/w/workspace/netconf-csit-3node-clustering-scale-only-titanium/test/csit/libraries/NetconfKeywords.robot' on line 20: Suite 'netconf-clustering-scale.txt' has already imported library 'SSHLibrary' with different arguments. This import is ignored. Error in file '/w/workspace/netconf-csit-3node-clustering-scale-only-titanium/test/csit/libraries/NexusKeywords.robot' on line 20: Suite 'netconf-clustering-scale.txt' has already imported library 'SSHLibrary' with different arguments. This import is ignored. Error in file '/w/workspace/netconf-csit-3node-clustering-scale-only-titanium/test/csit/libraries/RemoteBash.robot' on line 25: Suite 'netconf-clustering-scale.txt' has already imported library 'SSHLibrary' with different arguments. This import is ignored. Error in file '/w/workspace/netconf-csit-3node-clustering-scale-only-titanium/test/csit/libraries/RestPerfClient.robot' on line 31: Suite 'netconf-clustering-scale.txt' has already imported library 'SSHLibrary' with different arguments. This import is ignored.