${SuiteFastFail} = False ${SuiteFastFail} False Makes a variable available everywhere within the scope of the current suite. Set suite to not fail fast. ${already_done} = False ${already_done} \${ClusterManagement__has_setup_run} False Returns variable value or ``default`` if the variable does not exist. ${ClusterManagement__has_setup_run} = True \${ClusterManagement__has_setup_run} True Makes a variable available everywhere within the scope of the current suite. ${cluster_size} = 0 ${cluster_size} \${NUM_ODL_SYSTEM} 1 Returns variable value or ``default`` if the variable does not exist. ${cluster_size} Converts the given item to an integer number. ${status} = PASS ${possibly_int_of_members} = 0 ${status} ${possibly_int_of_members} BuiltIn.Convert_To_Integer ${cluster_size} Runs the given keyword with the given arguments and ignores possible error. ${int_of_members} = 0 ${int_of_members} '${status}' != 'PASS' ${1} ${possibly_int_of_members} Sets variable based on the given condition. @{member_index_list} = [ ] @{member_index_list} Returns a list containing given items. @{session_list} = [ ] @{session_list} Returns a list containing given items. &{index_to_ip_mapping} = { } &{index_to_ip_mapping} Creates and returns a dictionary based on the given ``items``. ${index} ${member_index_list} ${session_list} ${index_to_ip_mapping} http_timeout=${http_timeout} http_retries=${http_retries} Add a corresponding item based on index into the last three arguments. Create the Http session whose alias is added to list. ${index} 1 ${int_of_members+1} ${ClusterManagement__member_index_list} = [] \${ClusterManagement__member_index_list} ${member_index_list} Makes a variable available everywhere within the scope of the current suite. ${ClusterManagement__index_to_ip_mapping} = {} \${ClusterManagement__index_to_ip_mapping} ${index_to_ip_mapping} Makes a variable available everywhere within the scope of the current suite. ${ClusterManagement__session_list} = [] \${ClusterManagement__session_list} ${session_list} Makes a variable available everywhere within the scope of the current suite. int_of_members=${int_of_members} http_timeout=${http_timeout} http_retries=${http_retries} Construct index list, session list and IP mapping, publish them as suite variables. http_timeout=${http_timeout} Detect repeated call, or detect number of members and initialize derived suite variables. Http sessions are created with parameters to not waste time when ODL is no accepting connections properly. Not A Karaf App ${return_list_reference} = [] ${return_list_reference} """${given_list}""" != "" ${given_list} ${ClusterManagement__member_index_list} Sets variable based on the given condition. ${return_list_copy} = [] ${return_list_copy} @{return_list_reference} Returns a list containing given items. ${return_list_copy} ${index_list} = [] ${index_list} given_list=${member_index_list} Utility to allow ${EMPTY} as default argument value, as the internal list is computed at runtime. This keyword always returns a (shallow) copy of given or default list, so operations with the returned list should not affect other lists. Also note that this keyword does not consider empty list to be ${EMPTY}. command=${command} member_index=${index} Obtain IP, call Utils and return output. This keeps previous ssh session active. ${index} @{index_list} iptables -I INPUT -p tcp --dport ${KARAF_SHELL_PORT} -j ACCEPT; iptables-save Cycle through indices (or all), run command on each. First connections to Karaf console may fail, so WUKS is used. TODO: Track as a Bug. Displays the given messages in the log file as keyword arguments. BuiltIn.Wait_Until_Keyword_Succeeds 3s 1s Open_Controller_Karaf_Console_On_Background member_index=${index} Runs the given keyword with the given arguments and ignores possible error. ${index} @{ClusterManagement__member_index_list} http_timeout=${http_timeout} Initialize ClusterManagement. Open ssh karaf connections to each ODL. Not A Karaf App Not A Karaf App ${return_list_reference} = [] ${return_list_reference} """${given_list}""" != "" ${given_list} ${ClusterManagement__member_index_list} Sets variable based on the given condition. ${return_list_copy} = [] ${return_list_copy} @{return_list_reference} Returns a list containing given items. ${return_list_copy} ${index_list} = [] ${index_list} given_list=${member_index_list} Utility to allow ${EMPTY} as default argument value, as the internal list is computed at runtime. This keyword always returns a (shallow) copy of given or default list, so operations with the returned list should not affect other lists. Also note that this keyword does not consider empty list to be ${EMPTY}. ${status} ${output} Execute_Controller_Karaf_Command_With_Retry_On_Background log:log "ROBOT MESSAGE: ${message}" member_index=${index} Runs the given keyword with the given arguments and ignores possible error. ${output} Fails the test with the given message and optionally alters its tags. ${index} @{index_list} Starting suite ${SUITE_SOURCE} ${member_index_list} Make sure this resource is initialized. Send a message into the controller's karaf log file on every node listed (or all). By default, failure while processing a node is silently ignored, unless ${tolerate_failure} is False. Log suite name to karaf log, useful in suite setup. KarafKeywords.Log_Test_Suite_Start_To_Controller_Karaf Runs the given keyword with the given arguments and ignores possible error. Prepare both FailFast and Karaf logging, log that the caller suite has started. This keyword is to be used in suite setup, and without it the other keywords may not work properly. prompt=${TOOLS_SYSTEM_PROMPT} Update the default `configuration`. ${TOOLS_SYSTEM_IP} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into ':22' as 'jenkins'. OSError: [Errno 16] Device or resource busy ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. OSError: [Errno 16] Device or resource busy Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. user=${user} password=${password} delay=${delay} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. OSError: [Errno 16] Device or resource busy Returning from the enclosing user keyword. Flexible SSH Login user=${user} password=${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Call Flexible SSH Login, but with default values suitable for Mininet machine. OSError: [Errno 16] Device or resource busy /w/workspace/controller-csit-1node-benchmark-all-titanium/test/csit/suites/controller/benchmark/../../../../tools/mdsal_benchmark/${tool} Uploads file(s) from the local machine to the remote machine. Creates virtual env. If not to use the default name, use Virtual_Env_Set_Path kw. Returns stdout. requests Installs python package into virtual env. Use with version if needed (e.g. exabgp==3.4.16). Returns stdout. log:set ${ODL_LOG_LEVEL} Cycle through indices (or all), run karaf command on each. Setup imported resources, SSH-login to mininet machine, create HTTP session, put Python tool to mininet machine. OSError: [Errno 16] Device or resource busy critical singlenode_setup Parent suite setup failed: OSError: [Errno 16] Device or resource busy Merge created csvs into given file necause plot plugin cannot have more source files for one graph. Parent suite setup failed: OSError: [Errno 16] Device or resource busy ${cd_and_command} = cd '.' && rm -rf /tmp/defaultvenv ${cd_and_command} cd '${path}' && ${command} Returns the given values which can then be assigned to a variables. Executing command 'cd '.' && rm -rf /tmp/defaultvenv'. ${stdout} = None ${stderr} = None ${rc} = None Connection not open ${stdout} ${stderr} ${rc} ${command} return_stderr=True return_rc=True Executes ``command`` on the remote machine and returns its outputs. Connection not open Could not get length of 'None'. ${stderr} Verifies that the given item is empty. Could not get length of 'None'. ${emptiness_status} = FAIL ${result} = Could not get length of 'None'. ${emptiness_status} ${result} BuiltIn.Should_Be_Empty ${stderr} Runs the given keyword with the given arguments and ignores possible error. ${success} = False ${success} (${rc} == 0) and (("${emptiness_status}" == "PASS") or not ${stderr_must_be_empty}) True False Sets variable based on the given condition. None ${stdout} Logs the given message with the given level. None ${stderr} Logs the given message with the given level. None ${rc} Logs the given message with the given level. ${stdout} ${stderr} ${rc} Log everything returned by SSHLibrary.Execute_Command ${success} ${stdout} Got rc: None or stderr was not empty: None Got rc: ${rc} or stderr was not empty: ${stderr} Fails the test with the given message and optionally alters its tags. Got rc: None or stderr was not empty: None ${cd_and_command} return_success_only=False log_on_success=${log_on_success} log_on_failure=${log_on_failure} stderr_must_be_empty=${stderr_must_be_empty} Execute command via the active SSH connection. For success, rc has to be zero and optionally stderr has to be empty. Log everything, depending on arguments and success. Return either success string or stdout. TODO: Do we want to support customizing return values the same way as SSHLibrary.Execute_Command does? Several failures occurred: 1) Connection not open 2) Got rc: None or stderr was not empty: None Returning from the enclosing user keyword. Execute_Command_Passes ${cd_and_command} return_success_only=False log_on_success=${log_on_success} log_on_failure=${log_on_failure} stderr_must_be_empty=${stderr_must_be_empty} Runs the specified keyword and returns from the enclosing user keyword. command=${command} path=${SSHKeywords__current_remote_working_directory} log_on_success=${log_on_success} log_on_failure=${log_on_failure} stderr_must_be_empty=${stderr_must_be_empty} A keyword similar to Execute_Command_Should_Pass which performs "cd" to ${path} before executing the rm -rf /tmp/defaultvenv. This is useful when rewriting bash scripts, as series of SSHLibrary.Execute_Command do not share current working directory. TODO: Perhaps a Keyword which sets up environment variables would be useful as well. Several failures occurred: 1) Connection not open 2) Got rc: None or stderr was not empty: None Returning from the enclosing user keyword. Execute_Command_At_Path_Should_Pass command=${command} path=${SSHKeywords__current_remote_working_directory} log_on_success=${log_on_success} log_on_failure=${log_on_failure} stderr_must_be_empty=${stderr_must_be_empty} Runs the specified keyword and returns from the enclosing user keyword. rm -rf ${SSHKeywords__current_venv_path} Run Execute_Command_At_Path_Should_Pass with previously set CWD as path. Several failures occurred: 1) Connection not open 2) Got rc: None or stderr was not empty: None Deletes a directory with virtual env. Several failures occurred: 1) Connection not open 2) Got rc: None or stderr was not empty: None Closes all open connections. Cleaning-up Several failures occurred: 1) Connection not open 2) Got rc: None or stderr was not empty: None MD-SAL Data Store benchmarking. Copyright (c) 2015 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html This test suite uses the odl-dsbenchmark-impl feature controlled via dsbenchmark.py tool for testing the MD-SAL Data Store performance. (see the 'https://wiki.opendaylight.org/view/Controller_Core_Functionality_Tutorials:Tutorials:Data_Store_Benchmarking_and_Data_Access_Patterns') Based on values in test suite variables it triggers required numbers of warm-up and measured test runs: odl-dsbenchmark-impl module generates (towards MD-SAL Data Store) specified structure, type and number of operations. The test suite performs checks for start-up and test execution timeouts (Start Measurement, Wait For Results) and basic checks for test runs results (Check Results). Finally it provides total numbers per operation structure and type (by default in the perf_per_struct.csv, perf_per_ops.csv files) suitable for plotting in system test environment. See also the 'https://wiki.opendaylight.org/view/CrossProject:Integration_Group:System_Test:Step_by_Step_Guide#Optional_-_Plot_a_graph_from_your_job' Included totals can be filtered using the FILTER parameter (RegExp). Because of the way how graphs are drawn, it is recomended to keep all test suite variables unchanged as defined for the 1st build. Parameters WARMUPS, RUNS and accordingly the TIMEOUT value can be changed for each build if needed. Parameter UNITS defines time units returned by odl-dsbenchmark-impl module. The dsbenchmark.py tool always returns values in miliseconds. When running this robot suite always use --exclude tag for distinguish the run for 3node setup: need a benchmark for leader and follow (--exclude singlenode_setup) the run for 1node setup: no followr present (--exclude clustered_setup) Suite setup failed: OSError: [Errno 16] Device or resource busy Also suite teardown failed: Several failures occurred: 1) Connection not open 2) Got rc: None or stderr was not empty: None All Tests critical singlenode_setup controller-benchmark.txt Error in file '/w/workspace/controller-csit-1node-benchmark-all-titanium/test/csit/libraries/KarafKeywords.robot' on line 9: Suite 'controller-benchmark.txt' has already imported library 'SSHLibrary' with different arguments. This import is ignored. Error in file '/w/workspace/controller-csit-1node-benchmark-all-titanium/test/csit/libraries/SSHKeywords.robot' on line 16: Suite 'controller-benchmark.txt' has already imported library 'SSHLibrary' with different arguments. This import is ignored. Error in file '/w/workspace/controller-csit-1node-benchmark-all-titanium/test/csit/libraries/Utils.robot' on line 4: Suite 'controller-benchmark.txt' has already imported library 'SSHLibrary' with different arguments. This import is ignored. Error in file '/w/workspace/controller-csit-1node-benchmark-all-titanium/test/csit/libraries/RemoteBash.robot' on line 25: Suite 'controller-benchmark.txt' has already imported library 'SSHLibrary' with different arguments. This import is ignored.