Started by upstream project "integration-distribution-test-calcium" build number 75 originally caused by: Started by upstream project "autorelease-release-calcium-mvn38-openjdk17" build number 92 originally caused by: Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on prd-centos8-robot-2c-8g-7613 (centos8-robot-2c-8g) in workspace /w/workspace/daexim-csit-1node-basic-only-calcium [ssh-agent] Looking for ssh-agent implementation... [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) $ ssh-agent SSH_AUTH_SOCK=/tmp/ssh-RrpkimNb5ucZ/agent.5299 SSH_AGENT_PID=5300 [ssh-agent] Started. Running ssh-add (command line suppressed) Identity added: /w/workspace/daexim-csit-1node-basic-only-calcium@tmp/private_key_783794394317000428.key (/w/workspace/daexim-csit-1node-basic-only-calcium@tmp/private_key_783794394317000428.key) [ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key) The recommended git tool is: NONE using credential opendaylight-jenkins-ssh Wiping out workspace first. Cloning the remote Git repository Cloning repository git://devvexx.opendaylight.org/mirror/integration/test > git init /w/workspace/daexim-csit-1node-basic-only-calcium/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test > git --version # timeout=10 > git --version # 'git version 2.39.1' using GIT_SSH to set credentials Release Engineering Jenkins Key [INFO] Currently running in a labeled security context [INFO] Currently SELinux is 'enforcing' on the host > /usr/bin/chcon --type=ssh_home_t /w/workspace/daexim-csit-1node-basic-only-calcium/test@tmp/jenkins-gitclient-ssh1398110885344670551.key Verifying host key using known hosts file You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Configure Global Security' -> 'Git Host Key Verification Configuration' and configure host key verification. > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test using GIT_SSH to set credentials Release Engineering Jenkins Key [INFO] Currently running in a labeled security context [INFO] Currently SELinux is 'enforcing' on the host > /usr/bin/chcon --type=ssh_home_t /w/workspace/daexim-csit-1node-basic-only-calcium/test@tmp/jenkins-gitclient-ssh11439669074977003890.key Verifying host key using known hosts file You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Configure Global Security' -> 'Git Host Key Verification Configuration' and configure host key verification. > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10 > git rev-parse FETCH_HEAD^{commit} # timeout=10 Checking out Revision ff1bb51a8a14f89ceefd91c6fc535a4bce78e0de (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f ff1bb51a8a14f89ceefd91c6fc535a4bce78e0de # timeout=10 Commit message: "Support both empty data formats" > git rev-parse FETCH_HEAD^{commit} # timeout=10 > git rev-list --no-walk 3e5edace5526f9876023937f2be30c8eb91e4de4 # timeout=10 No emails were triggered. provisioning config files... copy managed file [npmrc] to file:/home/jenkins/.npmrc copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [daexim-csit-1node-basic-only-calcium] $ /bin/bash /tmp/jenkins16908576924193401029.sh ---> python-tools-install.sh Setup pyenv: system * 3.8.13 (set by /opt/pyenv/version) * 3.9.13 (set by /opt/pyenv/version) * 3.10.6 (set by /opt/pyenv/version) lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-Tss4 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-Tss4/bin to PATH Generating Requirements File Python 3.10.6 pip 23.3.1 from /tmp/venv-Tss4/lib/python3.10/site-packages/pip (python 3.10) appdirs==1.4.4 argcomplete==3.2.1 aspy.yaml==1.3.0 attrs==23.1.0 autopage==0.5.2 Babel==2.14.0 beautifulsoup4==4.12.2 boto3==1.33.13 botocore==1.33.13 bs4==0.0.1 cachetools==5.3.2 certifi==2023.11.17 cffi==1.16.0 cfgv==3.4.0 chardet==5.2.0 charset-normalizer==3.3.2 click==8.1.7 cliff==4.4.0 cmd2==2.4.3 cryptography==3.3.2 debtcollector==2.5.0 decorator==5.1.1 defusedxml==0.7.1 Deprecated==1.2.14 distlib==0.3.8 dnspython==2.4.2 docker==4.2.2 dogpile.cache==1.2.2 email-validator==2.1.0.post1 filelock==3.13.1 future==0.18.3 gitdb==4.0.11 GitPython==3.1.40 google-auth==2.25.2 httplib2==0.22.0 identify==2.5.33 idna==3.6 importlib-metadata==7.0.0 importlib-resources==1.5.0 iso8601==2.1.0 Jinja2==3.1.2 jmespath==1.0.1 jsonpatch==1.33 jsonpointer==2.4 jsonschema==4.20.0 jsonschema-specifications==2023.11.2 keystoneauth1==5.4.0 kubernetes==28.1.0 lftools==0.37.8 lxml==4.9.3 MarkupSafe==2.1.3 msgpack==1.0.7 multi-key-dict==2.0.3 munch==4.0.0 netaddr==0.9.0 netifaces==0.11.0 niet==1.4.2 nodeenv==1.8.0 oauth2client==4.1.3 oauthlib==3.2.2 openstacksdk==0.62.0 os-client-config==2.1.0 os-service-types==1.7.0 osc-lib==2.9.0 oslo.config==9.2.0 oslo.context==5.3.0 oslo.i18n==6.2.0 oslo.log==5.4.0 oslo.serialization==5.2.0 oslo.utils==6.3.0 packaging==23.2 pbr==6.0.0 platformdirs==4.1.0 prettytable==3.9.0 pyasn1==0.5.1 pyasn1-modules==0.3.0 pycparser==2.21 pygerrit2==2.0.15 PyGithub==2.1.1 pyinotify==0.9.6 PyJWT==2.8.0 PyNaCl==1.5.0 pyparsing==2.4.7 pyperclip==1.8.2 pyrsistent==0.20.0 python-cinderclient==9.4.0 python-dateutil==2.8.2 python-heatclient==3.3.0 python-jenkins==1.8.2 python-keystoneclient==5.2.0 python-magnumclient==4.3.0 python-novaclient==18.4.0 python-openstackclient==6.0.0 python-swiftclient==4.4.0 pytz==2023.3.post1 PyYAML==6.0.1 referencing==0.32.0 requests==2.31.0 requests-oauthlib==1.3.1 requestsexceptions==1.4.0 rfc3986==2.0.0 rpds-py==0.13.2 rsa==4.9 ruamel.yaml==0.18.5 ruamel.yaml.clib==0.2.8 s3transfer==0.8.2 simplejson==3.19.2 six==1.16.0 smmap==5.0.1 soupsieve==2.5 stevedore==5.1.0 tabulate==0.9.0 toml==0.10.2 tomlkit==0.12.3 tqdm==4.66.1 typing_extensions==4.9.0 tzdata==2023.3 urllib3==1.26.18 virtualenv==20.25.0 wcwidth==0.2.12 websocket-client==1.7.0 wrapt==1.16.0 xdg==6.0.0 xmltodict==0.13.0 yq==3.2.3 zipp==3.17.0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_STACK_TEMPLATE=csit-2-instance-type.yaml OS_CLOUD=vex OS_STACK_NAME=releng-daexim-csit-1node-basic-only-calcium-75 OS_STACK_TEMPLATE_DIR=openstack-hot [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [daexim-csit-1node-basic-only-calcium] $ /bin/bash /tmp/jenkins16140397405533220953.sh ---> Create parameters file for OpenStack HOT OpenStack Heat parameters generated ----------------------------------- parameters: vm_0_count: '1' vm_0_flavor: 'v3-standard-4' vm_0_image: 'ZZCI - CentOS Stream 8 - builder - x86_64 - 20230727-135233.501' vm_1_count: '0' vm_1_flavor: 'v3-standard-2' vm_1_image: 'ZZCI - Ubuntu 18.04 - mininet-ovs-28 - x86_64 - 20230501-180106.320' job_name: '07810-75' silo: 'releng' [daexim-csit-1node-basic-only-calcium] $ /bin/bash -l /tmp/jenkins4644304223486615175.sh ---> Create HEAT stack + source /home/jenkins/lf-env.sh + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ++ mktemp -d /tmp/venv-XXXX + lf_venv=/tmp/venv-CKUs + local venv_file=/tmp/.os_lf_venv + local python=python3 + local options + local set_path=true + local install_args= ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\''' + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\''' ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + true + case $1 in + python=python3 + shift 2 + true + case $1 in + shift + break + case $python in + local pkg_list= + [[ -d /opt/pyenv ]] + echo 'Setup pyenv:' Setup pyenv: + export PYENV_ROOT=/opt/pyenv + PYENV_ROOT=/opt/pyenv + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + pyenv versions system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/daexim-csit-1node-basic-only-calcium/.python-version) + command -v pyenv ++ pyenv init - --no-rehash + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "'\''/opt/pyenv/shims'\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; fi; done; echo "${paths[*]}"'\'')" export PATH="/opt/pyenv/shims:${PATH}" export PYENV_SHELL=bash source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\'' pyenv() { local command command="${1:-}" if [ "$#" -gt 0 ]; then shift fi case "$command" in rehash|shell) eval "$(pyenv "sh-$command" "$@")" ;; *) command pyenv "$command" "$@" ;; esac }' +++ bash --norc -ec 'IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; fi; done; echo "${paths[*]}"' ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ export PYENV_SHELL=bash ++ PYENV_SHELL=bash ++ source /opt/pyenv/libexec/../completions/pyenv.bash +++ complete -F _pyenv pyenv ++ lf-pyver python3 ++ local py_version_xy=python3 ++ local py_version_xyz= ++ awk '{ print $1 }' ++ pyenv versions ++ local command ++ command=versions ++ '[' 1 -gt 0 ']' ++ shift ++ case "$command" in ++ command pyenv versions ++ pyenv versions ++ sed 's/^[ *]* //' ++ grep -E '^[0-9.]*[0-9]$' ++ [[ ! -s /tmp/.pyenv_versions ]] +++ tail -n 1 +++ grep '^3' /tmp/.pyenv_versions +++ sort -V ++ py_version_xyz=3.10.6 ++ [[ -z 3.10.6 ]] ++ echo 3.10.6 ++ return 0 + pyenv local 3.10.6 + local command + command=local + '[' 2 -gt 0 ']' + shift + case "$command" in + command pyenv local 3.10.6 + pyenv local 3.10.6 + for arg in "$@" + case $arg in + pkg_list+='lftools[openstack] ' + for arg in "$@" + case $arg in + pkg_list+='kubernetes ' + for arg in "$@" + case $arg in + pkg_list+='niet ' + for arg in "$@" + case $arg in + pkg_list+='python-heatclient ' + for arg in "$@" + case $arg in + pkg_list+='python-openstackclient ' + for arg in "$@" + case $arg in + pkg_list+='python-magnumclient ' + for arg in "$@" + case $arg in + pkg_list+='yq ' + [[ -f /tmp/.os_lf_venv ]] ++ cat /tmp/.os_lf_venv + lf_venv=/tmp/venv-Tss4 + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Tss4 from' file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Tss4 from file:/tmp/.os_lf_venv + /tmp/venv-Tss4/bin/python3 -m pip install --upgrade --quiet pip virtualenv + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ]] + echo 'lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ' lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + /tmp/venv-Tss4/bin/python3 -m pip install --upgrade --quiet --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + type python3 + true + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-Tss4/bin to PATH' lf-activate-venv(): INFO: Adding /tmp/venv-Tss4/bin to PATH + PATH=/tmp/venv-Tss4/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + return 0 + openstack --os-cloud vex limits show --absolute +--------------------------+---------+ | Name | Value | +--------------------------+---------+ | maxTotalInstances | -1 | | maxTotalCores | 450 | | maxTotalRAMSize | 1000000 | | maxServerMeta | 128 | | maxImageMeta | 128 | | maxPersonality | 5 | | maxPersonalitySize | 10240 | | maxTotalKeypairs | 100 | | maxServerGroups | 10 | | maxServerGroupMembers | 10 | | maxTotalFloatingIps | -1 | | maxSecurityGroups | -1 | | maxSecurityGroupRules | -1 | | totalRAMUsed | 376832 | | totalCoresUsed | 92 | | totalInstancesUsed | 33 | | totalFloatingIpsUsed | 0 | | totalSecurityGroupsUsed | 0 | | totalServerGroupsUsed | 0 | | maxTotalVolumes | -1 | | maxTotalSnapshots | 10 | | maxTotalVolumeGigabytes | 4096 | | maxTotalBackups | 10 | | maxTotalBackupGigabytes | 1000 | | totalVolumesUsed | 0 | | totalGigabytesUsed | 0 | | totalSnapshotsUsed | 0 | | totalBackupsUsed | 0 | | totalBackupGigabytesUsed | 0 | +--------------------------+---------+ + pushd /opt/ciman/openstack-hot /opt/ciman/openstack-hot /w/workspace/daexim-csit-1node-basic-only-calcium + lftools openstack --os-cloud vex stack create releng-daexim-csit-1node-basic-only-calcium-75 csit-2-instance-type.yaml /w/workspace/daexim-csit-1node-basic-only-calcium/stack-parameters.yaml Creating stack releng-daexim-csit-1node-basic-only-calcium-75 Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... WARN: Failed to initialize stack. Reason: Timed out TypeError: delete() missing 1 required positional argument: 'force' Build step 'Execute shell' marked build as failure $ ssh-agent -k unset SSH_AUTH_SOCK; unset SSH_AGENT_PID; echo Agent pid 5300 killed; [ssh-agent] Stopped. Recording plot data Robot results publisher started... -Parsing output xml: Failed! hudson.AbortException: No files found in path /w/workspace/daexim-csit-1node-basic-only-calcium with configured filemask: output.xml at hudson.plugins.robot.RobotParser$RobotParserCallable.invoke(RobotParser.java:76) at hudson.plugins.robot.RobotParser$RobotParserCallable.invoke(RobotParser.java:52) at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3578) at hudson.remoting.UserRequest.perform(UserRequest.java:211) at hudson.remoting.UserRequest.perform(UserRequest.java:54) at hudson.remoting.Request$2.run(Request.java:377) at hudson.remoting.InterceptingExecutorService.lambda$wrap$0(InterceptingExecutorService.java:78) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:829) Suppressed: hudson.remoting.Channel$CallSiteStackTrace: Remote call to prd-centos8-robot-2c-8g-7613 at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1787) at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:356) at hudson.remoting.Channel.call(Channel.java:1003) at hudson.FilePath.act(FilePath.java:1192) at hudson.FilePath.act(FilePath.java:1181) at hudson.plugins.robot.RobotParser.parse(RobotParser.java:48) at hudson.plugins.robot.RobotPublisher.parse(RobotPublisher.java:246) at hudson.plugins.robot.RobotPublisher.perform(RobotPublisher.java:267) at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:80) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:818) at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:767) at hudson.model.Build$BuildExecution.post2(Build.java:179) at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:711) at hudson.model.Run.execute(Run.java:1918) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44) at hudson.model.ResourceController.execute(ResourceController.java:101) at hudson.model.Executor.run(Executor.java:442) [PostBuildScript] - [INFO] Executing post build scripts. [daexim-csit-1node-basic-only-calcium] $ /bin/bash /tmp/jenkins13483490865030400408.sh Archiving csit artifacts mv: cannot stat 'odl1_*': No such file or directory mv: cannot stat 'karaf_1_*_threads*': No such file or directory mv: cannot stat '*_1.png': No such file or directory mv: cannot stat '/tmp/odl1_*': No such file or directory mv: cannot stat 'gclogs-1': No such file or directory % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 188 0 188 0 0 5529 0 --:--:-- --:--:-- --:--:-- 5529 Archive: robot-plugin.zip End-of-central-directory signature not found. Either this file is not a zipfile, or it constitutes one disk of a multi-part archive. In the latter case the central directory and zipfile comment will be found on the last disk(s) of this archive. unzip: cannot find zipfile directory in one of robot-plugin.zip or robot-plugin.zip.zip, and cannot find robot-plugin.zip.ZIP, period. mv: cannot stat '*.log': No such file or directory mv: cannot stat '*.log.gz': No such file or directory mv: cannot stat '*.csv': No such file or directory mv: cannot stat '*.png': No such file or directory [PostBuildScript] - [INFO] Executing post build scripts. [daexim-csit-1node-basic-only-calcium] $ /bin/bash /tmp/jenkins17730947171916860677.sh [PostBuildScript] - [INFO] Executing post build scripts. [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_CLOUD=vex OS_STACK_NAME=releng-daexim-csit-1node-basic-only-calcium-75 [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [daexim-csit-1node-basic-only-calcium] $ /bin/bash /tmp/jenkins18382689402642499827.sh ---> openstack-stack-delete.sh Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/daexim-csit-1node-basic-only-calcium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Tss4 from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient lf-activate-venv(): INFO: Adding /tmp/venv-Tss4/bin to PATH INFO: Retrieving stack cost for: releng-daexim-csit-1node-basic-only-calcium-75 DEBUG: Successfully retrieved stack cost: total: 0.11 INFO: Deleting stack releng-daexim-csit-1node-basic-only-calcium-75 Waiting for stack to delete... Waiting for stack to delete... Successfully deleted stack releng-daexim-csit-1node-basic-only-calcium-75 [PostBuildScript] - [INFO] Executing post build scripts. [daexim-csit-1node-basic-only-calcium] $ /bin/bash /tmp/jenkins16880256665254501502.sh ---> sysstat.sh [daexim-csit-1node-basic-only-calcium] $ /bin/bash /tmp/jenkins11811332217144434330.sh ---> package-listing.sh ++ tr '[:upper:]' '[:lower:]' ++ facter osfamily + OS_FAMILY=redhat + workspace=/w/workspace/daexim-csit-1node-basic-only-calcium + START_PACKAGES=/tmp/packages_start.txt + END_PACKAGES=/tmp/packages_end.txt + DIFF_PACKAGES=/tmp/packages_diff.txt + PACKAGES=/tmp/packages_start.txt + '[' /w/workspace/daexim-csit-1node-basic-only-calcium ']' + PACKAGES=/tmp/packages_end.txt + case "${OS_FAMILY}" in + rpm -qa + sort + '[' -f /tmp/packages_start.txt ']' + '[' -f /tmp/packages_end.txt ']' + diff /tmp/packages_start.txt /tmp/packages_end.txt + '[' /w/workspace/daexim-csit-1node-basic-only-calcium ']' + mkdir -p /w/workspace/daexim-csit-1node-basic-only-calcium/archives/ + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/daexim-csit-1node-basic-only-calcium/archives/ [daexim-csit-1node-basic-only-calcium] $ /bin/bash /tmp/jenkins11455271860109978430.sh ---> capture-instance-metadata.sh Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/daexim-csit-1node-basic-only-calcium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Tss4 from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-Tss4/bin to PATH INFO: Running in OpenStack, capturing instance metadata [daexim-csit-1node-basic-only-calcium] $ /bin/bash /tmp/jenkins4342299550302358414.sh provisioning config files... Could not find credentials [logs] for daexim-csit-1node-basic-only-calcium #75 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/daexim-csit-1node-basic-only-calcium@tmp/config12474388936953492308tmp Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] Run condition [Regular expression match] enabling perform for step [Provide Configuration files] provisioning config files... copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content SERVER_ID=logs [EnvInject] - Variables injected successfully. [daexim-csit-1node-basic-only-calcium] $ /bin/bash /tmp/jenkins8295892717468130445.sh ---> create-netrc.sh WARN: Log server credential not found. [daexim-csit-1node-basic-only-calcium] $ /bin/bash /tmp/jenkins4715884356932702455.sh ---> python-tools-install.sh Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/daexim-csit-1node-basic-only-calcium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Tss4 from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-Tss4/bin to PATH [daexim-csit-1node-basic-only-calcium] $ /bin/bash /tmp/jenkins13384350034157015187.sh ---> sudo-logs.sh Archiving 'sudo' log.. [daexim-csit-1node-basic-only-calcium] $ /bin/bash /tmp/jenkins12837193171551038172.sh ---> job-cost.sh Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/daexim-csit-1node-basic-only-calcium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Tss4 from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. lftools 0.37.8 requires openstacksdk<1.5.0, but you have openstacksdk 2.0.0 which is incompatible. lf-activate-venv(): INFO: Adding /tmp/venv-Tss4/bin to PATH DEBUG: total: 0.11 INFO: Retrieving Stack Cost... INFO: Retrieving Pricing Info for: v3-standard-2 INFO: Archiving Costs [daexim-csit-1node-basic-only-calcium] $ /bin/bash -l /tmp/jenkins6276894423373044882.sh ---> logs-deploy.sh Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/daexim-csit-1node-basic-only-calcium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Tss4 from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. python-openstackclient 6.4.0 requires openstacksdk>=2.0.0, but you have openstacksdk 1.4.0 which is incompatible. lf-activate-venv(): INFO: Adding /tmp/venv-Tss4/bin to PATH WARNING: Nexus logging server not set INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/daexim-csit-1node-basic-only-calcium/75/ INFO: archiving logs to S3 ---> uname -a: Linux prd-centos8-robot-2c-8g-7613.novalocal 4.18.0-481.el8.x86_64 #1 SMP Tue Mar 21 12:15:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux ---> lscpu: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 1 Socket(s): 2 NUMA node(s): 1 Vendor ID: AuthenticAMD CPU family: 23 Model: 49 Model name: AMD EPYC-Rome Processor Stepping: 0 CPU MHz: 2799.998 BogoMIPS: 5599.99 Virtualization: AMD-V Hypervisor vendor: KVM Virtualization type: full L1d cache: 32K L1i cache: 32K L2 cache: 512K L3 cache: 16384K NUMA node0 CPU(s): 0,1 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities ---> nproc: 2 ---> df -h: Filesystem Size Used Avail Use% Mounted on devtmpfs 3.8G 0 3.8G 0% /dev tmpfs 3.8G 0 3.8G 0% /dev/shm tmpfs 3.8G 17M 3.8G 1% /run tmpfs 3.8G 0 3.8G 0% /sys/fs/cgroup /dev/vda1 40G 8.8G 32G 22% / tmpfs 770M 0 770M 0% /run/user/1001 ---> free -m: total used free shared buff/cache available Mem: 7697 534 5051 19 2111 6866 Swap: 1023 0 1023 ---> ip addr: 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: mtu 1458 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:52:40:33 brd ff:ff:ff:ff:ff:ff altname enp0s3 altname ens3 inet 10.30.171.53/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0 valid_lft 85191sec preferred_lft 85191sec inet6 fe80::f816:3eff:fe52:4033/64 scope link valid_lft forever preferred_lft forever ---> sar -b -r -n DEV: Linux 4.18.0-481.el8.x86_64 (centos-stream-8-robot-64278291-afbc-e085-f936-fd2cda2e4867.noval) 12/13/2023 _x86_64_ (2 CPU) 07:20:38 LINUX RESTART (2 CPU) 07:21:01 AM tps rtps wtps bread/s bwrtn/s 07:22:01 AM 92.65 47.07 45.58 6185.27 36826.51 07:23:01 AM 86.64 12.75 73.89 2192.17 6420.56 07:24:01 AM 95.48 0.63 94.85 28.00 10068.47 07:25:01 AM 21.21 0.05 21.16 1.07 2026.36 07:26:01 AM 0.25 0.00 0.25 0.00 3.78 07:27:01 AM 0.22 0.00 0.22 0.00 2.53 07:28:01 AM 0.23 0.00 0.23 0.00 3.07 07:29:01 AM 0.13 0.00 0.13 0.00 0.92 07:30:01 AM 0.12 0.00 0.12 0.00 1.33 07:31:01 AM 0.20 0.00 0.20 0.00 2.18 07:32:01 AM 0.15 0.00 0.15 0.00 1.98 07:33:01 AM 0.23 0.00 0.23 0.00 3.03 07:34:01 AM 0.17 0.00 0.17 0.00 1.58 07:35:01 AM 0.17 0.05 0.12 0.80 3.18 07:36:01 AM 1.22 0.00 1.22 0.00 28.48 07:37:01 AM 0.13 0.00 0.13 0.00 1.03 07:38:01 AM 0.12 0.00 0.12 0.00 1.05 07:39:01 AM 0.13 0.00 0.13 0.00 0.92 07:40:01 AM 10.86 0.27 10.60 44.66 276.00 Average: 16.33 3.20 13.13 444.87 2930.37 07:21:01 AM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 07:22:01 AM 5851144 7218232 2031184 25.77 2688 1567572 600696 6.73 131040 1650120 24652 07:23:01 AM 5390160 7088740 2492168 31.62 2688 1881696 673952 7.55 183752 1991624 141740 07:24:01 AM 5197036 7046360 2685292 34.07 2688 2025544 682796 7.65 192224 2145172 46948 07:25:01 AM 5193880 7042952 2688448 34.11 2688 2025560 682796 7.65 192244 2148660 8 07:26:01 AM 5193924 7042996 2688404 34.11 2688 2025560 682796 7.65 192244 2149028 4 07:27:01 AM 5193672 7042748 2688656 34.11 2688 2025564 682796 7.65 192244 2149104 12 07:28:01 AM 5193980 7043056 2688348 34.11 2688 2025564 698528 7.82 192244 2149040 8 07:29:01 AM 5194028 7043104 2688300 34.11 2688 2025564 698528 7.82 192244 2149044 4 07:30:01 AM 5193876 7042956 2688452 34.11 2688 2025568 691888 7.75 192244 2149336 16 07:31:01 AM 5193780 7042872 2688548 34.11 2688 2025568 691888 7.75 192244 2149136 8 07:32:01 AM 5194072 7043168 2688256 34.10 2688 2025572 691888 7.75 192244 2149208 12 07:33:01 AM 5193624 7042720 2688704 34.11 2688 2025572 691888 7.75 192244 2149284 4 07:34:01 AM 5193956 7043052 2688372 34.11 2688 2025572 691888 7.75 192244 2149156 4 07:35:01 AM 5191644 7040748 2690684 34.14 2688 2025576 688332 7.71 192244 2151392 24 07:36:01 AM 5190628 7039732 2691700 34.15 2688 2025576 688332 7.71 192244 2152416 4 07:37:01 AM 5191000 7040104 2691328 34.14 2688 2025576 688332 7.71 192244 2152220 4 07:38:01 AM 5191176 7040284 2691152 34.14 2688 2025580 688332 7.71 192244 2152160 4 07:39:01 AM 5191012 7040120 2691316 34.14 2688 2025580 688332 7.71 192244 2152160 4 07:40:01 AM 5195892 7046676 2686436 34.08 2688 2027252 694000 7.77 386808 1953452 200 Average: 5238341 7054243 2643987 33.54 2688 1993980 684105 7.66 198815 2104827 11245 07:21:01 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 07:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:22:01 AM eth0 128.71 75.46 466.12 28.84 0.00 0.00 0.00 0.00 07:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:23:01 AM eth0 145.81 108.73 1143.42 25.37 0.00 0.00 0.00 0.00 07:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:24:01 AM eth0 52.41 41.01 577.13 7.54 0.00 0.00 0.00 0.00 07:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:25:01 AM eth0 3.08 0.28 0.61 0.21 0.00 0.00 0.00 0.00 07:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:26:01 AM eth0 1.57 0.12 0.17 0.01 0.00 0.00 0.00 0.00 07:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:27:01 AM eth0 1.20 0.27 0.22 0.10 0.00 0.00 0.00 0.00 07:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:28:01 AM eth0 6.08 0.42 1.04 0.16 0.00 0.00 0.00 0.00 07:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:29:01 AM eth0 1.37 0.37 0.36 0.14 0.00 0.00 0.00 0.00 07:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:30:01 AM eth0 1.33 0.57 0.59 0.34 0.00 0.00 0.00 0.00 07:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:31:01 AM eth0 0.88 0.37 0.33 0.14 0.00 0.00 0.00 0.00 07:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:32:01 AM eth0 2.18 0.42 0.48 0.18 0.00 0.00 0.00 0.00 07:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:33:01 AM eth0 2.33 0.60 0.65 0.34 0.00 0.00 0.00 0.00 07:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:34:01 AM eth0 2.02 0.40 0.39 0.14 0.00 0.00 0.00 0.00 07:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:35:01 AM eth0 4.27 2.50 2.83 6.93 0.00 0.00 0.00 0.00 07:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:36:01 AM eth0 1.52 1.10 0.71 3.69 0.00 0.00 0.00 0.00 07:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:37:01 AM eth0 0.83 0.48 0.40 0.20 0.00 0.00 0.00 0.00 07:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:38:01 AM eth0 4.92 0.35 0.88 0.14 0.00 0.00 0.00 0.00 07:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:39:01 AM eth0 0.85 0.30 0.28 0.11 0.00 0.00 0.00 0.00 07:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:40:01 AM eth0 17.66 14.70 16.40 7.15 0.00 0.00 0.00 0.00 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 Average: eth0 19.95 13.08 116.47 4.30 0.00 0.00 0.00 0.00 ---> sar -P ALL: Linux 4.18.0-481.el8.x86_64 (centos-stream-8-robot-64278291-afbc-e085-f936-fd2cda2e4867.noval) 12/13/2023 _x86_64_ (2 CPU) 07:20:38 LINUX RESTART (2 CPU) 07:21:01 AM CPU %user %nice %system %iowait %steal %idle 07:22:01 AM all 11.74 0.00 2.37 54.50 0.04 31.35 07:22:01 AM 0 12.27 0.00 2.77 59.16 0.03 25.78 07:22:01 AM 1 11.22 0.00 1.97 49.85 0.05 36.91 07:23:01 AM all 36.35 0.00 4.11 3.71 0.12 55.72 07:23:01 AM 0 30.82 0.00 3.29 3.03 0.12 62.74 07:23:01 AM 1 41.89 0.00 4.92 4.40 0.12 48.67 07:24:01 AM all 32.15 0.00 2.93 4.95 0.09 59.88 07:24:01 AM 0 37.70 0.00 3.17 3.84 0.10 55.19 07:24:01 AM 1 26.63 0.00 2.69 6.05 0.08 64.55 07:25:01 AM all 0.40 0.00 0.18 0.87 0.03 98.51 07:25:01 AM 0 0.20 0.00 0.23 0.94 0.03 98.60 07:25:01 AM 1 0.60 0.00 0.13 0.80 0.03 98.43 07:26:01 AM all 0.34 0.00 0.09 0.00 0.02 99.55 07:26:01 AM 0 0.17 0.00 0.12 0.00 0.03 99.68 07:26:01 AM 1 0.52 0.00 0.07 0.00 0.00 99.42 07:27:01 AM all 0.31 0.00 0.06 0.00 0.03 99.60 07:27:01 AM 0 0.13 0.00 0.05 0.00 0.03 99.78 07:27:01 AM 1 0.48 0.00 0.07 0.00 0.03 99.42 07:28:01 AM all 0.38 0.00 0.06 0.00 0.03 99.54 07:28:01 AM 0 0.20 0.00 0.08 0.00 0.03 99.68 07:28:01 AM 1 0.55 0.00 0.03 0.00 0.02 99.40 07:29:01 AM all 0.41 0.00 0.05 0.00 0.03 99.52 07:29:01 AM 0 0.23 0.00 0.07 0.00 0.03 99.67 07:29:01 AM 1 0.58 0.00 0.03 0.00 0.02 99.37 07:30:01 AM all 0.48 0.00 0.06 0.00 0.02 99.44 07:30:01 AM 0 0.68 0.00 0.07 0.00 0.03 99.22 07:30:01 AM 1 0.28 0.00 0.05 0.00 0.00 99.67 07:31:01 AM all 0.39 0.00 0.06 0.00 0.03 99.52 07:31:01 AM 0 0.58 0.00 0.08 0.00 0.05 99.28 07:31:01 AM 1 0.20 0.00 0.03 0.00 0.02 99.75 07:32:01 AM all 0.28 0.00 0.05 0.00 0.02 99.65 07:32:01 AM 0 0.37 0.00 0.07 0.00 0.03 99.53 07:32:01 AM 1 0.20 0.00 0.03 0.00 0.00 99.77 07:32:01 AM CPU %user %nice %system %iowait %steal %idle 07:33:01 AM all 0.43 0.00 0.04 0.00 0.03 99.50 07:33:01 AM 0 0.68 0.00 0.03 0.00 0.03 99.25 07:33:01 AM 1 0.18 0.00 0.05 0.00 0.02 99.75 07:34:01 AM all 0.39 0.00 0.05 0.00 0.03 99.53 07:34:01 AM 0 0.62 0.00 0.05 0.00 0.02 99.32 07:34:01 AM 1 0.17 0.00 0.05 0.00 0.03 99.75 07:35:01 AM all 0.46 0.00 0.14 0.00 0.03 99.37 07:35:01 AM 0 0.65 0.00 0.15 0.00 0.03 99.17 07:35:01 AM 1 0.27 0.00 0.13 0.00 0.02 99.58 07:36:01 AM all 0.53 0.00 0.06 0.01 0.03 99.37 07:36:01 AM 0 0.28 0.00 0.03 0.02 0.03 99.63 07:36:01 AM 1 0.78 0.00 0.08 0.00 0.03 99.10 07:37:01 AM all 0.39 0.00 0.06 0.00 0.02 99.53 07:37:01 AM 0 0.15 0.00 0.05 0.00 0.02 99.78 07:37:01 AM 1 0.63 0.00 0.07 0.00 0.02 99.28 07:38:01 AM all 0.41 0.00 0.06 0.00 0.04 99.49 07:38:01 AM 0 0.10 0.00 0.07 0.00 0.05 99.78 07:38:01 AM 1 0.72 0.00 0.05 0.00 0.03 99.20 07:39:01 AM all 0.38 0.00 0.06 0.00 0.03 99.54 07:39:01 AM 0 0.10 0.00 0.07 0.00 0.03 99.80 07:39:01 AM 1 0.65 0.00 0.05 0.00 0.02 99.28 07:40:01 AM all 17.35 0.00 1.00 0.23 0.06 81.37 07:40:01 AM 0 10.36 0.00 0.94 0.33 0.05 88.32 07:40:01 AM 1 24.32 0.00 1.07 0.12 0.07 74.43 Average: all 5.46 0.00 0.60 3.37 0.04 90.53 Average: 0 5.08 0.00 0.60 3.53 0.04 90.75 Average: 1 5.84 0.00 0.61 3.22 0.03 90.30