Started by upstream project "integration-distribution-mri-test-potassium" build number 25 originally caused by: Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on prd-centos8-robot-2c-8g-14243 (centos8-robot-2c-8g) in workspace /w/workspace/netconf-csit-1node-scale-max-devices-only-master [ssh-agent] Looking for ssh-agent implementation... [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) $ ssh-agent SSH_AUTH_SOCK=/tmp/ssh-w67yUruTfqG1/agent.5341 SSH_AGENT_PID=5342 [ssh-agent] Started. Running ssh-add (command line suppressed) Identity added: /w/workspace/netconf-csit-1node-scale-max-devices-only-master@tmp/private_key_13734471891090912435.key (/w/workspace/netconf-csit-1node-scale-max-devices-only-master@tmp/private_key_13734471891090912435.key) [ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key) The recommended git tool is: NONE using credential opendaylight-jenkins-ssh Wiping out workspace first. Cloning the remote Git repository Cloning repository git://devvexx.opendaylight.org/mirror/integration/test > git init /w/workspace/netconf-csit-1node-scale-max-devices-only-master/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test > git --version # timeout=10 > git --version # 'git version 2.39.3' using GIT_SSH to set credentials Release Engineering Jenkins Key [INFO] Currently running in a labeled security context [INFO] Currently SELinux is 'enforcing' on the host > /usr/bin/chcon --type=ssh_home_t /w/workspace/netconf-csit-1node-scale-max-devices-only-master/test@tmp/jenkins-gitclient-ssh9994163855308337032.key Verifying host key using known hosts file You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Configure Global Security' -> 'Git Host Key Verification Configuration' and configure host key verification. > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test using GIT_SSH to set credentials Release Engineering Jenkins Key [INFO] Currently running in a labeled security context [INFO] Currently SELinux is 'enforcing' on the host > /usr/bin/chcon --type=ssh_home_t /w/workspace/netconf-csit-1node-scale-max-devices-only-master/test@tmp/jenkins-gitclient-ssh8030528719387660662.key Verifying host key using known hosts file You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Configure Global Security' -> 'Git Host Key Verification Configuration' and configure host key verification. > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10 > git rev-parse FETCH_HEAD^{commit} # timeout=10 Checking out Revision 6ab2d076771165554025486bce4dc059473c79f5 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 6ab2d076771165554025486bce4dc059473c79f5 # timeout=10 Commit message: "Run gitlint with tox" > git rev-parse FETCH_HEAD^{commit} # timeout=10 > git rev-list --no-walk ff1bb51a8a14f89ceefd91c6fc535a4bce78e0de # timeout=10 No emails were triggered. provisioning config files... copy managed file [npmrc] to file:/home/jenkins/.npmrc copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [netconf-csit-1node-scale-max-devices-only-master] $ /bin/bash /tmp/jenkins13196041887106786382.sh ---> python-tools-install.sh Setup pyenv: system * 3.8.13 (set by /opt/pyenv/version) * 3.9.13 (set by /opt/pyenv/version) * 3.10.6 (set by /opt/pyenv/version) lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-YfJy lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-YfJy/bin to PATH Generating Requirements File Python 3.10.6 pip 23.3.2 from /tmp/venv-YfJy/lib/python3.10/site-packages/pip (python 3.10) appdirs==1.4.4 argcomplete==3.2.1 aspy.yaml==1.3.0 attrs==23.2.0 autopage==0.5.2 Babel==2.14.0 beautifulsoup4==4.12.2 boto3==1.34.14 botocore==1.34.14 bs4==0.0.1 cachetools==5.3.2 certifi==2023.11.17 cffi==1.16.0 cfgv==3.4.0 chardet==5.2.0 charset-normalizer==3.3.2 click==8.1.7 cliff==4.4.0 cmd2==2.4.3 cryptography==3.3.2 debtcollector==2.5.0 decorator==5.1.1 defusedxml==0.7.1 Deprecated==1.2.14 distlib==0.3.8 dnspython==2.4.2 docker==4.2.2 dogpile.cache==1.3.0 email-validator==2.1.0.post1 filelock==3.13.1 future==0.18.3 gitdb==4.0.11 GitPython==3.1.40 google-auth==2.26.1 httplib2==0.22.0 identify==2.5.33 idna==3.6 importlib-metadata==7.0.1 importlib-resources==1.5.0 iso8601==2.1.0 Jinja2==3.1.2 jmespath==1.0.1 jsonpatch==1.33 jsonpointer==2.4 jsonschema==4.20.0 jsonschema-specifications==2023.12.1 keystoneauth1==5.4.0 kubernetes==28.1.0 lftools==0.37.8 lxml==5.0.1 MarkupSafe==2.1.3 msgpack==1.0.7 multi_key_dict==2.0.3 munch==4.0.0 netaddr==0.10.1 netifaces==0.11.0 niet==1.4.2 nodeenv==1.8.0 oauth2client==4.1.3 oauthlib==3.2.2 openstacksdk==0.62.0 os-client-config==2.1.0 os-service-types==1.7.0 osc-lib==2.9.0 oslo.config==9.2.0 oslo.context==5.3.0 oslo.i18n==6.2.0 oslo.log==5.4.0 oslo.serialization==5.2.0 oslo.utils==6.3.0 packaging==23.2 pbr==6.0.0 platformdirs==4.1.0 prettytable==3.9.0 pyasn1==0.5.1 pyasn1-modules==0.3.0 pycparser==2.21 pygerrit2==2.0.15 PyGithub==2.1.1 pyinotify==0.9.6 PyJWT==2.8.0 PyNaCl==1.5.0 pyparsing==2.4.7 pyperclip==1.8.2 pyrsistent==0.20.0 python-cinderclient==9.4.0 python-dateutil==2.8.2 python-heatclient==3.3.0 python-jenkins==1.8.2 python-keystoneclient==5.2.0 python-magnumclient==4.3.0 python-novaclient==18.4.0 python-openstackclient==6.0.0 python-swiftclient==4.4.0 pytz==2023.3.post1 PyYAML==6.0.1 referencing==0.32.1 requests==2.31.0 requests-oauthlib==1.3.1 requestsexceptions==1.4.0 rfc3986==2.0.0 rpds-py==0.16.2 rsa==4.9 ruamel.yaml==0.18.5 ruamel.yaml.clib==0.2.8 s3transfer==0.10.0 simplejson==3.19.2 six==1.16.0 smmap==5.0.1 soupsieve==2.5 stevedore==5.1.0 tabulate==0.9.0 toml==0.10.2 tomlkit==0.12.3 tqdm==4.66.1 typing_extensions==4.9.0 tzdata==2023.4 urllib3==1.26.18 virtualenv==20.25.0 wcwidth==0.2.13 websocket-client==1.7.0 wrapt==1.16.0 xdg==6.0.0 xmltodict==0.13.0 yq==3.2.3 zipp==3.17.0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_STACK_TEMPLATE=csit-2-instance-type.yaml OS_CLOUD=vex OS_STACK_NAME=releng-netconf-csit-1node-scale-max-devices-only-master-316 OS_STACK_TEMPLATE_DIR=openstack-hot [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [netconf-csit-1node-scale-max-devices-only-master] $ /bin/bash /tmp/jenkins16597829144490413071.sh ---> Create parameters file for OpenStack HOT OpenStack Heat parameters generated ----------------------------------- parameters: vm_0_count: '1' vm_0_flavor: 'odl-standard-8' vm_0_image: 'ZZCI - CentOS Stream 8 - builder - x86_64 - 20230727-135233.501' vm_1_count: '1' vm_1_flavor: 'odl-standard-8' vm_1_image: 'ZZCI - Ubuntu 18.04 - mininet-ovs-28 - x86_64 - 20230501-180106.320' job_name: '61673-316' silo: 'releng' [netconf-csit-1node-scale-max-devices-only-master] $ /bin/bash -l /tmp/jenkins5634504440173599931.sh ---> Create HEAT stack + source /home/jenkins/lf-env.sh + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ++ mktemp -d /tmp/venv-XXXX + lf_venv=/tmp/venv-OCvt + local venv_file=/tmp/.os_lf_venv + local python=python3 + local options + local set_path=true + local install_args= ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\''' + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\''' ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + true + case $1 in + python=python3 + shift 2 + true + case $1 in + shift + break + case $python in + local pkg_list= + [[ -d /opt/pyenv ]] + echo 'Setup pyenv:' Setup pyenv: + export PYENV_ROOT=/opt/pyenv + PYENV_ROOT=/opt/pyenv + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + pyenv versions system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/netconf-csit-1node-scale-max-devices-only-master/.python-version) + command -v pyenv ++ pyenv init - --no-rehash + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "'\''/opt/pyenv/shims'\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; fi; done; echo "${paths[*]}"'\'')" export PATH="/opt/pyenv/shims:${PATH}" export PYENV_SHELL=bash source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\'' pyenv() { local command command="${1:-}" if [ "$#" -gt 0 ]; then shift fi case "$command" in rehash|shell) eval "$(pyenv "sh-$command" "$@")" ;; *) command pyenv "$command" "$@" ;; esac }' +++ bash --norc -ec 'IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; fi; done; echo "${paths[*]}"' ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ export PYENV_SHELL=bash ++ PYENV_SHELL=bash ++ source /opt/pyenv/libexec/../completions/pyenv.bash +++ complete -F _pyenv pyenv ++ lf-pyver python3 ++ local py_version_xy=python3 ++ local py_version_xyz= ++ awk '{ print $1 }' ++ pyenv versions ++ local command ++ command=versions ++ '[' 1 -gt 0 ']' ++ shift ++ case "$command" in ++ command pyenv versions ++ pyenv versions ++ sed 's/^[ *]* //' ++ grep -E '^[0-9.]*[0-9]$' ++ [[ ! -s /tmp/.pyenv_versions ]] +++ grep '^3' /tmp/.pyenv_versions +++ sort -V +++ tail -n 1 ++ py_version_xyz=3.10.6 ++ [[ -z 3.10.6 ]] ++ echo 3.10.6 ++ return 0 + pyenv local 3.10.6 + local command + command=local + '[' 2 -gt 0 ']' + shift + case "$command" in + command pyenv local 3.10.6 + pyenv local 3.10.6 + for arg in "$@" + case $arg in + pkg_list+='lftools[openstack] ' + for arg in "$@" + case $arg in + pkg_list+='kubernetes ' + for arg in "$@" + case $arg in + pkg_list+='niet ' + for arg in "$@" + case $arg in + pkg_list+='python-heatclient ' + for arg in "$@" + case $arg in + pkg_list+='python-openstackclient ' + for arg in "$@" + case $arg in + pkg_list+='python-magnumclient ' + for arg in "$@" + case $arg in + pkg_list+='yq ' + [[ -f /tmp/.os_lf_venv ]] ++ cat /tmp/.os_lf_venv + lf_venv=/tmp/venv-YfJy + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-YfJy from' file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Reuse venv:/tmp/venv-YfJy from file:/tmp/.os_lf_venv + /tmp/venv-YfJy/bin/python3 -m pip install --upgrade --quiet pip virtualenv + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ]] + echo 'lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ' lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + /tmp/venv-YfJy/bin/python3 -m pip install --upgrade --quiet --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + type python3 + true + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-YfJy/bin to PATH' lf-activate-venv(): INFO: Adding /tmp/venv-YfJy/bin to PATH + PATH=/tmp/venv-YfJy/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + return 0 + openstack --os-cloud vex limits show --absolute +--------------------------+---------+ | Name | Value | +--------------------------+---------+ | maxTotalInstances | -1 | | maxTotalCores | 450 | | maxTotalRAMSize | 1000000 | | maxServerMeta | 128 | | maxImageMeta | 128 | | maxPersonality | 5 | | maxPersonalitySize | 10240 | | maxTotalKeypairs | 100 | | maxServerGroups | 10 | | maxServerGroupMembers | 10 | | maxTotalFloatingIps | -1 | | maxSecurityGroups | -1 | | maxSecurityGroupRules | -1 | | totalRAMUsed | 753664 | | totalCoresUsed | 184 | | totalInstancesUsed | 59 | | totalFloatingIpsUsed | 0 | | totalSecurityGroupsUsed | 0 | | totalServerGroupsUsed | 0 | | maxTotalVolumes | -1 | | maxTotalSnapshots | 10 | | maxTotalVolumeGigabytes | 4096 | | maxTotalBackups | 10 | | maxTotalBackupGigabytes | 1000 | | totalVolumesUsed | 0 | | totalGigabytesUsed | 0 | | totalSnapshotsUsed | 0 | | totalBackupsUsed | 0 | | totalBackupGigabytesUsed | 0 | +--------------------------+---------+ + pushd /opt/ciman/openstack-hot /opt/ciman/openstack-hot /w/workspace/netconf-csit-1node-scale-max-devices-only-master + lftools openstack --os-cloud vex stack create releng-netconf-csit-1node-scale-max-devices-only-master-316 csit-2-instance-type.yaml /w/workspace/netconf-csit-1node-scale-max-devices-only-master/stack-parameters.yaml Creating stack releng-netconf-csit-1node-scale-max-devices-only-master-316 Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... WARN: Failed to initialize stack. Reason: Timed out TypeError: delete() missing 1 required positional argument: 'force' Build step 'Execute shell' marked build as failure $ ssh-agent -k unset SSH_AUTH_SOCK; unset SSH_AGENT_PID; echo Agent pid 5342 killed; [ssh-agent] Stopped. Recording plot data Robot results publisher started... -Parsing output xml: Failed! hudson.AbortException: No files found in path /w/workspace/netconf-csit-1node-scale-max-devices-only-master with configured filemask: output.xml at hudson.plugins.robot.RobotParser$RobotParserCallable.invoke(RobotParser.java:76) at hudson.plugins.robot.RobotParser$RobotParserCallable.invoke(RobotParser.java:52) at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3578) at hudson.remoting.UserRequest.perform(UserRequest.java:211) at hudson.remoting.UserRequest.perform(UserRequest.java:54) at hudson.remoting.Request$2.run(Request.java:377) at hudson.remoting.InterceptingExecutorService.lambda$wrap$0(InterceptingExecutorService.java:78) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:829) Suppressed: hudson.remoting.Channel$CallSiteStackTrace: Remote call to prd-centos8-robot-2c-8g-14243 at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1787) at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:356) at hudson.remoting.Channel.call(Channel.java:1003) at hudson.FilePath.act(FilePath.java:1192) at hudson.FilePath.act(FilePath.java:1181) at hudson.plugins.robot.RobotParser.parse(RobotParser.java:48) at hudson.plugins.robot.RobotPublisher.parse(RobotPublisher.java:246) at hudson.plugins.robot.RobotPublisher.perform(RobotPublisher.java:267) at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:80) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:818) at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:767) at hudson.model.Build$BuildExecution.post2(Build.java:179) at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:711) at hudson.model.Run.execute(Run.java:1918) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44) at hudson.model.ResourceController.execute(ResourceController.java:101) at hudson.model.Executor.run(Executor.java:442) [PostBuildScript] - [INFO] Executing post build scripts. [netconf-csit-1node-scale-max-devices-only-master] $ /bin/bash /tmp/jenkins11771798910690718850.sh Archiving csit artifacts mv: cannot stat 'odl1_*': No such file or directory mv: cannot stat 'karaf_1_*_threads*': No such file or directory mv: cannot stat '*_1.png': No such file or directory mv: cannot stat '/tmp/odl1_*': No such file or directory mv: cannot stat 'gclogs-1': No such file or directory % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 188 0 188 0 0 1492 0 --:--:-- --:--:-- --:--:-- 1492 Archive: robot-plugin.zip End-of-central-directory signature not found. Either this file is not a zipfile, or it constitutes one disk of a multi-part archive. In the latter case the central directory and zipfile comment will be found on the last disk(s) of this archive. unzip: cannot find zipfile directory in one of robot-plugin.zip or robot-plugin.zip.zip, and cannot find robot-plugin.zip.ZIP, period. mv: cannot stat '*.log': No such file or directory mv: cannot stat '*.log.gz': No such file or directory mv: cannot stat '*.csv': No such file or directory mv: cannot stat '*.png': No such file or directory [PostBuildScript] - [INFO] Executing post build scripts. [netconf-csit-1node-scale-max-devices-only-master] $ /bin/bash /tmp/jenkins3154317851815770570.sh [PostBuildScript] - [INFO] Executing post build scripts. [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_CLOUD=vex OS_STACK_NAME=releng-netconf-csit-1node-scale-max-devices-only-master-316 [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [netconf-csit-1node-scale-max-devices-only-master] $ /bin/bash /tmp/jenkins11879570102103195400.sh ---> openstack-stack-delete.sh Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/netconf-csit-1node-scale-max-devices-only-master/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-YfJy from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient lf-activate-venv(): INFO: Adding /tmp/venv-YfJy/bin to PATH INFO: Retrieving stack cost for: releng-netconf-csit-1node-scale-max-devices-only-master-316 DEBUG: Successfully retrieved stack cost: total: 0.78 INFO: Deleting stack releng-netconf-csit-1node-scale-max-devices-only-master-316 Successfully deleted stack releng-netconf-csit-1node-scale-max-devices-only-master-316 [PostBuildScript] - [INFO] Executing post build scripts. [netconf-csit-1node-scale-max-devices-only-master] $ /bin/bash /tmp/jenkins11040862410074709833.sh ---> sysstat.sh [netconf-csit-1node-scale-max-devices-only-master] $ /bin/bash /tmp/jenkins423276089288535496.sh ---> package-listing.sh ++ facter osfamily ++ tr '[:upper:]' '[:lower:]' + OS_FAMILY=redhat + workspace=/w/workspace/netconf-csit-1node-scale-max-devices-only-master + START_PACKAGES=/tmp/packages_start.txt + END_PACKAGES=/tmp/packages_end.txt + DIFF_PACKAGES=/tmp/packages_diff.txt + PACKAGES=/tmp/packages_start.txt + '[' /w/workspace/netconf-csit-1node-scale-max-devices-only-master ']' + PACKAGES=/tmp/packages_end.txt + case "${OS_FAMILY}" in + sort + rpm -qa + '[' -f /tmp/packages_start.txt ']' + '[' -f /tmp/packages_end.txt ']' + diff /tmp/packages_start.txt /tmp/packages_end.txt + '[' /w/workspace/netconf-csit-1node-scale-max-devices-only-master ']' + mkdir -p /w/workspace/netconf-csit-1node-scale-max-devices-only-master/archives/ + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/netconf-csit-1node-scale-max-devices-only-master/archives/ [netconf-csit-1node-scale-max-devices-only-master] $ /bin/bash /tmp/jenkins4679439649829737708.sh ---> capture-instance-metadata.sh Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/netconf-csit-1node-scale-max-devices-only-master/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-YfJy from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-YfJy/bin to PATH INFO: Running in OpenStack, capturing instance metadata [netconf-csit-1node-scale-max-devices-only-master] $ /bin/bash /tmp/jenkins404835879423926838.sh provisioning config files... Could not find credentials [logs] for netconf-csit-1node-scale-max-devices-only-master #316 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/netconf-csit-1node-scale-max-devices-only-master@tmp/config6990670265227324717tmp Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] Run condition [Regular expression match] enabling perform for step [Provide Configuration files] provisioning config files... copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content SERVER_ID=logs [EnvInject] - Variables injected successfully. [netconf-csit-1node-scale-max-devices-only-master] $ /bin/bash /tmp/jenkins18363400132757018684.sh ---> create-netrc.sh WARN: Log server credential not found. [netconf-csit-1node-scale-max-devices-only-master] $ /bin/bash /tmp/jenkins529444769179407371.sh ---> python-tools-install.sh Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/netconf-csit-1node-scale-max-devices-only-master/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-YfJy from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-YfJy/bin to PATH [netconf-csit-1node-scale-max-devices-only-master] $ /bin/bash /tmp/jenkins9292649122553176438.sh ---> sudo-logs.sh Archiving 'sudo' log.. [netconf-csit-1node-scale-max-devices-only-master] $ /bin/bash /tmp/jenkins12099548220194271546.sh ---> job-cost.sh Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/netconf-csit-1node-scale-max-devices-only-master/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-YfJy from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. lftools 0.37.8 requires openstacksdk<1.5.0, but you have openstacksdk 2.0.0 which is incompatible. lf-activate-venv(): INFO: Adding /tmp/venv-YfJy/bin to PATH DEBUG: total: 0.78 INFO: Retrieving Stack Cost... INFO: Retrieving Pricing Info for: v3-standard-2 INFO: Archiving Costs [netconf-csit-1node-scale-max-devices-only-master] $ /bin/bash -l /tmp/jenkins5327874148979855878.sh ---> logs-deploy.sh Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/netconf-csit-1node-scale-max-devices-only-master/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-YfJy from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. python-openstackclient 6.4.0 requires openstacksdk>=2.0.0, but you have openstacksdk 1.4.0 which is incompatible. lf-activate-venv(): INFO: Adding /tmp/venv-YfJy/bin to PATH WARNING: Nexus logging server not set INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/netconf-csit-1node-scale-max-devices-only-master/316/ INFO: archiving logs to S3 ---> uname -a: Linux prd-centos8-robot-2c-8g-14243.novalocal 4.18.0-527.el8.x86_64 #1 SMP Thu Nov 23 14:16:19 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux ---> lscpu: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 1 Socket(s): 2 NUMA node(s): 1 Vendor ID: AuthenticAMD CPU family: 23 Model: 49 Model name: AMD EPYC-Rome Processor Stepping: 0 CPU MHz: 2799.998 BogoMIPS: 5599.99 Virtualization: AMD-V Hypervisor vendor: KVM Virtualization type: full L1d cache: 32K L1i cache: 32K L2 cache: 512K L3 cache: 16384K NUMA node0 CPU(s): 0,1 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities ---> nproc: 2 ---> df -h: Filesystem Size Used Avail Use% Mounted on devtmpfs 3.8G 0 3.8G 0% /dev tmpfs 3.8G 0 3.8G 0% /dev/shm tmpfs 3.8G 17M 3.8G 1% /run tmpfs 3.8G 0 3.8G 0% /sys/fs/cgroup /dev/vda1 40G 9.4G 31G 24% / tmpfs 770M 0 770M 0% /run/user/1001 ---> free -m: total used free shared buff/cache available Mem: 7697 550 5024 19 2122 6849 Swap: 1023 0 1023 ---> ip addr: 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: mtu 1458 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:c8:a7:d3 brd ff:ff:ff:ff:ff:ff altname enp0s3 altname ens3 inet 10.30.170.38/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0 valid_lft 85232sec preferred_lft 85232sec inet6 fe80::f816:3eff:fec8:a7d3/64 scope link valid_lft forever preferred_lft forever ---> sar -b -r -n DEV: Linux 4.18.0-527.el8.x86_64 (centos-stream-8-robot-fae2b486-4aa0-48b5-8561-0bd1156c3383.noval) 01/07/2024 _x86_64_ (2 CPU) 02:02:29 LINUX RESTART (2 CPU) 02:03:03 AM tps rtps wtps bread/s bwrtn/s 02:04:01 AM 81.37 18.63 62.74 3912.46 31632.00 02:05:01 AM 116.54 6.61 109.93 1269.44 9594.65 02:06:01 AM 42.18 0.60 41.58 26.80 5354.02 02:07:01 AM 5.02 0.00 5.02 0.00 203.88 02:08:01 AM 0.35 0.00 0.35 0.00 3.57 02:09:01 AM 0.42 0.00 0.42 0.00 4.90 02:10:01 AM 0.35 0.00 0.35 0.00 3.18 02:11:01 AM 0.30 0.00 0.30 0.00 2.55 02:12:01 AM 0.35 0.00 0.35 0.00 4.25 02:13:01 AM 0.35 0.00 0.35 0.00 3.55 02:14:01 AM 0.52 0.00 0.52 0.00 6.80 02:15:01 AM 0.27 0.00 0.27 0.00 2.10 02:16:01 AM 0.35 0.00 0.35 0.00 3.87 02:17:01 AM 0.17 0.00 0.17 0.00 2.11 02:18:01 AM 0.13 0.03 0.10 0.27 0.63 02:19:01 AM 1.23 0.00 1.23 0.00 28.79 02:20:01 AM 0.18 0.00 0.18 0.00 2.42 02:21:01 AM 9.16 0.27 8.90 44.64 245.16 02:22:01 AM 22.09 0.55 21.54 69.71 642.55 Average: 14.69 1.37 13.32 273.83 2461.80 02:03:03 AM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 02:04:01 AM 5463288 7046332 2419176 30.69 2688 1774840 718012 8.04 165732 1966800 99264 02:05:01 AM 5149532 7022344 2732932 34.67 2688 2048760 696024 7.79 188656 2196720 141980 02:06:01 AM 5163684 7023460 2718780 34.49 2688 2036176 688680 7.71 195272 2170568 4 02:07:01 AM 5166072 7025848 2716392 34.46 2688 2036176 688680 7.71 195272 2170620 12 02:08:01 AM 5166260 7026036 2716204 34.46 2688 2036176 688680 7.71 195272 2170632 4 02:09:01 AM 5166284 7026064 2716180 34.46 2688 2036180 688680 7.71 195272 2170708 4 02:10:01 AM 5166260 7026032 2716204 34.46 2688 2036180 707560 7.92 195272 2170876 4 02:11:01 AM 5166404 7026196 2716060 34.46 2688 2036188 707560 7.92 195272 2170680 4 02:12:01 AM 5166196 7025988 2716268 34.46 2688 2036188 707560 7.92 195272 2171000 4 02:13:01 AM 5166036 7025828 2716428 34.46 2688 2036188 707560 7.92 195272 2171036 4 02:14:01 AM 5165288 7025084 2717176 34.47 2688 2036192 707560 7.92 195272 2171844 4 02:15:01 AM 5165696 7025492 2716768 34.47 2688 2036192 707560 7.92 195272 2171576 4 02:16:01 AM 5165664 7025460 2716800 34.47 2688 2036192 707560 7.92 195272 2171576 4 02:17:01 AM 5165756 7025556 2716708 34.47 2688 2036196 707560 7.92 195272 2171464 4 02:18:01 AM 5165536 7025356 2716928 34.47 2688 2036200 707560 7.92 195272 2171604 16 02:19:01 AM 5165620 7025440 2716844 34.47 2688 2036200 707560 7.92 195272 2171672 8 02:20:01 AM 5165272 7025096 2717192 34.47 2688 2036204 698460 7.82 195272 2171724 8 02:21:01 AM 5192284 7053788 2690180 34.13 2688 2037872 659724 7.39 397744 1943168 204 02:22:01 AM 5112280 6981236 2770184 35.14 2688 2043924 722660 8.09 398180 2021240 27388 Average: 5179127 7025612 2703337 34.30 2688 2023591 701326 7.85 214705 2141869 14154 02:03:03 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 02:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:04:01 AM eth0 333.24 195.61 1572.97 56.21 0.00 0.00 0.00 0.00 02:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:05:01 AM eth0 60.00 47.28 666.73 7.88 0.00 0.00 0.00 0.00 02:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:06:01 AM eth0 6.45 3.33 3.13 1.34 0.00 0.00 0.00 0.00 02:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:07:01 AM eth0 1.43 0.37 0.33 0.12 0.00 0.00 0.00 0.00 02:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:08:01 AM eth0 0.87 0.35 0.34 0.14 0.00 0.00 0.00 0.00 02:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:09:01 AM eth0 0.82 0.42 0.40 0.20 0.00 0.00 0.00 0.00 02:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:10:01 AM eth0 0.90 0.37 0.34 0.14 0.00 0.00 0.00 0.00 02:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:11:01 AM eth0 1.37 0.35 0.39 0.14 0.00 0.00 0.00 0.00 02:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:12:01 AM eth0 4.95 1.25 5.31 0.38 0.00 0.00 0.00 0.00 02:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:13:01 AM eth0 2.48 0.47 0.60 0.21 0.00 0.00 0.00 0.00 02:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:14:01 AM eth0 2.25 1.08 1.32 0.83 0.00 0.00 0.00 0.00 02:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:15:01 AM eth0 0.77 0.38 0.33 0.14 0.00 0.00 0.00 0.00 02:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:16:01 AM eth0 1.25 0.40 0.44 0.14 0.00 0.00 0.00 0.00 02:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:17:01 AM eth0 4.55 0.37 0.84 0.14 0.00 0.00 0.00 0.00 02:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:18:01 AM eth0 1.13 0.40 0.35 0.14 0.00 0.00 0.00 0.00 02:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:19:01 AM eth0 1.30 0.43 0.47 0.20 0.00 0.00 0.00 0.00 02:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:20:01 AM eth0 0.82 0.38 0.33 0.14 0.00 0.00 0.00 0.00 02:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:21:01 AM eth0 19.52 14.71 16.14 16.52 0.00 0.00 0.00 0.00 02:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:22:01 AM eth0 17.51 15.93 38.85 7.20 0.00 0.00 0.00 0.00 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 Average: eth0 23.76 14.63 119.03 4.76 0.00 0.00 0.00 0.00 ---> sar -P ALL: Linux 4.18.0-527.el8.x86_64 (centos-stream-8-robot-fae2b486-4aa0-48b5-8561-0bd1156c3383.noval) 01/07/2024 _x86_64_ (2 CPU) 02:02:29 LINUX RESTART (2 CPU) 02:03:03 AM CPU %user %nice %system %iowait %steal %idle 02:04:01 AM all 29.99 0.00 5.14 16.15 0.10 48.63 02:04:01 AM 0 23.35 0.00 4.11 10.73 0.09 61.73 02:04:01 AM 1 36.63 0.00 6.16 21.57 0.10 35.54 02:05:01 AM all 36.32 0.00 5.65 3.55 0.09 54.38 02:05:01 AM 0 22.56 0.00 4.26 3.16 0.10 69.91 02:05:01 AM 1 50.08 0.00 7.04 3.95 0.08 38.86 02:06:01 AM all 10.13 0.00 1.34 1.39 0.06 87.09 02:06:01 AM 0 16.00 0.00 1.49 0.94 0.07 81.51 02:06:01 AM 1 4.27 0.00 1.18 1.83 0.05 92.66 02:07:01 AM all 0.40 0.00 0.08 0.08 0.03 99.41 02:07:01 AM 0 0.60 0.00 0.07 0.00 0.03 99.30 02:07:01 AM 1 0.20 0.00 0.10 0.17 0.02 99.52 02:08:01 AM all 0.40 0.00 0.06 0.00 0.03 99.51 02:08:01 AM 0 0.58 0.00 0.07 0.00 0.03 99.32 02:08:01 AM 1 0.22 0.00 0.05 0.00 0.03 99.70 02:09:01 AM all 0.41 0.00 0.04 0.00 0.03 99.52 02:09:01 AM 0 0.60 0.00 0.05 0.00 0.03 99.32 02:09:01 AM 1 0.22 0.00 0.03 0.00 0.02 99.73 02:10:01 AM all 0.26 0.00 0.09 0.00 0.05 99.60 02:10:01 AM 0 0.35 0.00 0.12 0.00 0.07 99.47 02:10:01 AM 1 0.17 0.00 0.07 0.00 0.03 99.73 02:11:01 AM all 0.31 0.00 0.08 0.00 0.03 99.57 02:11:01 AM 0 0.52 0.00 0.07 0.00 0.02 99.40 02:11:01 AM 1 0.10 0.00 0.10 0.00 0.05 99.75 02:12:01 AM all 0.49 0.00 0.10 0.00 0.03 99.37 02:12:01 AM 0 0.82 0.00 0.07 0.00 0.03 99.08 02:12:01 AM 1 0.17 0.00 0.13 0.00 0.03 99.67 02:13:01 AM all 0.31 0.00 0.08 0.00 0.04 99.57 02:13:01 AM 0 0.52 0.00 0.05 0.00 0.03 99.40 02:13:01 AM 1 0.10 0.00 0.10 0.00 0.05 99.75 02:14:01 AM all 0.36 0.00 0.08 0.01 0.02 99.53 02:14:01 AM 0 0.20 0.00 0.07 0.00 0.00 99.73 02:14:01 AM 1 0.52 0.00 0.10 0.02 0.03 99.33 02:14:01 AM CPU %user %nice %system %iowait %steal %idle 02:15:01 AM all 0.38 0.00 0.06 0.00 0.03 99.54 02:15:01 AM 0 0.27 0.00 0.05 0.00 0.02 99.67 02:15:01 AM 1 0.48 0.00 0.07 0.00 0.03 99.42 02:16:01 AM all 0.41 0.00 0.07 0.00 0.04 99.48 02:16:01 AM 0 0.37 0.00 0.10 0.00 0.05 99.48 02:16:01 AM 1 0.45 0.00 0.03 0.00 0.03 99.48 02:17:01 AM all 0.43 0.00 0.09 0.00 0.03 99.45 02:17:01 AM 0 0.13 0.00 0.10 0.00 0.03 99.73 02:17:01 AM 1 0.72 0.00 0.08 0.00 0.03 99.17 02:18:01 AM all 0.49 0.00 0.18 0.00 0.02 99.31 02:18:01 AM 0 0.58 0.00 0.12 0.00 0.02 99.28 02:18:01 AM 1 0.40 0.00 0.25 0.00 0.02 99.33 02:19:01 AM all 0.52 0.00 0.08 0.01 0.03 99.37 02:19:01 AM 0 0.50 0.00 0.10 0.02 0.03 99.35 02:19:01 AM 1 0.53 0.00 0.05 0.00 0.02 99.40 02:20:01 AM all 0.38 0.00 0.09 0.00 0.03 99.50 02:20:01 AM 0 0.53 0.00 0.10 0.00 0.02 99.35 02:20:01 AM 1 0.23 0.00 0.08 0.00 0.03 99.65 02:21:01 AM all 15.15 0.00 1.34 0.13 0.06 83.33 02:21:01 AM 0 7.91 0.00 1.25 0.15 0.05 90.64 02:21:01 AM 1 22.39 0.00 1.42 0.10 0.07 76.02 02:22:01 AM all 31.95 0.00 2.69 0.55 0.10 64.70 02:22:01 AM 0 28.92 0.00 2.26 0.72 0.10 68.01 02:22:01 AM 1 34.99 0.00 3.13 0.38 0.10 61.39 Average: all 6.74 0.00 0.90 1.12 0.04 91.19 Average: 0 5.50 0.00 0.76 0.81 0.04 92.89 Average: 1 7.98 0.00 1.05 1.43 0.04 89.49