Started by upstream project "integration-distribution-test-titanium" build number 426 originally caused by: Started by upstream project "autorelease-release-vanadium-mvn39-openjdk21" build number 50 originally caused by: Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on prd-centos8-robot-2c-8g-53620 (centos8-robot-2c-8g) in workspace /w/workspace/ovsdb-csit-1node-upstream-southbound-all-titanium [ssh-agent] Looking for ssh-agent implementation... [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) $ ssh-agent SSH_AUTH_SOCK=/tmp/ssh-VIz71etU1yro/agent.5278 SSH_AGENT_PID=5279 [ssh-agent] Started. Running ssh-add (command line suppressed) Identity added: /w/workspace/ovsdb-csit-1node-upstream-southbound-all-titanium@tmp/private_key_4904830526119838770.key (/w/workspace/ovsdb-csit-1node-upstream-southbound-all-titanium@tmp/private_key_4904830526119838770.key) [ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key) The recommended git tool is: NONE using credential opendaylight-jenkins-ssh Wiping out workspace first. Cloning the remote Git repository Cloning repository git://devvexx.opendaylight.org/mirror/integration/test > git init /w/workspace/ovsdb-csit-1node-upstream-southbound-all-titanium/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test > git --version # timeout=10 > git --version # 'git version 2.43.0' using GIT_SSH to set credentials Release Engineering Jenkins Key [INFO] Currently running in a labeled security context [INFO] Currently SELinux is 'enforcing' on the host > /usr/bin/chcon --type=ssh_home_t /w/workspace/ovsdb-csit-1node-upstream-southbound-all-titanium/test@tmp/jenkins-gitclient-ssh4842213794264547842.key Verifying host key using known hosts file You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test using GIT_SSH to set credentials Release Engineering Jenkins Key [INFO] Currently running in a labeled security context [INFO] Currently SELinux is 'enforcing' on the host > /usr/bin/chcon --type=ssh_home_t /w/workspace/ovsdb-csit-1node-upstream-southbound-all-titanium/test@tmp/jenkins-gitclient-ssh11163311920454466361.key Verifying host key using known hosts file You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10 > git rev-parse FETCH_HEAD^{commit} # timeout=10 Checking out Revision 6c60ddfc8acc87c45ab0767b2ba1d2c4e7d34388 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 6c60ddfc8acc87c45ab0767b2ba1d2c4e7d34388 # timeout=10 Commit message: "Adapt test for new pce-allocation field" > git rev-parse FETCH_HEAD^{commit} # timeout=10 > git rev-list --no-walk 62cb016f4f4171033927cf2ae7f4ac5095373e88 # timeout=10 No emails were triggered. provisioning config files... copy managed file [npmrc] to file:/home/jenkins/.npmrc copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [ovsdb-csit-1node-upstream-southbound-all-titanium] $ /bin/bash /tmp/jenkins2996955560893887395.sh ---> python-tools-install.sh Setup pyenv: system * 3.8.13 (set by /opt/pyenv/version) * 3.9.13 (set by /opt/pyenv/version) * 3.10.13 (set by /opt/pyenv/version) * 3.11.7 (set by /opt/pyenv/version) lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-dTcr lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-dTcr/bin to PATH Generating Requirements File ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. httplib2 0.31.0 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible. Python 3.11.7 pip 25.2 from /tmp/venv-dTcr/lib/python3.11/site-packages/pip (python 3.11) appdirs==1.4.4 argcomplete==3.6.2 aspy.yaml==1.3.0 attrs==25.3.0 autopage==0.5.2 beautifulsoup4==4.13.5 boto3==1.40.33 botocore==1.40.33 bs4==0.0.2 cachetools==5.5.2 certifi==2025.8.3 cffi==2.0.0 cfgv==3.4.0 chardet==5.2.0 charset-normalizer==3.4.3 click==8.2.1 cliff==4.11.0 cmd2==2.7.0 cryptography==3.3.2 debtcollector==3.0.0 decorator==5.2.1 defusedxml==0.7.1 Deprecated==1.2.18 distlib==0.4.0 dnspython==2.8.0 docker==7.1.0 dogpile.cache==1.4.1 durationpy==0.10 email-validator==2.3.0 filelock==3.19.1 future==1.0.0 gitdb==4.0.12 GitPython==3.1.45 google-auth==2.40.3 httplib2==0.31.0 identify==2.6.14 idna==3.10 importlib-resources==1.5.0 iso8601==2.1.0 Jinja2==3.1.6 jmespath==1.0.1 jsonpatch==1.33 jsonpointer==3.0.0 jsonschema==4.25.1 jsonschema-specifications==2025.9.1 keystoneauth1==5.12.0 kubernetes==33.1.0 lftools==0.37.13 lxml==6.0.1 markdown-it-py==4.0.0 MarkupSafe==3.0.2 mdurl==0.1.2 msgpack==1.1.1 multi_key_dict==2.0.3 munch==4.0.0 netaddr==1.3.0 niet==1.4.2 nodeenv==1.9.1 oauth2client==4.1.3 oauthlib==3.3.1 openstacksdk==4.7.1 os-service-types==1.8.0 osc-lib==4.2.0 oslo.config==10.0.0 oslo.context==6.1.0 oslo.i18n==6.6.0 oslo.log==7.2.1 oslo.serialization==5.8.0 oslo.utils==9.1.0 packaging==25.0 pbr==7.0.1 platformdirs==4.4.0 prettytable==3.16.0 psutil==7.1.0 pyasn1==0.6.1 pyasn1_modules==0.4.2 pycparser==2.23 pygerrit2==2.0.15 PyGithub==2.8.1 Pygments==2.19.2 PyJWT==2.10.1 PyNaCl==1.6.0 pyparsing==2.4.7 pyperclip==1.9.0 pyrsistent==0.20.0 python-cinderclient==9.8.0 python-dateutil==2.9.0.post0 python-heatclient==4.3.0 python-jenkins==1.8.3 python-keystoneclient==5.7.0 python-magnumclient==4.9.0 python-openstackclient==8.2.0 python-swiftclient==4.8.0 PyYAML==6.0.2 referencing==0.36.2 requests==2.32.5 requests-oauthlib==2.0.0 requestsexceptions==1.4.0 rfc3986==2.0.0 rich==14.1.0 rich-argparse==1.7.1 rpds-py==0.27.1 rsa==4.9.1 ruamel.yaml==0.18.15 ruamel.yaml.clib==0.2.12 s3transfer==0.14.0 simplejson==3.20.1 six==1.17.0 smmap==5.0.2 soupsieve==2.8 stevedore==5.5.0 tabulate==0.9.0 toml==0.10.2 tomlkit==0.13.3 tqdm==4.67.1 typing_extensions==4.15.0 tzdata==2025.2 urllib3==1.26.20 virtualenv==20.34.0 wcwidth==0.2.13 websocket-client==1.8.0 wrapt==1.17.3 xdg==6.0.0 xmltodict==1.0.2 yq==3.4.3 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_STACK_TEMPLATE=csit-2-instance-type.yaml OS_CLOUD=vex OS_STACK_NAME=releng-ovsdb-csit-1node-upstream-southbound-all-titanium-415 OS_STACK_TEMPLATE_DIR=openstack-hot [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [ovsdb-csit-1node-upstream-southbound-all-titanium] $ /bin/bash /tmp/jenkins17417281443159003150.sh ---> Create parameters file for OpenStack HOT OpenStack Heat parameters generated ----------------------------------- parameters: vm_0_count: '1' vm_0_flavor: 'v3-standard-4' vm_0_image: 'ZZCI - Ubuntu 22.04 - builder - x86_64 - 20250201-010426.857' vm_1_count: '2' vm_1_flavor: 'v3-standard-2' vm_1_image: 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 - 20250201-060151.911' job_name: '24937-415' silo: 'releng' [ovsdb-csit-1node-upstream-southbound-all-titanium] $ /bin/bash -l /tmp/jenkins918218925725237924.sh ---> Create HEAT stack + source /home/jenkins/lf-env.sh + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ++ mktemp -d /tmp/venv-XXXX + lf_venv=/tmp/venv-uSZG + local venv_file=/tmp/.os_lf_venv + local python=python3 + local options + local set_path=true + local install_args= ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\''' + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\''' ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + true + case $1 in + python=python3 + shift 2 + true + case $1 in + shift + break + case $python in + local pkg_list= + [[ -d /opt/pyenv ]] + echo 'Setup pyenv:' Setup pyenv: + export PYENV_ROOT=/opt/pyenv + PYENV_ROOT=/opt/pyenv + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + pyenv versions system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/ovsdb-csit-1node-upstream-southbound-all-titanium/.python-version) + command -v pyenv ++ pyenv init - --no-rehash + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; fi; done; echo "${paths[*]}"'\'')" export PATH="/opt/pyenv/shims:${PATH}" export PYENV_SHELL=bash source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\'' pyenv() { local command command="${1:-}" if [ "$#" -gt 0 ]; then shift fi case "$command" in rehash|shell) eval "$(pyenv "sh-$command" "$@")" ;; *) command pyenv "$command" "$@" ;; esac }' +++ bash --norc -ec 'IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; fi; done; echo "${paths[*]}"' ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ export PYENV_SHELL=bash ++ PYENV_SHELL=bash ++ source /opt/pyenv/libexec/../completions/pyenv.bash +++ complete -F _pyenv pyenv ++ lf-pyver python3 ++ local py_version_xy=python3 ++ local py_version_xyz= ++ awk '{ print $1 }' ++ pyenv versions ++ local command ++ command=versions ++ '[' 1 -gt 0 ']' ++ shift ++ case "$command" in ++ command pyenv versions ++ pyenv versions ++ sed 's/^[ *]* //' ++ grep -E '^[0-9.]*[0-9]$' ++ [[ ! -s /tmp/.pyenv_versions ]] +++ grep '^3' /tmp/.pyenv_versions +++ tail -n 1 +++ sort -V ++ py_version_xyz=3.11.7 ++ [[ -z 3.11.7 ]] ++ echo 3.11.7 ++ return 0 + pyenv local 3.11.7 + local command + command=local + '[' 2 -gt 0 ']' + shift + case "$command" in + command pyenv local 3.11.7 + pyenv local 3.11.7 + for arg in "$@" + case $arg in + pkg_list+='lftools[openstack] ' + for arg in "$@" + case $arg in + pkg_list+='kubernetes ' + for arg in "$@" + case $arg in + pkg_list+='niet ' + for arg in "$@" + case $arg in + pkg_list+='python-heatclient ' + for arg in "$@" + case $arg in + pkg_list+='python-openstackclient ' + for arg in "$@" + case $arg in + pkg_list+='python-magnumclient ' + for arg in "$@" + case $arg in + pkg_list+='yq ' + [[ -f /tmp/.os_lf_venv ]] ++ cat /tmp/.os_lf_venv + lf_venv=/tmp/venv-dTcr + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-dTcr from' file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Reuse venv:/tmp/venv-dTcr from file:/tmp/.os_lf_venv + /tmp/venv-dTcr/bin/python3 -m pip install --upgrade --quiet pip 'setuptools<66' virtualenv + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ]] + echo 'lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ' lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + /tmp/venv-dTcr/bin/python3 -m pip install --upgrade --quiet --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + type python3 + true + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-dTcr/bin to PATH' lf-activate-venv(): INFO: Adding /tmp/venv-dTcr/bin to PATH + PATH=/tmp/venv-dTcr/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + return 0 + openstack --os-cloud vex limits show --absolute +--------------------------+---------+ | Name | Value | +--------------------------+---------+ | maxTotalInstances | -1 | | maxTotalCores | 450 | | maxTotalRAMSize | 1000000 | | maxServerMeta | 128 | | maxImageMeta | 128 | | maxPersonality | 5 | | maxPersonalitySize | 10240 | | maxTotalKeypairs | 100 | | maxServerGroups | 10 | | maxServerGroupMembers | 10 | | maxTotalFloatingIps | -1 | | maxSecurityGroups | -1 | | maxSecurityGroupRules | -1 | | totalRAMUsed | 630784 | | totalCoresUsed | 154 | | totalInstancesUsed | 51 | | totalFloatingIpsUsed | 0 | | totalSecurityGroupsUsed | 0 | | totalServerGroupsUsed | 0 | | maxTotalVolumes | -1 | | maxTotalSnapshots | 10 | | maxTotalVolumeGigabytes | 4096 | | maxTotalBackups | 10 | | maxTotalBackupGigabytes | 1000 | | totalVolumesUsed | 3 | | totalGigabytesUsed | 60 | | totalSnapshotsUsed | 0 | | totalBackupsUsed | 0 | | totalBackupGigabytesUsed | 0 | +--------------------------+---------+ + pushd /opt/ciman/openstack-hot /opt/ciman/openstack-hot /w/workspace/ovsdb-csit-1node-upstream-southbound-all-titanium + lftools openstack --os-cloud vex stack create releng-ovsdb-csit-1node-upstream-southbound-all-titanium-415 csit-2-instance-type.yaml /w/workspace/ovsdb-csit-1node-upstream-southbound-all-titanium/stack-parameters.yaml Creating stack releng-ovsdb-csit-1node-upstream-southbound-all-titanium-415 Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... Waiting to initialize infrastructure... WARN: Failed to initialize stack. Reason: Resource CREATE failed: MessagingTimeout: resources.vm_1_group.resources[0]: Timed out waiting for a reply to message ID e21abde668384e4db1dcdd69aa8f650f TypeError: delete() missing 1 required positional argument: 'force' Build step 'Execute shell' marked build as failure $ ssh-agent -k unset SSH_AUTH_SOCK; unset SSH_AGENT_PID; echo Agent pid 5279 killed; [ssh-agent] Stopped. Recording plot data Robot results publisher started... INFO: Checking test criticality is deprecated and will be dropped in a future release! -Parsing output xml: Failed! hudson.AbortException: No files found in path /w/workspace/ovsdb-csit-1node-upstream-southbound-all-titanium with configured filemask: output.xml at hudson.plugins.robot.RobotParser$RobotParserCallable.invoke(RobotParser.java:81) at hudson.plugins.robot.RobotParser$RobotParserCallable.invoke(RobotParser.java:52) at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3616) at hudson.remoting.UserRequest.perform(UserRequest.java:211) at hudson.remoting.UserRequest.perform(UserRequest.java:54) at hudson.remoting.Request$2.run(Request.java:377) at hudson.remoting.InterceptingExecutorService.lambda$wrap$0(InterceptingExecutorService.java:78) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:829) Suppressed: hudson.remoting.Channel$CallSiteStackTrace: Remote call to prd-centos8-robot-2c-8g-53620 at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1787) at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:356) at hudson.remoting.Channel.call(Channel.java:1003) at hudson.FilePath.act(FilePath.java:1230) at hudson.FilePath.act(FilePath.java:1219) at hudson.plugins.robot.RobotParser.parse(RobotParser.java:48) at hudson.plugins.robot.RobotPublisher.parse(RobotPublisher.java:246) at hudson.plugins.robot.RobotPublisher.perform(RobotPublisher.java:268) at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:80) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:818) at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:767) at hudson.model.Build$BuildExecution.post2(Build.java:179) at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:711) at hudson.model.Run.execute(Run.java:1918) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44) at hudson.model.ResourceController.execute(ResourceController.java:101) at hudson.model.Executor.run(Executor.java:442) [PostBuildScript] - [INFO] Executing post build scripts. [ovsdb-csit-1node-upstream-southbound-all-titanium] $ /bin/bash /tmp/jenkins50449775853188460.sh Archiving csit artifacts seq: invalid floating point argument: ‘’ Try 'seq --help' for more information. % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 237 0 237 0 0 9480 0 --:--:-- --:--:-- --:--:-- 9480 Archive: robot-plugin.zip End-of-central-directory signature not found. Either this file is not a zipfile, or it constitutes one disk of a multi-part archive. In the latter case the central directory and zipfile comment will be found on the last disk(s) of this archive. unzip: cannot find zipfile directory in one of robot-plugin.zip or robot-plugin.zip.zip, and cannot find robot-plugin.zip.ZIP, period. mv: cannot stat '*.log': No such file or directory mv: cannot stat '*.log.gz': No such file or directory mv: cannot stat '*.csv': No such file or directory mv: cannot stat '*.png': No such file or directory [PostBuildScript] - [INFO] Executing post build scripts. [ovsdb-csit-1node-upstream-southbound-all-titanium] $ /bin/bash /tmp/jenkins8526463232221287896.sh [PostBuildScript] - [INFO] Executing post build scripts. [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_CLOUD=vex OS_STACK_NAME=releng-ovsdb-csit-1node-upstream-southbound-all-titanium-415 [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [ovsdb-csit-1node-upstream-southbound-all-titanium] $ /bin/bash /tmp/jenkins4155253349407108762.sh ---> openstack-stack-delete.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/ovsdb-csit-1node-upstream-southbound-all-titanium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-dTcr from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient lf-activate-venv(): INFO: Adding /tmp/venv-dTcr/bin to PATH INFO: Retrieving stack cost for: releng-ovsdb-csit-1node-upstream-southbound-all-titanium-415 openstack.exceptions.BadRequestException: BadRequestException: 400: Client Error for url: https://compute.public.mtl1.vexxhost.net/v2.1/12c36e260d8e4bb2913965203b1b491f/servers/detail?name=, Invalid input for query parameters name. Value: . '' is not a 'regex' WARNING: Unable to get stack costs, continuing anyway INFO: Deleting stack releng-ovsdb-csit-1node-upstream-southbound-all-titanium-415 Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... WARN: Failed to delete $STACK_NAME. Reason: Resource DELETE failed: MessagingTimeout: resources.vm_0_group: Timed out waiting for a reply to message ID 6793915f6d3f40cb846ab862659d5bdd Retrying delete... WARNING: Failure: Unable to establish connection to https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-ovsdb-csit-1node-upstream-southbound-all-titanium-415/668634ef-1969-4292-88c6-a052a071757c: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')). Retrying in 0.5s. 1 retries left Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... WARN: Failed to delete $STACK_NAME. Reason: Resource DELETE failed: MessagingTimeout: resources.vm_0_group: Timed out waiting for a reply to message ID aaf7228e0bbe458984dd59a5307937ae Retrying delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Failed to delete stack releng-ovsdb-csit-1node-upstream-southbound-all-titanium-415 [PostBuildScript] - [INFO] Executing post build scripts. [ovsdb-csit-1node-upstream-southbound-all-titanium] $ /bin/bash /tmp/jenkins15514620412940850933.sh ---> sysstat.sh [ovsdb-csit-1node-upstream-southbound-all-titanium] $ /bin/bash /tmp/jenkins3985359379112836851.sh ---> package-listing.sh ++ facter osfamily ++ tr '[:upper:]' '[:lower:]' + OS_FAMILY=redhat + workspace=/w/workspace/ovsdb-csit-1node-upstream-southbound-all-titanium + START_PACKAGES=/tmp/packages_start.txt + END_PACKAGES=/tmp/packages_end.txt + DIFF_PACKAGES=/tmp/packages_diff.txt + PACKAGES=/tmp/packages_start.txt + '[' /w/workspace/ovsdb-csit-1node-upstream-southbound-all-titanium ']' + PACKAGES=/tmp/packages_end.txt + case "${OS_FAMILY}" in + rpm -qa + sort + '[' -f /tmp/packages_start.txt ']' + '[' -f /tmp/packages_end.txt ']' + diff /tmp/packages_start.txt /tmp/packages_end.txt + '[' /w/workspace/ovsdb-csit-1node-upstream-southbound-all-titanium ']' + mkdir -p /w/workspace/ovsdb-csit-1node-upstream-southbound-all-titanium/archives/ + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ovsdb-csit-1node-upstream-southbound-all-titanium/archives/ [ovsdb-csit-1node-upstream-southbound-all-titanium] $ /bin/bash /tmp/jenkins4264113997009802883.sh ---> capture-instance-metadata.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/ovsdb-csit-1node-upstream-southbound-all-titanium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-dTcr from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-dTcr/bin to PATH INFO: Running in OpenStack, capturing instance metadata [ovsdb-csit-1node-upstream-southbound-all-titanium] $ /bin/bash /tmp/jenkins564929028326064875.sh provisioning config files... Could not find credentials [logs] for ovsdb-csit-1node-upstream-southbound-all-titanium #415 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ovsdb-csit-1node-upstream-southbound-all-titanium@tmp/config10315627707153097432tmp Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] Run condition [Regular expression match] enabling perform for step [Provide Configuration files] provisioning config files... copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content SERVER_ID=logs [EnvInject] - Variables injected successfully. [ovsdb-csit-1node-upstream-southbound-all-titanium] $ /bin/bash /tmp/jenkins16141280989032011121.sh ---> create-netrc.sh WARN: Log server credential not found. [ovsdb-csit-1node-upstream-southbound-all-titanium] $ /bin/bash /tmp/jenkins17741643520275197550.sh ---> python-tools-install.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/ovsdb-csit-1node-upstream-southbound-all-titanium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-dTcr from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-dTcr/bin to PATH [ovsdb-csit-1node-upstream-southbound-all-titanium] $ /bin/bash /tmp/jenkins5143188299338767903.sh ---> sudo-logs.sh Archiving 'sudo' log.. [ovsdb-csit-1node-upstream-southbound-all-titanium] $ /bin/bash /tmp/jenkins16391051427231962774.sh ---> job-cost.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/ovsdb-csit-1node-upstream-southbound-all-titanium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-dTcr from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 lf-activate-venv(): INFO: Adding /tmp/venv-dTcr/bin to PATH DEBUG: total: 0 INFO: Retrieving Stack Cost... INFO: Retrieving Pricing Info for: v3-standard-2 INFO: Archiving Costs [ovsdb-csit-1node-upstream-southbound-all-titanium] $ /bin/bash -l /tmp/jenkins11469178218391030748.sh ---> logs-deploy.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/ovsdb-csit-1node-upstream-southbound-all-titanium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-dTcr from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-dTcr/bin to PATH WARNING: Nexus logging server not set INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/ovsdb-csit-1node-upstream-southbound-all-titanium/415/ INFO: archiving logs to S3 ---> uname -a: Linux prd-centos8-robot-2c-8g-53620.novalocal 4.18.0-553.5.1.el8.x86_64 #1 SMP Tue May 21 05:46:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux ---> lscpu: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 1 Socket(s): 2 NUMA node(s): 1 Vendor ID: AuthenticAMD CPU family: 23 Model: 49 Model name: AMD EPYC-Rome Processor Stepping: 0 CPU MHz: 2800.000 BogoMIPS: 5600.00 Virtualization: AMD-V Hypervisor vendor: KVM Virtualization type: full L1d cache: 32K L1i cache: 32K L2 cache: 512K L3 cache: 16384K NUMA node0 CPU(s): 0,1 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities ---> nproc: 2 ---> df -h: Filesystem Size Used Avail Use% Mounted on devtmpfs 3.8G 0 3.8G 0% /dev tmpfs 3.8G 0 3.8G 0% /dev/shm tmpfs 3.8G 17M 3.8G 1% /run tmpfs 3.8G 0 3.8G 0% /sys/fs/cgroup /dev/vda1 40G 8.3G 32G 21% / tmpfs 770M 0 770M 0% /run/user/1001 ---> free -m: total used free shared buff/cache available Mem: 7697 585 4994 19 2116 6814 Swap: 1023 0 1023 ---> ip addr: 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: mtu 1458 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:4c:06:a6 brd ff:ff:ff:ff:ff:ff altname enp0s3 altname ens3 inet 10.30.170.78/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0 valid_lft 85230sec preferred_lft 85230sec inet6 fe80::f816:3eff:fe4c:6a6/64 scope link valid_lft forever preferred_lft forever ---> sar -b -r -n DEV: Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-robot-7d7a37eb-bc14-4dd6-9530-dc22c5eae738.noval) 09/18/2025 _x86_64_ (2 CPU) 00:51:33 LINUX RESTART (2 CPU) 12:52:01 AM tps rtps wtps bread/s bwrtn/s 12:53:01 AM 139.80 61.55 78.26 7670.78 23293.02 12:54:01 AM 91.80 0.72 91.09 52.92 11034.49 12:55:01 AM 23.86 0.23 23.63 35.33 1986.37 12:56:01 AM 10.15 0.00 10.15 0.00 628.61 12:57:01 AM 2.47 0.00 2.47 0.00 72.80 12:58:01 AM 0.27 0.00 0.27 0.00 4.30 12:59:01 AM 0.15 0.00 0.15 0.00 1.45 01:00:01 AM 0.20 0.00 0.20 0.00 2.38 01:01:01 AM 0.20 0.02 0.18 0.13 1.92 01:02:01 AM 0.48 0.07 0.42 1.73 7.58 01:03:01 AM 6.20 5.95 0.25 574.88 3.85 01:04:01 AM 3.17 0.00 3.17 0.00 76.72 01:05:01 AM 0.27 0.00 0.27 0.00 4.13 01:06:01 AM 0.12 0.00 0.12 0.00 0.93 01:07:02 AM 0.25 0.03 0.22 0.27 2.42 01:08:01 AM 1.32 0.00 1.32 0.00 31.66 01:09:01 AM 0.20 0.00 0.20 0.00 3.12 01:10:01 AM 0.17 0.00 0.17 0.00 1.48 01:11:01 AM 18.74 0.63 18.11 83.97 475.72 Average: 15.79 3.65 12.15 443.57 1982.50 12:52:01 AM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 12:53:01 AM 5398296 7071760 2484136 31.51 2688 1856332 669620 7.50 186280 1981312 171284 12:54:01 AM 5172524 7010172 2709908 34.38 2688 2013232 705436 7.90 198668 2156604 42852 12:55:01 AM 5085868 6957556 2796564 35.48 2688 2047856 752620 8.43 214560 2234524 44388 12:56:01 AM 5171708 7010284 2710724 34.39 2688 2014444 692044 7.75 226300 2136436 4 12:57:01 AM 5171820 7010396 2710612 34.39 2688 2014444 692044 7.75 226300 2136440 4 12:58:01 AM 5171588 7010168 2710844 34.39 2688 2014448 692044 7.75 226300 2136636 4 12:59:01 AM 5171220 7009768 2711212 34.40 2688 2014448 692044 7.75 226300 2137288 4 01:00:01 AM 5170584 7009132 2711848 34.40 2688 2014448 714040 8.00 226300 2137548 4 01:01:01 AM 5169852 7008424 2712580 34.41 2688 2014452 714040 8.00 226300 2138020 4 01:02:01 AM 5170900 7009540 2711532 34.40 2688 2014520 714040 8.00 226476 2137248 4 01:03:01 AM 5153220 7009136 2729212 34.62 2688 2031768 701060 7.85 228668 2152612 672 01:04:01 AM 5153384 7009300 2729048 34.62 2688 2031768 701060 7.85 228668 2152548 4 01:05:01 AM 5153232 7009148 2729200 34.62 2688 2031768 701060 7.85 228668 2152888 4 01:06:01 AM 5153592 7009512 2728840 34.62 2688 2031772 701060 7.85 228668 2152388 4 01:07:02 AM 5153288 7009220 2729144 34.62 2688 2031772 702796 7.87 228872 2152384 12 01:08:01 AM 5153516 7009448 2728916 34.62 2688 2031772 702796 7.87 228872 2152424 8 01:09:01 AM 5153448 7009384 2728984 34.62 2688 2031776 702796 7.87 228872 2152428 4 01:10:01 AM 5153032 7008968 2729400 34.63 2688 2031776 724636 8.11 228872 2152772 12 01:11:01 AM 5125948 6986732 2756484 34.97 2688 2035756 740384 8.29 387704 2020228 25316 Average: 5168791 7008845 2713641 34.43 2688 2016240 706085 7.91 231666 2135407 14978 12:52:01 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 12:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:53:01 AM eth0 331.07 207.13 1695.23 60.41 0.00 0.00 0.00 0.00 12:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:54:01 AM eth0 64.66 50.53 804.76 8.47 0.00 0.00 0.00 0.00 12:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:55:01 AM eth0 12.36 9.42 12.96 5.23 0.00 0.00 0.00 0.00 12:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:56:01 AM eth0 2.60 2.05 2.06 0.54 0.00 0.00 0.00 0.00 12:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:57:01 AM eth0 0.65 0.30 0.21 0.10 0.00 0.00 0.00 0.00 12:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:58:01 AM eth0 1.02 0.72 0.50 0.22 0.00 0.00 0.00 0.00 12:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:59:01 AM eth0 1.25 0.72 0.68 0.39 0.00 0.00 0.00 0.00 01:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:00:01 AM eth0 0.67 0.40 0.34 0.14 0.00 0.00 0.00 0.00 01:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:01:01 AM eth0 0.75 0.40 0.35 0.14 0.00 0.00 0.00 0.00 01:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:02:01 AM eth0 0.60 0.35 0.29 0.12 0.00 0.00 0.00 0.00 01:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:03:01 AM eth0 1.60 1.27 0.54 0.27 0.00 0.00 0.00 0.00 01:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:04:01 AM eth0 1.02 0.40 0.38 0.14 0.00 0.00 0.00 0.00 01:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:05:01 AM eth0 0.78 0.50 0.58 0.33 0.00 0.00 0.00 0.00 01:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:06:01 AM eth0 0.87 0.55 0.42 0.16 0.00 0.00 0.00 0.00 01:07:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:07:02 AM eth0 0.67 0.40 0.34 0.14 0.00 0.00 0.00 0.00 01:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:08:01 AM eth0 0.75 0.46 0.48 0.21 0.00 0.00 0.00 0.00 01:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:09:01 AM eth0 0.67 0.35 0.34 0.14 0.00 0.00 0.00 0.00 01:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:10:01 AM eth0 1.35 0.55 0.68 0.36 0.00 0.00 0.00 0.00 01:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:11:01 AM eth0 18.58 16.51 14.84 18.41 0.00 0.00 0.00 0.00 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 Average: eth0 23.28 15.43 133.60 5.05 0.00 0.00 0.00 0.00 ---> sar -P ALL: Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-robot-7d7a37eb-bc14-4dd6-9530-dc22c5eae738.noval) 09/18/2025 _x86_64_ (2 CPU) 00:51:33 LINUX RESTART (2 CPU) 12:52:01 AM CPU %user %nice %system %iowait %steal %idle 12:53:01 AM all 44.62 0.06 8.37 4.82 0.10 42.02 12:53:01 AM 0 41.67 0.02 8.18 2.64 0.10 47.40 12:53:01 AM 1 47.58 0.10 8.57 7.00 0.10 36.65 12:54:01 AM all 25.54 0.00 3.75 2.78 0.10 67.84 12:54:01 AM 0 11.94 0.00 2.88 3.05 0.10 82.03 12:54:01 AM 1 39.16 0.00 4.62 2.50 0.10 53.62 12:55:01 AM all 9.64 0.00 1.12 0.32 0.05 88.87 12:55:01 AM 0 8.92 0.00 0.80 0.07 0.03 90.18 12:55:01 AM 1 10.37 0.00 1.44 0.57 0.07 87.56 12:56:01 AM all 3.54 0.00 0.48 0.08 0.05 95.85 12:56:01 AM 0 3.92 0.00 0.60 0.15 0.05 95.28 12:56:01 AM 1 3.15 0.00 0.37 0.00 0.05 96.43 12:57:01 AM all 0.37 0.00 0.07 0.01 0.05 99.51 12:57:01 AM 0 0.58 0.00 0.07 0.02 0.05 99.28 12:57:01 AM 1 0.15 0.00 0.07 0.00 0.05 99.73 12:58:01 AM all 0.39 0.00 0.06 0.00 0.04 99.51 12:58:01 AM 0 0.58 0.00 0.07 0.00 0.07 99.28 12:58:01 AM 1 0.20 0.00 0.05 0.00 0.02 99.73 12:59:01 AM all 0.34 0.00 0.07 0.00 0.05 99.54 12:59:01 AM 0 0.45 0.00 0.08 0.00 0.07 99.40 12:59:01 AM 1 0.23 0.00 0.05 0.00 0.03 99.68 01:00:01 AM all 0.23 0.00 0.06 0.00 0.05 99.67 01:00:01 AM 0 0.33 0.00 0.07 0.00 0.07 99.53 01:00:01 AM 1 0.12 0.00 0.05 0.00 0.03 99.80 01:01:01 AM all 0.37 0.00 0.07 0.00 0.03 99.53 01:01:01 AM 0 0.65 0.00 0.05 0.00 0.02 99.28 01:01:01 AM 1 0.08 0.00 0.08 0.00 0.05 99.78 01:02:01 AM all 0.28 0.00 0.08 0.00 0.04 99.60 01:02:01 AM 0 0.43 0.00 0.07 0.00 0.03 99.47 01:02:01 AM 1 0.12 0.00 0.10 0.00 0.05 99.73 01:03:01 AM all 0.39 0.22 0.16 0.13 0.04 99.06 01:03:01 AM 0 0.53 0.02 0.10 0.00 0.05 99.30 01:03:01 AM 1 0.25 0.42 0.22 0.27 0.03 98.82 01:03:01 AM CPU %user %nice %system %iowait %steal %idle 01:04:01 AM all 0.35 0.00 0.07 0.02 0.05 99.52 01:04:01 AM 0 0.20 0.00 0.08 0.03 0.07 99.62 01:04:01 AM 1 0.50 0.00 0.05 0.00 0.03 99.42 01:05:01 AM all 0.30 0.00 0.06 0.00 0.06 99.58 01:05:01 AM 0 0.18 0.00 0.02 0.00 0.03 99.77 01:05:01 AM 1 0.42 0.00 0.10 0.00 0.08 99.40 01:06:01 AM all 0.38 0.00 0.06 0.00 0.03 99.53 01:06:01 AM 0 0.12 0.00 0.07 0.00 0.03 99.78 01:06:01 AM 1 0.65 0.00 0.05 0.00 0.02 99.28 01:07:02 AM all 0.41 0.00 0.18 0.00 0.04 99.37 01:07:02 AM 0 0.13 0.00 0.17 0.00 0.07 99.63 01:07:02 AM 1 0.68 0.00 0.18 0.00 0.02 99.12 01:08:01 AM all 0.50 0.00 0.06 0.02 0.05 99.37 01:08:01 AM 0 0.10 0.00 0.08 0.02 0.07 99.73 01:08:01 AM 1 0.90 0.00 0.03 0.02 0.03 99.02 01:09:01 AM all 0.37 0.00 0.07 0.00 0.03 99.53 01:09:01 AM 0 0.13 0.00 0.08 0.00 0.03 99.75 01:09:01 AM 1 0.60 0.00 0.05 0.00 0.03 99.32 01:10:01 AM all 0.34 0.00 0.07 0.00 0.04 99.55 01:10:01 AM 0 0.28 0.00 0.08 0.00 0.07 99.57 01:10:01 AM 1 0.40 0.00 0.05 0.00 0.02 99.53 01:11:01 AM all 29.27 0.00 3.73 0.14 0.08 66.78 01:11:01 AM 0 30.79 0.00 3.85 0.13 0.08 65.14 01:11:01 AM 1 27.75 0.00 3.62 0.15 0.07 68.42 Average: all 6.19 0.01 0.98 0.44 0.05 92.32 Average: 0 5.37 0.00 0.92 0.32 0.06 93.33 Average: 1 7.02 0.03 1.04 0.55 0.05 91.32