Started by upstream project "integration-distribution-test-titanium" build number 134
originally caused by:
Started by upstream project "autorelease-release-titanium-mvn39-openjdk21" build number 134
originally caused by:
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on prd-centos8-robot-2c-8g-8214 (centos8-robot-2c-8g) in workspace /w/workspace/openflowplugin-csit-1node-cbench-only-titanium
[ssh-agent] Looking for ssh-agent implementation...
[ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine)
$ ssh-agent
SSH_AUTH_SOCK=/tmp/ssh-jxvaVkk8ybXh/agent.5272
SSH_AGENT_PID=5273
[ssh-agent] Started.
Running ssh-add (command line suppressed)
Identity added: /w/workspace/openflowplugin-csit-1node-cbench-only-titanium@tmp/private_key_8787403578132796747.key (/w/workspace/openflowplugin-csit-1node-cbench-only-titanium@tmp/private_key_8787403578132796747.key)
[ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key)
The recommended git tool is: NONE
using credential opendaylight-jenkins-ssh
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository git://devvexx.opendaylight.org/mirror/integration/test
> git init /w/workspace/openflowplugin-csit-1node-cbench-only-titanium/test # timeout=10
Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
> git --version # timeout=10
> git --version # 'git version 2.43.0'
using GIT_SSH to set credentials Release Engineering Jenkins Key
[INFO] Currently running in a labeled security context
[INFO] Currently SELinux is 'enforcing' on the host
> /usr/bin/chcon --type=ssh_home_t /w/workspace/openflowplugin-csit-1node-cbench-only-titanium/test@tmp/jenkins-gitclient-ssh10916601676662817808.key
Verifying host key using known hosts file
You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
> git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
using GIT_SSH to set credentials Release Engineering Jenkins Key
[INFO] Currently running in a labeled security context
[INFO] Currently SELinux is 'enforcing' on the host
> /usr/bin/chcon --type=ssh_home_t /w/workspace/openflowplugin-csit-1node-cbench-only-titanium/test@tmp/jenkins-gitclient-ssh8875602975454712180.key
Verifying host key using known hosts file
You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
> git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10
> git rev-parse FETCH_HEAD^{commit} # timeout=10
Checking out Revision 008ffc904ed7d008b0eaada9592634a76b867e84 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 008ffc904ed7d008b0eaada9592634a76b867e84 # timeout=10
Commit message: "Remove VTN project variables"
> git rev-parse FETCH_HEAD^{commit} # timeout=10
> git rev-list --no-walk 62658074a9de1bb4cdf226129ffae83a31011e59 # timeout=10
No emails were triggered.
provisioning config files...
copy managed file [npmrc] to file:/home/jenkins/.npmrc
copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[openflowplugin-csit-1node-cbench-only-titanium] $ /bin/bash /tmp/jenkins2841728245471655252.sh
---> python-tools-install.sh
Setup pyenv:
system
* 3.8.13 (set by /opt/pyenv/version)
* 3.9.13 (set by /opt/pyenv/version)
* 3.10.13 (set by /opt/pyenv/version)
* 3.11.7 (set by /opt/pyenv/version)
lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-TDc9
lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools
lf-activate-venv(): INFO: Adding /tmp/venv-TDc9/bin to PATH
Generating Requirements File
Python 3.11.7
pip 24.3.1 from /tmp/venv-TDc9/lib/python3.11/site-packages/pip (python 3.11)
appdirs==1.4.4
argcomplete==3.5.3
aspy.yaml==1.3.0
attrs==24.3.0
autopage==0.5.2
beautifulsoup4==4.12.3
boto3==1.35.93
botocore==1.35.93
bs4==0.0.2
cachetools==5.5.0
certifi==2024.12.14
cffi==1.17.1
cfgv==3.4.0
chardet==5.2.0
charset-normalizer==3.4.1
click==8.1.8
cliff==4.8.0
cmd2==2.5.8
cryptography==3.3.2
debtcollector==3.0.0
decorator==5.1.1
defusedxml==0.7.1
Deprecated==1.2.15
distlib==0.3.9
dnspython==2.7.0
docker==4.2.2
dogpile.cache==1.3.3
durationpy==0.9
email_validator==2.2.0
filelock==3.16.1
future==1.0.0
gitdb==4.0.12
GitPython==3.1.44
google-auth==2.37.0
httplib2==0.22.0
identify==2.6.5
idna==3.10
importlib-resources==1.5.0
iso8601==2.1.0
Jinja2==3.1.5
jmespath==1.0.1
jsonpatch==1.33
jsonpointer==3.0.0
jsonschema==4.23.0
jsonschema-specifications==2024.10.1
keystoneauth1==5.9.1
kubernetes==31.0.0
lftools==0.37.10
lxml==5.3.0
MarkupSafe==3.0.2
msgpack==1.1.0
multi_key_dict==2.0.3
munch==4.0.0
netaddr==1.3.0
niet==1.4.2
nodeenv==1.9.1
oauth2client==4.1.3
oauthlib==3.2.2
openstacksdk==4.2.0
os-client-config==2.1.0
os-service-types==1.7.0
osc-lib==3.2.0
oslo.config==9.7.0
oslo.context==5.7.0
oslo.i18n==6.5.0
oslo.log==6.2.0
oslo.serialization==5.6.0
oslo.utils==8.0.0
packaging==24.2
pbr==6.1.0
platformdirs==4.3.6
prettytable==3.12.0
psutil==6.1.1
pyasn1==0.6.1
pyasn1_modules==0.4.1
pycparser==2.22
pygerrit2==2.0.15
PyGithub==2.5.0
PyJWT==2.10.1
PyNaCl==1.5.0
pyparsing==2.4.7
pyperclip==1.9.0
pyrsistent==0.20.0
python-cinderclient==9.6.0
python-dateutil==2.9.0.post0
python-heatclient==4.0.0
python-jenkins==1.8.2
python-keystoneclient==5.5.0
python-magnumclient==4.7.0
python-openstackclient==7.2.1
python-swiftclient==4.6.0
PyYAML==6.0.2
referencing==0.35.1
requests==2.32.3
requests-oauthlib==2.0.0
requestsexceptions==1.4.0
rfc3986==2.0.0
rpds-py==0.22.3
rsa==4.9
ruamel.yaml==0.18.10
ruamel.yaml.clib==0.2.12
s3transfer==0.10.4
simplejson==3.19.3
six==1.17.0
smmap==5.0.2
soupsieve==2.6
stevedore==5.4.0
tabulate==0.9.0
toml==0.10.2
tomlkit==0.13.2
tqdm==4.67.1
typing_extensions==4.12.2
tzdata==2024.2
urllib3==1.26.20
virtualenv==20.28.1
wcwidth==0.2.13
websocket-client==1.8.0
wrapt==1.17.0
xdg==6.0.0
xmltodict==0.14.2
yq==3.4.3
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content
OS_STACK_TEMPLATE=csit-2-instance-type.yaml
OS_CLOUD=vex
OS_STACK_NAME=releng-openflowplugin-csit-1node-cbench-only-titanium-134
OS_STACK_TEMPLATE_DIR=openstack-hot
[EnvInject] - Variables injected successfully.
provisioning config files...
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[openflowplugin-csit-1node-cbench-only-titanium] $ /bin/bash /tmp/jenkins12767865197332400205.sh
---> Create parameters file for OpenStack HOT
OpenStack Heat parameters generated
-----------------------------------
parameters:
vm_0_count: '1'
vm_0_flavor: 'v3-standard-4'
vm_0_image: 'ZZCI - Ubuntu 20.04 - builder - x86_64 - 20241201-160151.330'
vm_1_count: '1'
vm_1_flavor: 'v3-standard-2'
vm_1_image: 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 - 20241201-060156.310'
job_name: '48317-134'
silo: 'releng'
[openflowplugin-csit-1node-cbench-only-titanium] $ /bin/bash -l /tmp/jenkins16043288862384119891.sh
---> Create HEAT stack
+ source /home/jenkins/lf-env.sh
+ lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
++ mktemp -d /tmp/venv-XXXX
+ lf_venv=/tmp/venv-zlW0
+ local venv_file=/tmp/.os_lf_venv
+ local python=python3
+ local options
+ local set_path=true
+ local install_args=
++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
+ options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
+ eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
+ true
+ case $1 in
+ python=python3
+ shift 2
+ true
+ case $1 in
+ shift
+ break
+ case $python in
+ local pkg_list=
+ [[ -d /opt/pyenv ]]
+ echo 'Setup pyenv:'
Setup pyenv:
+ export PYENV_ROOT=/opt/pyenv
+ PYENV_ROOT=/opt/pyenv
+ export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ pyenv versions
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/openflowplugin-csit-1node-cbench-only-titanium/.python-version)
+ command -v pyenv
++ pyenv init - --no-rehash
+ eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH);
for i in ${!paths[@]}; do
if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\'';
fi; done;
echo "${paths[*]}"'\'')"
export PATH="/opt/pyenv/shims:${PATH}"
export PYENV_SHELL=bash
source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\''
pyenv() {
local command
command="${1:-}"
if [ "$#" -gt 0 ]; then
shift
fi
case "$command" in
rehash|shell)
eval "$(pyenv "sh-$command" "$@")"
;;
*)
command pyenv "$command" "$@"
;;
esac
}'
+++ bash --norc -ec 'IFS=:; paths=($PATH);
for i in ${!paths[@]}; do
if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\'';
fi; done;
echo "${paths[*]}"'
++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ export PYENV_SHELL=bash
++ PYENV_SHELL=bash
++ source /opt/pyenv/libexec/../completions/pyenv.bash
+++ complete -F _pyenv pyenv
++ lf-pyver python3
++ local py_version_xy=python3
++ local py_version_xyz=
++ pyenv versions
++ local command
++ command=versions
++ '[' 1 -gt 0 ']'
++ shift
++ case "$command" in
++ command pyenv versions
++ pyenv versions
++ sed 's/^[ *]* //'
++ grep -E '^[0-9.]*[0-9]$'
++ awk '{ print $1 }'
++ [[ ! -s /tmp/.pyenv_versions ]]
+++ grep '^3' /tmp/.pyenv_versions
+++ sort -V
+++ tail -n 1
++ py_version_xyz=3.11.7
++ [[ -z 3.11.7 ]]
++ echo 3.11.7
++ return 0
+ pyenv local 3.11.7
+ local command
+ command=local
+ '[' 2 -gt 0 ']'
+ shift
+ case "$command" in
+ command pyenv local 3.11.7
+ pyenv local 3.11.7
+ for arg in "$@"
+ case $arg in
+ pkg_list+='lftools[openstack] '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='kubernetes '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='niet '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-heatclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-openstackclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-magnumclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='yq '
+ [[ -f /tmp/.os_lf_venv ]]
++ cat /tmp/.os_lf_venv
+ lf_venv=/tmp/venv-TDc9
+ echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-TDc9 from' file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-TDc9 from file:/tmp/.os_lf_venv
+ /tmp/venv-TDc9/bin/python3 -m pip install --upgrade --quiet pip virtualenv
+ [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ]]
+ echo 'lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq '
lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
+ /tmp/venv-TDc9/bin/python3 -m pip install --upgrade --quiet --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
+ type python3
+ true
+ echo 'lf-activate-venv(): INFO: Adding /tmp/venv-TDc9/bin to PATH'
lf-activate-venv(): INFO: Adding /tmp/venv-TDc9/bin to PATH
+ PATH=/tmp/venv-TDc9/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ return 0
+ openstack --os-cloud vex limits show --absolute
+--------------------------+---------+
| Name | Value |
+--------------------------+---------+
| maxTotalInstances | -1 |
| maxTotalCores | 450 |
| maxTotalRAMSize | 1000000 |
| maxServerMeta | 128 |
| maxImageMeta | 128 |
| maxPersonality | 5 |
| maxPersonalitySize | 10240 |
| maxTotalKeypairs | 100 |
| maxServerGroups | 10 |
| maxServerGroupMembers | 10 |
| maxTotalFloatingIps | -1 |
| maxSecurityGroups | -1 |
| maxSecurityGroupRules | -1 |
| totalRAMUsed | 516096 |
| totalCoresUsed | 126 |
| totalInstancesUsed | 44 |
| totalFloatingIpsUsed | 0 |
| totalSecurityGroupsUsed | 0 |
| totalServerGroupsUsed | 0 |
| maxTotalVolumes | -1 |
| maxTotalSnapshots | 10 |
| maxTotalVolumeGigabytes | 4096 |
| maxTotalBackups | 10 |
| maxTotalBackupGigabytes | 1000 |
| totalVolumesUsed | 3 |
| totalGigabytesUsed | 60 |
| totalSnapshotsUsed | 0 |
| totalBackupsUsed | 0 |
| totalBackupGigabytesUsed | 0 |
+--------------------------+---------+
+ pushd /opt/ciman/openstack-hot
/opt/ciman/openstack-hot /w/workspace/openflowplugin-csit-1node-cbench-only-titanium
+ lftools openstack --os-cloud vex stack create releng-openflowplugin-csit-1node-cbench-only-titanium-134 csit-2-instance-type.yaml /w/workspace/openflowplugin-csit-1node-cbench-only-titanium/stack-parameters.yaml
Creating stack releng-openflowplugin-csit-1node-cbench-only-titanium-134
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
WARN: Failed to initialize stack. Reason: Timed out
TypeError: delete() missing 1 required positional argument: 'force'
Build step 'Execute shell' marked build as failure
$ ssh-agent -k
unset SSH_AUTH_SOCK;
unset SSH_AGENT_PID;
echo Agent pid 5273 killed;
[ssh-agent] Stopped.
Recording plot data
Robot results publisher started...
INFO: Checking test criticality is deprecated and will be dropped in a future release!
-Parsing output xml:
Failed!
hudson.AbortException: No files found in path /w/workspace/openflowplugin-csit-1node-cbench-only-titanium with configured filemask: output.xml
at hudson.plugins.robot.RobotParser$RobotParserCallable.invoke(RobotParser.java:81)
at hudson.plugins.robot.RobotParser$RobotParserCallable.invoke(RobotParser.java:52)
at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3616)
at hudson.remoting.UserRequest.perform(UserRequest.java:211)
at hudson.remoting.UserRequest.perform(UserRequest.java:54)
at hudson.remoting.Request$2.run(Request.java:377)
at hudson.remoting.InterceptingExecutorService.lambda$wrap$0(InterceptingExecutorService.java:78)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
Suppressed: hudson.remoting.Channel$CallSiteStackTrace: Remote call to prd-centos8-robot-2c-8g-8214
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1787)
at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:356)
at hudson.remoting.Channel.call(Channel.java:1003)
at hudson.FilePath.act(FilePath.java:1230)
at hudson.FilePath.act(FilePath.java:1219)
at hudson.plugins.robot.RobotParser.parse(RobotParser.java:48)
at hudson.plugins.robot.RobotPublisher.parse(RobotPublisher.java:246)
at hudson.plugins.robot.RobotPublisher.perform(RobotPublisher.java:268)
at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:80)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:818)
at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:767)
at hudson.model.Build$BuildExecution.post2(Build.java:179)
at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:711)
at hudson.model.Run.execute(Run.java:1918)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44)
at hudson.model.ResourceController.execute(ResourceController.java:101)
at hudson.model.Executor.run(Executor.java:442)
[PostBuildScript] - [INFO] Executing post build scripts.
[openflowplugin-csit-1node-cbench-only-titanium] $ /bin/bash /tmp/jenkins5126374070691573774.sh
Archiving csit artifacts
seq: invalid floating point argument: ‘’
Try 'seq --help' for more information.
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 237 0 237 0 0 3338 0 --:--:-- --:--:-- --:--:-- 3338
Archive: robot-plugin.zip
End-of-central-directory signature not found. Either this file is not
a zipfile, or it constitutes one disk of a multi-part archive. In the
latter case the central directory and zipfile comment will be found on
the last disk(s) of this archive.
unzip: cannot find zipfile directory in one of robot-plugin.zip or
robot-plugin.zip.zip, and cannot find robot-plugin.zip.ZIP, period.
mv: cannot stat '*.log': No such file or directory
mv: cannot stat '*.log.gz': No such file or directory
mv: cannot stat '*.csv': No such file or directory
mv: cannot stat '*.png': No such file or directory
[PostBuildScript] - [INFO] Executing post build scripts.
[openflowplugin-csit-1node-cbench-only-titanium] $ /bin/bash /tmp/jenkins9579621309438789463.sh
[PostBuildScript] - [INFO] Executing post build scripts.
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content
OS_CLOUD=vex
OS_STACK_NAME=releng-openflowplugin-csit-1node-cbench-only-titanium-134
[EnvInject] - Variables injected successfully.
provisioning config files...
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[openflowplugin-csit-1node-cbench-only-titanium] $ /bin/bash /tmp/jenkins10434747532729987583.sh
---> openstack-stack-delete.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/openflowplugin-csit-1node-cbench-only-titanium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-TDc9 from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient
lf-activate-venv(): INFO: Adding /tmp/venv-TDc9/bin to PATH
INFO: Retrieving stack cost for: releng-openflowplugin-csit-1node-cbench-only-titanium-134
DEBUG: Successfully retrieved stack cost: total: 0.16999999999999998
INFO: Deleting stack releng-openflowplugin-csit-1node-cbench-only-titanium-134
Successfully deleted stack releng-openflowplugin-csit-1node-cbench-only-titanium-134
[PostBuildScript] - [INFO] Executing post build scripts.
[openflowplugin-csit-1node-cbench-only-titanium] $ /bin/bash /tmp/jenkins6843357439297151410.sh
---> sysstat.sh
[openflowplugin-csit-1node-cbench-only-titanium] $ /bin/bash /tmp/jenkins15489069351884103229.sh
---> package-listing.sh
++ facter osfamily
++ tr '[:upper:]' '[:lower:]'
+ OS_FAMILY=redhat
+ workspace=/w/workspace/openflowplugin-csit-1node-cbench-only-titanium
+ START_PACKAGES=/tmp/packages_start.txt
+ END_PACKAGES=/tmp/packages_end.txt
+ DIFF_PACKAGES=/tmp/packages_diff.txt
+ PACKAGES=/tmp/packages_start.txt
+ '[' /w/workspace/openflowplugin-csit-1node-cbench-only-titanium ']'
+ PACKAGES=/tmp/packages_end.txt
+ case "${OS_FAMILY}" in
+ rpm -qa
+ sort
+ '[' -f /tmp/packages_start.txt ']'
+ '[' -f /tmp/packages_end.txt ']'
+ diff /tmp/packages_start.txt /tmp/packages_end.txt
+ '[' /w/workspace/openflowplugin-csit-1node-cbench-only-titanium ']'
+ mkdir -p /w/workspace/openflowplugin-csit-1node-cbench-only-titanium/archives/
+ cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/openflowplugin-csit-1node-cbench-only-titanium/archives/
[openflowplugin-csit-1node-cbench-only-titanium] $ /bin/bash /tmp/jenkins10329885362635413559.sh
---> capture-instance-metadata.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/openflowplugin-csit-1node-cbench-only-titanium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-TDc9 from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools
lf-activate-venv(): INFO: Adding /tmp/venv-TDc9/bin to PATH
INFO: Running in OpenStack, capturing instance metadata
[openflowplugin-csit-1node-cbench-only-titanium] $ /bin/bash /tmp/jenkins14131156052763330835.sh
provisioning config files...
Could not find credentials [logs] for openflowplugin-csit-1node-cbench-only-titanium #134
copy managed file [jenkins-log-archives-settings] to file:/w/workspace/openflowplugin-csit-1node-cbench-only-titanium@tmp/config10432354384612498192tmp
Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index]
Run condition [Regular expression match] enabling perform for step [Provide Configuration files]
provisioning config files...
copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content
SERVER_ID=logs
[EnvInject] - Variables injected successfully.
[openflowplugin-csit-1node-cbench-only-titanium] $ /bin/bash /tmp/jenkins9068491933000466295.sh
---> create-netrc.sh
WARN: Log server credential not found.
[openflowplugin-csit-1node-cbench-only-titanium] $ /bin/bash /tmp/jenkins7963789960602556951.sh
---> python-tools-install.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/openflowplugin-csit-1node-cbench-only-titanium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-TDc9 from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools
lf-activate-venv(): INFO: Adding /tmp/venv-TDc9/bin to PATH
[openflowplugin-csit-1node-cbench-only-titanium] $ /bin/bash /tmp/jenkins5708376851633758449.sh
---> sudo-logs.sh
Archiving 'sudo' log..
[openflowplugin-csit-1node-cbench-only-titanium] $ /bin/bash /tmp/jenkins4479515646880879074.sh
---> job-cost.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/openflowplugin-csit-1node-cbench-only-titanium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-TDc9 from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15
lf-activate-venv(): INFO: Adding /tmp/venv-TDc9/bin to PATH
DEBUG: total: 0.16999999999999998
INFO: Retrieving Stack Cost...
INFO: Retrieving Pricing Info for: v3-standard-2
INFO: Archiving Costs
[openflowplugin-csit-1node-cbench-only-titanium] $ /bin/bash -l /tmp/jenkins10559129789071922813.sh
---> logs-deploy.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/openflowplugin-csit-1node-cbench-only-titanium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-TDc9 from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools
lf-activate-venv(): INFO: Adding /tmp/venv-TDc9/bin to PATH
WARNING: Nexus logging server not set
INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/openflowplugin-csit-1node-cbench-only-titanium/134/
INFO: archiving logs to S3
---> uname -a:
Linux prd-centos8-robot-2c-8g-8214.novalocal 4.18.0-553.5.1.el8.x86_64 #1 SMP Tue May 21 05:46:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
---> lscpu:
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
CPU(s): 2
On-line CPU(s) list: 0,1
Thread(s) per core: 1
Core(s) per socket: 1
Socket(s): 2
NUMA node(s): 1
Vendor ID: AuthenticAMD
CPU family: 23
Model: 49
Model name: AMD EPYC-Rome Processor
Stepping: 0
CPU MHz: 2799.998
BogoMIPS: 5599.99
Virtualization: AMD-V
Hypervisor vendor: KVM
Virtualization type: full
L1d cache: 32K
L1i cache: 32K
L2 cache: 512K
L3 cache: 16384K
NUMA node0 CPU(s): 0,1
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
---> nproc:
2
---> df -h:
Filesystem Size Used Avail Use% Mounted on
devtmpfs 3.8G 0 3.8G 0% /dev
tmpfs 3.8G 0 3.8G 0% /dev/shm
tmpfs 3.8G 17M 3.8G 1% /run
tmpfs 3.8G 0 3.8G 0% /sys/fs/cgroup
/dev/vda1 40G 8.2G 32G 21% /
tmpfs 770M 0 770M 0% /run/user/1001
---> free -m:
total used free shared buff/cache available
Mem: 7697 571 5064 19 2062 6831
Swap: 1023 0 1023
---> ip addr:
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1458 qdisc mq state UP group default qlen 1000
link/ether fa:16:3e:66:c6:8e brd ff:ff:ff:ff:ff:ff
altname enp0s3
altname ens3
inet 10.30.171.228/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0
valid_lft 85267sec preferred_lft 85267sec
inet6 fe80::f816:3eff:fe66:c68e/64 scope link
valid_lft forever preferred_lft forever
---> sar -b -r -n DEV:
Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-robot-7d7a37eb-bc14-4dd6-9530-dc22c5eae738.noval) 01/07/2025 _x86_64_ (2 CPU)
02:01:56 LINUX RESTART (2 CPU)
02:03:01 AM tps rtps wtps bread/s bwrtn/s
02:04:01 AM 92.74 6.06 86.67 1089.90 6342.27
02:05:01 AM 66.87 0.67 66.21 51.19 9598.97
02:06:01 AM 3.92 0.03 3.88 0.53 132.56
02:07:01 AM 0.47 0.00 0.47 0.00 5.95
02:08:01 AM 0.48 0.00 0.48 0.00 6.68
02:09:01 AM 0.32 0.00 0.32 0.00 3.20
02:10:02 AM 0.35 0.00 0.35 0.00 3.43
02:11:01 AM 0.53 0.00 0.53 0.00 6.90
02:12:01 AM 0.33 0.00 0.33 0.00 3.15
02:13:01 AM 0.47 0.00 0.47 0.00 5.93
02:14:01 AM 0.35 0.00 0.35 0.00 3.58
02:15:01 AM 0.28 0.00 0.28 0.00 2.88
02:16:01 AM 0.32 0.00 0.32 0.00 3.28
02:17:01 AM 0.38 0.00 0.38 0.00 4.12
02:18:01 AM 1.63 0.03 1.60 0.27 35.22
02:19:01 AM 0.28 0.00 0.28 0.00 3.42
02:20:01 AM 8.71 0.22 8.50 35.72 189.22
Average: 10.51 0.41 10.09 69.34 962.72
02:03:01 AM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty
02:04:01 AM 5290700 7058836 2591724 32.88 2688 1947176 659952 7.39 186900 2073128 228240
02:05:01 AM 5206368 7007140 2676056 33.95 2688 1979004 714164 8.00 198312 2134476 8
02:06:01 AM 5206872 7007672 2675552 33.94 2688 1979024 714164 8.00 198412 2135396 4
02:07:01 AM 5207284 7008084 2675140 33.94 2688 1979024 714164 8.00 198412 2134832 4
02:08:01 AM 5207060 7007860 2675364 33.94 2688 1979024 714164 8.00 198412 2135024 8
02:09:01 AM 5207380 7008188 2675044 33.94 2688 1979028 714164 8.00 198412 2134972 8
02:10:02 AM 5206948 7007756 2675476 33.94 2688 1979028 710048 7.95 198412 2135208 4
02:11:01 AM 5207288 7008132 2675136 33.94 2688 1979032 710048 7.95 198412 2135112 4
02:12:01 AM 5207456 7008300 2674968 33.94 2688 1979032 710048 7.95 198412 2134880 4
02:13:01 AM 5207256 7008100 2675168 33.94 2688 1979032 710048 7.95 198412 2134972 4
02:14:01 AM 5207404 7008252 2675020 33.94 2688 1979036 710048 7.95 198412 2134912 4
02:15:01 AM 5207396 7008244 2675028 33.94 2688 1979036 710048 7.95 198412 2134916 4
02:16:01 AM 5207348 7008196 2675076 33.94 2688 1979036 710048 7.95 198412 2134984 4
02:17:01 AM 5206452 7007304 2675972 33.95 2688 1979040 707512 7.92 198412 2135488 4
02:18:01 AM 5206700 7007556 2675724 33.95 2688 1979040 707512 7.92 198600 2135344 4
02:19:01 AM 5206616 7007472 2675808 33.95 2688 1979040 707512 7.92 198600 2135352 4
02:20:01 AM 5204500 7006592 2677924 33.97 2688 1980264 725320 8.12 226904 2109104 172
Average: 5211825 7010805 2670599 33.88 2688 1977229 708763 7.94 199427 2129888 13440
02:03:01 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil
02:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:04:01 AM eth0 90.75 71.74 950.72 10.22 0.00 0.00 0.00 0.00
02:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:05:01 AM eth0 39.39 27.55 435.44 3.87 0.00 0.00 0.00 0.00
02:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:06:01 AM eth0 8.30 0.50 1.24 0.14 0.00 0.00 0.00 0.00
02:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:07:01 AM eth0 1.85 0.42 0.39 0.14 0.00 0.00 0.00 0.00
02:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:08:01 AM eth0 1.27 0.47 0.42 0.20 0.00 0.00 0.00 0.00
02:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:09:01 AM eth0 0.90 0.42 0.39 0.14 0.00 0.00 0.00 0.00
02:10:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:10:02 AM eth0 1.27 0.42 0.35 0.14 0.00 0.00 0.00 0.00
02:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:11:01 AM eth0 0.75 0.34 0.28 0.12 0.00 0.00 0.00 0.00
02:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:12:01 AM eth0 2.25 0.42 0.40 0.14 0.00 0.00 0.00 0.00
02:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:13:01 AM eth0 2.90 0.62 0.54 0.22 0.00 0.00 0.00 0.00
02:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:14:01 AM eth0 0.98 0.42 0.39 0.14 0.00 0.00 0.00 0.00
02:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:15:01 AM eth0 1.13 0.37 0.34 0.13 0.00 0.00 0.00 0.00
02:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:16:01 AM eth0 2.72 0.42 0.60 0.17 0.00 0.00 0.00 0.00
02:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:17:01 AM eth0 1.67 0.63 0.65 0.37 0.00 0.00 0.00 0.00
02:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:18:01 AM eth0 1.75 0.63 0.72 0.39 0.00 0.00 0.00 0.00
02:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:19:01 AM eth0 2.25 0.47 0.74 0.30 0.00 0.00 0.00 0.00
02:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:20:01 AM eth0 15.64 11.35 14.29 5.86 0.00 0.00 0.00 0.00
Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
Average: eth0 10.35 6.90 82.90 1.34 0.00 0.00 0.00 0.00
---> sar -P ALL:
Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-robot-7d7a37eb-bc14-4dd6-9530-dc22c5eae738.noval) 01/07/2025 _x86_64_ (2 CPU)
02:01:56 LINUX RESTART (2 CPU)
02:03:01 AM CPU %user %nice %system %iowait %steal %idle
02:04:01 AM all 35.75 0.00 5.47 1.92 0.11 56.76
02:04:01 AM 0 47.46 0.00 6.32 2.33 0.12 43.77
02:04:01 AM 1 24.05 0.00 4.62 1.50 0.10 69.74
02:05:01 AM all 11.27 0.00 1.56 3.45 0.06 83.66
02:05:01 AM 0 16.54 0.00 1.87 4.36 0.07 77.16
02:05:01 AM 1 6.00 0.00 1.25 2.54 0.05 90.16
02:06:01 AM all 0.40 0.00 0.12 0.25 0.06 99.17
02:06:01 AM 0 0.53 0.00 0.08 0.50 0.08 98.80
02:06:01 AM 1 0.27 0.00 0.15 0.00 0.03 99.55
02:07:01 AM all 0.32 0.00 0.07 0.01 0.02 99.59
02:07:01 AM 0 0.17 0.00 0.08 0.00 0.03 99.72
02:07:01 AM 1 0.47 0.00 0.05 0.02 0.00 99.46
02:08:01 AM all 0.36 0.00 0.06 0.00 0.03 99.55
02:08:01 AM 0 0.10 0.00 0.07 0.00 0.03 99.80
02:08:01 AM 1 0.62 0.00 0.05 0.00 0.03 99.30
02:09:01 AM all 0.39 0.00 0.05 0.00 0.03 99.52
02:09:01 AM 0 0.37 0.00 0.07 0.00 0.05 99.52
02:09:01 AM 1 0.42 0.00 0.03 0.00 0.02 99.53
02:10:02 AM all 0.38 0.00 0.07 0.00 0.02 99.53
02:10:02 AM 0 0.55 0.00 0.07 0.00 0.02 99.37
02:10:02 AM 1 0.22 0.00 0.07 0.00 0.02 99.70
02:11:01 AM all 0.39 0.00 0.06 0.07 0.03 99.45
02:11:01 AM 0 0.59 0.00 0.07 0.14 0.05 99.15
02:11:01 AM 1 0.19 0.00 0.05 0.00 0.02 99.75
02:12:01 AM all 0.37 0.00 0.06 0.00 0.03 99.55
02:12:01 AM 0 0.20 0.00 0.08 0.00 0.03 99.68
02:12:01 AM 1 0.53 0.00 0.03 0.00 0.02 99.42
02:13:01 AM all 0.39 0.00 0.06 0.00 0.03 99.52
02:13:01 AM 0 0.32 0.00 0.08 0.00 0.03 99.57
02:13:01 AM 1 0.47 0.00 0.03 0.00 0.02 99.48
02:14:01 AM all 0.33 0.00 0.06 0.00 0.03 99.59
02:14:01 AM 0 0.50 0.00 0.07 0.00 0.03 99.40
02:14:01 AM 1 0.15 0.00 0.05 0.00 0.02 99.78
02:14:01 AM CPU %user %nice %system %iowait %steal %idle
02:15:01 AM all 0.38 0.00 0.05 0.00 0.03 99.54
02:15:01 AM 0 0.35 0.00 0.07 0.00 0.03 99.55
02:15:01 AM 1 0.40 0.00 0.03 0.00 0.03 99.53
02:16:01 AM all 0.34 0.00 0.05 0.00 0.02 99.59
02:16:01 AM 0 0.62 0.00 0.05 0.00 0.02 99.32
02:16:01 AM 1 0.07 0.00 0.05 0.00 0.02 99.87
02:17:01 AM all 0.25 0.00 0.06 0.00 0.03 99.66
02:17:01 AM 0 0.42 0.00 0.07 0.00 0.03 99.48
02:17:01 AM 1 0.08 0.00 0.05 0.00 0.03 99.83
02:18:01 AM all 0.46 0.00 0.17 0.01 0.02 99.35
02:18:01 AM 0 0.23 0.00 0.15 0.02 0.02 99.58
02:18:01 AM 1 0.68 0.00 0.18 0.00 0.02 99.12
02:19:01 AM all 0.40 0.00 0.05 0.00 0.03 99.52
02:19:01 AM 0 0.20 0.00 0.03 0.00 0.02 99.75
02:19:01 AM 1 0.60 0.00 0.07 0.00 0.03 99.30
02:20:01 AM all 11.85 0.00 1.09 0.13 0.05 86.89
02:20:01 AM 0 10.80 0.00 1.05 0.12 0.05 87.98
02:20:01 AM 1 12.90 0.00 1.12 0.13 0.05 85.80
Average: all 3.77 0.00 0.54 0.34 0.04 95.31
Average: 0 4.71 0.00 0.61 0.44 0.04 94.20
Average: 1 2.83 0.00 0.46 0.25 0.03 96.42