21:32:18 Started by timer 21:32:18 Running as SYSTEM 21:32:18 [EnvInject] - Loading node environment variables. 21:32:18 Building remotely on prd-centos8-builder-2c-2g-20238 (centos8-builder-2c-2g) in workspace /w/workspace/builder-openstack-cron 21:32:18 [ssh-agent] Looking for ssh-agent implementation... 21:32:18 [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) 21:32:18 $ ssh-agent 21:32:18 SSH_AUTH_SOCK=/tmp/ssh-I7ty9N7WUqxZ/agent.5442 21:32:18 SSH_AGENT_PID=5443 21:32:18 [ssh-agent] Started. 21:32:18 Running ssh-add (command line suppressed) 21:32:18 Identity added: /w/workspace/builder-openstack-cron@tmp/private_key_1819150306681930044.key (/w/workspace/builder-openstack-cron@tmp/private_key_1819150306681930044.key) 21:32:18 [ssh-agent] Using credentials jenkins (jenkins-ssh) 21:32:18 The recommended git tool is: NONE 21:32:21 using credential jenkins-ssh 21:32:21 Wiping out workspace first. 21:32:21 Cloning the remote Git repository 21:32:21 Cloning repository git://devvexx.opendaylight.org/mirror/releng/builder 21:32:21 > git init /w/workspace/builder-openstack-cron # timeout=10 21:32:21 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/releng/builder 21:32:21 > git --version # timeout=10 21:32:21 > git --version # 'git version 2.43.0' 21:32:21 using GIT_SSH to set credentials jenkins-ssh 21:32:21 [INFO] Currently running in a labeled security context 21:32:21 [INFO] Currently SELinux is 'enforcing' on the host 21:32:21 > /usr/bin/chcon --type=ssh_home_t /w/workspace/builder-openstack-cron@tmp/jenkins-gitclient-ssh17198048172298310708.key 21:32:21 Verifying host key using known hosts file 21:32:21 You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. 21:32:21 > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/releng/builder +refs/heads/*:refs/remotes/origin/* # timeout=10 21:32:24 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/releng/builder # timeout=10 21:32:24 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 21:32:24 Avoid second fetch 21:32:24 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 21:32:24 Checking out Revision bafcd9eb6d6eb8e0726e4dc59d49c9b325b5e62b (refs/remotes/origin/master) 21:32:24 > git config core.sparsecheckout # timeout=10 21:32:24 > git checkout -f bafcd9eb6d6eb8e0726e4dc59d49c9b325b5e62b # timeout=10 21:32:24 Commit message: "Fix: update transportpce build nodes for scandium" 21:32:24 > git rev-list --no-walk bafcd9eb6d6eb8e0726e4dc59d49c9b325b5e62b # timeout=10 21:32:24 > git remote # timeout=10 21:32:24 > git submodule init # timeout=10 21:32:24 > git submodule sync # timeout=10 21:32:25 > git config --get remote.origin.url # timeout=10 21:32:25 > git submodule init # timeout=10 21:32:25 > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10 21:32:25 > git config --get submodule.global-jjb.url # timeout=10 21:32:25 > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10 21:32:25 > git config --get submodule.packer/common-packer.url # timeout=10 21:32:25 > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10 21:32:25 > git submodule update --init --recursive global-jjb # timeout=10 21:32:26 > git submodule update --init --recursive packer/common-packer # timeout=10 21:32:29 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 21:32:29 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 21:32:29 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 21:32:29 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 21:32:29 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 21:32:29 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 21:32:29 Run condition [Boolean condition] enabling prebuild for step [BuilderChain] 21:32:29 No emails were triggered. 21:32:29 provisioning config files... 21:32:30 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml 21:32:30 copy managed file [npmrc] to file:/home/jenkins/.npmrc 21:32:30 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 21:32:30 [builder-openstack-cron] $ /bin/bash /tmp/jenkins10729735040400877335.sh 21:32:30 ---> python-tools-install.sh 21:32:30 Setup pyenv: 21:32:30 system 21:32:30 * 3.8.13 (set by /opt/pyenv/version) 21:32:30 * 3.9.13 (set by /opt/pyenv/version) 21:32:30 * 3.10.13 (set by /opt/pyenv/version) 21:32:30 * 3.11.7 (set by /opt/pyenv/version) 21:32:35 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-PIun 21:32:35 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 21:32:38 lf-activate-venv(): INFO: Installing: lftools 21:33:09 lf-activate-venv(): INFO: Adding /tmp/venv-PIun/bin to PATH 21:33:09 Generating Requirements File 21:33:29 Python 3.11.7 21:33:29 pip 24.2 from /tmp/venv-PIun/lib/python3.11/site-packages/pip (python 3.11) 21:33:29 appdirs==1.4.4 21:33:29 argcomplete==3.5.0 21:33:29 aspy.yaml==1.3.0 21:33:29 attrs==24.2.0 21:33:29 autopage==0.5.2 21:33:29 beautifulsoup4==4.12.3 21:33:29 boto3==1.35.14 21:33:29 botocore==1.35.14 21:33:29 bs4==0.0.2 21:33:29 cachetools==5.5.0 21:33:29 certifi==2024.8.30 21:33:29 cffi==1.17.1 21:33:29 cfgv==3.4.0 21:33:29 chardet==5.2.0 21:33:29 charset-normalizer==3.3.2 21:33:29 click==8.1.7 21:33:29 cliff==4.7.0 21:33:29 cmd2==2.4.3 21:33:29 cryptography==3.3.2 21:33:29 debtcollector==3.0.0 21:33:29 decorator==5.1.1 21:33:29 defusedxml==0.7.1 21:33:29 Deprecated==1.2.14 21:33:29 distlib==0.3.8 21:33:29 dnspython==2.6.1 21:33:29 docker==4.2.2 21:33:29 dogpile.cache==1.3.3 21:33:29 email_validator==2.2.0 21:33:29 filelock==3.16.0 21:33:29 future==1.0.0 21:33:29 gitdb==4.0.11 21:33:29 GitPython==3.1.43 21:33:29 google-auth==2.34.0 21:33:29 httplib2==0.22.0 21:33:29 identify==2.6.0 21:33:29 idna==3.8 21:33:29 importlib-resources==1.5.0 21:33:29 iso8601==2.1.0 21:33:29 Jinja2==3.1.4 21:33:29 jmespath==1.0.1 21:33:29 jsonpatch==1.33 21:33:29 jsonpointer==3.0.0 21:33:29 jsonschema==4.23.0 21:33:29 jsonschema-specifications==2023.12.1 21:33:29 keystoneauth1==5.8.0 21:33:29 kubernetes==30.1.0 21:33:29 lftools==0.37.10 21:33:29 lxml==5.3.0 21:33:29 MarkupSafe==2.1.5 21:33:29 msgpack==1.0.8 21:33:29 multi_key_dict==2.0.3 21:33:29 munch==4.0.0 21:33:29 netaddr==1.3.0 21:33:29 netifaces==0.11.0 21:33:29 niet==1.4.2 21:33:29 nodeenv==1.9.1 21:33:29 oauth2client==4.1.3 21:33:29 oauthlib==3.2.2 21:33:29 openstacksdk==4.0.0 21:33:29 os-client-config==2.1.0 21:33:29 os-service-types==1.7.0 21:33:29 osc-lib==3.1.0 21:33:29 oslo.config==9.6.0 21:33:29 oslo.context==5.6.0 21:33:29 oslo.i18n==6.4.0 21:33:29 oslo.log==6.1.2 21:33:29 oslo.serialization==5.5.0 21:33:29 oslo.utils==7.3.0 21:33:29 packaging==24.1 21:33:29 pbr==6.1.0 21:33:29 platformdirs==4.3.2 21:33:29 prettytable==3.11.0 21:33:29 pyasn1==0.6.0 21:33:29 pyasn1_modules==0.4.0 21:33:29 pycparser==2.22 21:33:29 pygerrit2==2.0.15 21:33:29 PyGithub==2.4.0 21:33:29 PyJWT==2.9.0 21:33:29 PyNaCl==1.5.0 21:33:29 pyparsing==2.4.7 21:33:29 pyperclip==1.9.0 21:33:29 pyrsistent==0.20.0 21:33:29 python-cinderclient==9.6.0 21:33:29 python-dateutil==2.9.0.post0 21:33:29 python-heatclient==4.0.0 21:33:29 python-jenkins==1.8.2 21:33:29 python-keystoneclient==5.5.0 21:33:29 python-magnumclient==4.7.0 21:33:29 python-openstackclient==7.0.0 21:33:29 python-swiftclient==4.6.0 21:33:29 PyYAML==6.0.2 21:33:29 referencing==0.35.1 21:33:29 requests==2.32.3 21:33:29 requests-oauthlib==2.0.0 21:33:29 requestsexceptions==1.4.0 21:33:29 rfc3986==2.0.0 21:33:29 rpds-py==0.20.0 21:33:29 rsa==4.9 21:33:29 ruamel.yaml==0.18.6 21:33:29 ruamel.yaml.clib==0.2.8 21:33:29 s3transfer==0.10.2 21:33:29 simplejson==3.19.3 21:33:29 six==1.16.0 21:33:29 smmap==5.0.1 21:33:29 soupsieve==2.6 21:33:29 stevedore==5.3.0 21:33:29 tabulate==0.9.0 21:33:29 toml==0.10.2 21:33:29 tomlkit==0.13.2 21:33:29 tqdm==4.66.5 21:33:29 typing_extensions==4.12.2 21:33:29 tzdata==2024.1 21:33:29 urllib3==1.26.20 21:33:29 virtualenv==20.26.4 21:33:29 wcwidth==0.2.13 21:33:29 websocket-client==1.8.0 21:33:29 wrapt==1.16.0 21:33:29 xdg==6.0.0 21:33:29 xmltodict==0.13.0 21:33:29 yq==3.4.3 21:33:29 [EnvInject] - Injecting environment variables from a build step. 21:33:29 [EnvInject] - Injecting as environment variables the properties content 21:33:29 OS_CLOUD=vex 21:33:29 21:33:29 [EnvInject] - Variables injected successfully. 21:33:29 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 21:33:29 Run condition [Boolean condition] enabling perform for step [Execute shell] 21:33:29 [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins9863008598128222708.sh 21:33:29 ---> Orphaned k8s clusters 21:33:29 Setup pyenv: 21:33:30 system 21:33:30 3.8.13 21:33:30 3.9.13 21:33:30 3.10.13 21:33:30 * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version) 21:33:30 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-PIun from file:/tmp/.os_lf_venv 21:33:31 lf-activate-venv(): INFO: Installing: kubernetes python-heatclient python-openstackclient python-magnumclient 21:33:36 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 21:33:36 lftools 0.37.10 requires urllib3<2.1.0, but you have urllib3 2.2.2 which is incompatible. 21:33:37 lf-activate-venv(): INFO: Adding /tmp/venv-PIun/bin to PATH 21:33:39 -----> Delete orphaned cluster 21:33:39 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 21:33:39 Run condition [Boolean condition] enabling perform for step [Execute shell] 21:33:39 [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins799793261488334715.sh 21:33:39 ---> Orphaned stacks 21:33:39 Setup pyenv: 21:33:40 system 21:33:40 3.8.13 21:33:40 3.9.13 21:33:40 3.10.13 21:33:40 * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version) 21:33:40 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-PIun from file:/tmp/.os_lf_venv 21:33:41 lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 21:33:55 lf-activate-venv(): INFO: Adding /tmp/venv-PIun/bin to PATH 21:33:55 + mapfile -t OS_COE_CLUSTERS_ID 21:33:55 ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name 21:33:55 ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)' 21:33:55 ++ awk '{print $1}' 21:33:58 + echo '-----> Active clusters -> stacks' 21:33:58 -----> Active clusters -> stacks 21:33:58 + OS_COE_STACKS=() 21:33:58 + [[ 0 -gt 0 ]] 21:33:58 + mapfile -t OS_STACKS 21:33:58 ++ awk '{print $1}' 21:33:58 ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED 21:33:59 + echo '-----> Active stacks' 21:33:59 -----> Active stacks 21:33:59 + for stack in "${OS_STACKS[@]}" 21:33:59 + echo releng-openflowplugin-csit-1node-scale-only-potassium-430 21:33:59 releng-openflowplugin-csit-1node-scale-only-potassium-430 21:33:59 + for stack in "${OS_STACKS[@]}" 21:33:59 + echo releng-openflowplugin-csit-1node-perf-bulkomatic-only-potassium-388 21:33:59 releng-openflowplugin-csit-1node-perf-bulkomatic-only-potassium-388 21:33:59 + echo '-----> Delete orphaned stacks' 21:33:59 -----> Delete orphaned stacks 21:33:59 + for STACK_NAME in "${OS_STACKS[@]}" 21:33:59 + [[ 0 -gt 0 ]] 21:33:59 + stack_in_jenkins releng-openflowplugin-csit-1node-scale-only-potassium-430 https://jenkins.opendaylight.org/releng https://jenkins.opendaylight.org/sandbox 21:33:59 + STACK_NAME=releng-openflowplugin-csit-1node-scale-only-potassium-430 21:33:59 + builds=() 21:33:59 + for jenkins in "${@:2}" 21:33:59 + PARAMS='tree=computer[executors[currentExecutable[url]],' 21:33:59 + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]' 21:33:59 + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 21:33:59 + JENKINS_URL='https://jenkins.opendaylight.org/releng/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 21:33:59 ++ curl -s -w '\n\n%{http_code}' --globoff -H Content-Type:application/json 'https://jenkins.opendaylight.org/releng/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 21:33:59 + resp='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/64838/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]} 21:33:59 21:33:59 200' 21:33:59 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/64838/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]} 21:33:59 21:33:59 200' 21:33:59 ++ head -n1 21:33:59 + json_data='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/64838/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]}' 21:33:59 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/64838/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]} 21:33:59 21:33:59 200' 21:33:59 ++ awk 'END {print $NF}' 21:33:59 + status=200 21:33:59 + '[' 200 '!=' 200 ']' 21:33:59 + [[ https://jenkins.opendaylight.org/releng == *\j\e\n\k\i\n\s\.*\.\o\r\g ]] 21:33:59 + [[ https://jenkins.opendaylight.org/releng == *\j\e\n\k\i\n\s\.*\.\i\o ]] 21:33:59 ++ echo https://jenkins.opendaylight.org/releng 21:33:59 ++ sed 's/\/*$//' 21:33:59 ++ awk -F/ '{print $NF}' 21:33:59 + silo=releng 21:33:59 + export silo 21:33:59 + builds=(${builds[@]} $(echo "$json_data" | jq -r '.computer[].executors[].currentExecutable.url' | grep -v null | awk -F'/' '{print ENVIRON["silo"] "-" $6 "-" $7}')) 21:33:59 ++ awk -F/ '{print ENVIRON["silo"] "-" $6 "-" $7}' 21:33:59 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/64838/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]}' 21:33:59 ++ jq -r '.computer[].executors[].currentExecutable.url' 21:33:59 ++ grep -v null 21:33:59 + for jenkins in "${@:2}" 21:33:59 + PARAMS='tree=computer[executors[currentExecutable[url]],' 21:33:59 + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]' 21:33:59 + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 21:33:59 + JENKINS_URL='https://jenkins.opendaylight.org/sandbox/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 21:33:59 ++ curl -s -w '\n\n%{http_code}' --globoff -H Content-Type:application/json 'https://jenkins.opendaylight.org/sandbox/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 21:33:59 + resp='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]} 21:33:59 21:33:59 200' 21:33:59 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]} 21:33:59 21:33:59 200' 21:33:59 ++ head -n1 21:33:59 + json_data='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}' 21:33:59 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]} 21:33:59 21:33:59 200' 21:33:59 ++ awk 'END {print $NF}' 21:33:59 + status=200 21:33:59 + '[' 200 '!=' 200 ']' 21:33:59 + [[ https://jenkins.opendaylight.org/sandbox == *\j\e\n\k\i\n\s\.*\.\o\r\g ]] 21:33:59 + [[ https://jenkins.opendaylight.org/sandbox == *\j\e\n\k\i\n\s\.*\.\i\o ]] 21:33:59 ++ echo https://jenkins.opendaylight.org/sandbox 21:33:59 ++ sed 's/\/*$//' 21:33:59 ++ awk -F/ '{print $NF}' 21:33:59 + silo=sandbox 21:33:59 + export silo 21:33:59 + builds=(${builds[@]} $(echo "$json_data" | jq -r '.computer[].executors[].currentExecutable.url' | grep -v null | awk -F'/' '{print ENVIRON["silo"] "-" $6 "-" $7}')) 21:33:59 ++ grep -v null 21:33:59 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}' 21:33:59 ++ jq -r '.computer[].executors[].currentExecutable.url' 21:33:59 ++ awk -F/ '{print ENVIRON["silo"] "-" $6 "-" $7}' 21:33:59 + [[ releng-builder-openstack-cron-64838 =~ releng-openflowplugin-csit-1node-scale-only-potassium-430 ]] 21:33:59 + return 1 21:33:59 + echo 'Deleting orphaned stack: releng-openflowplugin-csit-1node-scale-only-potassium-430' 21:33:59 Deleting orphaned stack: releng-openflowplugin-csit-1node-scale-only-potassium-430 21:33:59 + lftools openstack --os-cloud vex stack delete --force releng-openflowplugin-csit-1node-scale-only-potassium-430 21:42:29 Build timed out (after 10 minutes). Marking the build as failed. 21:42:29 $ ssh-agent -k 21:42:30 /tmp/jenkins799793261488334715.sh: line 129: 7075 Terminated lftools openstack --os-cloud "${os_cloud}" stack delete --force "${STACK_NAME}" 21:42:30 + for STACK_NAME in "${OS_STACKS[@]}" 21:42:30 + [[ 0 -gt 0 ]] 21:42:30 + stack_in_jenkins releng-openflowplugin-csit-1node-perf-bulkomatic-only-potassium-388 https://jenkins.opendaylight.org/releng https://jenkins.opendaylight.org/sandbox 21:42:30 + STACK_NAME=releng-openflowplugin-csit-1node-perf-bulkomatic-only-potassium-388 21:42:30 + builds=() 21:42:30 + for jenkins in "${@:2}" 21:42:30 + PARAMS='tree=computer[executors[currentExecutable[url]],' 21:42:30 + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]' 21:42:30 + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 21:42:30 + JENKINS_URL='https://jenkins.opendaylight.org/releng/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 21:42:30 unset SSH_AUTH_SOCK; 21:42:30 unset SSH_AGENT_PID; 21:42:30 echo Agent pid 5443 killed; 21:42:30 ++ curl -s -w '\n\n%{http_code}' --globoff -H Content-Type:application/json 'https://jenkins.opendaylight.org/releng/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 21:42:30 [ssh-agent] Stopped. 21:42:30 Build was aborted 21:42:30 [PostBuildScript] - [INFO] Executing post build scripts. 21:42:30 [builder-openstack-cron] $ /bin/bash /tmp/jenkins4030565745684420452.sh 21:42:30 ---> sysstat.sh 21:42:30 (23) Failed writing body 21:42:30 [builder-openstack-cron] $ /bin/bash /tmp/jenkins9003359425089113534.sh 21:42:30 ---> package-listing.sh 21:42:30 ++ facter osfamily 21:42:30 ++ tr '[:upper:]' '[:lower:]' 21:42:30 + OS_FAMILY=redhat 21:42:30 + workspace=/w/workspace/builder-openstack-cron 21:42:30 + START_PACKAGES=/tmp/packages_start.txt 21:42:30 + END_PACKAGES=/tmp/packages_end.txt 21:42:30 + DIFF_PACKAGES=/tmp/packages_diff.txt 21:42:30 + PACKAGES=/tmp/packages_start.txt 21:42:30 + '[' /w/workspace/builder-openstack-cron ']' 21:42:30 + PACKAGES=/tmp/packages_end.txt 21:42:30 + case "${OS_FAMILY}" in 21:42:30 + rpm -qa 21:42:30 + sort 21:42:31 + '[' -f /tmp/packages_start.txt ']' 21:42:31 + '[' -f /tmp/packages_end.txt ']' 21:42:31 + diff /tmp/packages_start.txt /tmp/packages_end.txt 21:42:31 + '[' /w/workspace/builder-openstack-cron ']' 21:42:31 + mkdir -p /w/workspace/builder-openstack-cron/archives/ 21:42:31 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/builder-openstack-cron/archives/ 21:42:31 [builder-openstack-cron] $ /bin/bash /tmp/jenkins9036203378588145716.sh 21:42:31 ---> capture-instance-metadata.sh 21:42:31 Setup pyenv: 21:42:31 system 21:42:31 3.8.13 21:42:31 3.9.13 21:42:31 3.10.13 21:42:31 * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version) 21:42:31 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-PIun from file:/tmp/.os_lf_venv 21:42:32 lf-activate-venv(): INFO: Installing: lftools 21:42:44 lf-activate-venv(): INFO: Adding /tmp/venv-PIun/bin to PATH 21:42:44 INFO: Running in OpenStack, capturing instance metadata 21:42:45 [builder-openstack-cron] $ /bin/bash /tmp/jenkins5884206918048719147.sh 21:42:45 provisioning config files... 21:42:45 Could not find credentials [logs] for builder-openstack-cron #64838 21:42:45 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/builder-openstack-cron@tmp/config17948478884655542332tmp 21:42:45 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] 21:42:45 Run condition [Regular expression match] enabling perform for step [Provide Configuration files] 21:42:45 provisioning config files... 21:42:45 copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials 21:42:45 [EnvInject] - Injecting environment variables from a build step. 21:42:45 [EnvInject] - Injecting as environment variables the properties content 21:42:45 SERVER_ID=logs 21:42:45 21:42:45 [EnvInject] - Variables injected successfully. 21:42:45 [builder-openstack-cron] $ /bin/bash /tmp/jenkins14004315423650731379.sh 21:42:45 ---> create-netrc.sh 21:42:45 WARN: Log server credential not found. 21:42:45 [builder-openstack-cron] $ /bin/bash /tmp/jenkins8577959336502560662.sh 21:42:45 ---> python-tools-install.sh 21:42:45 Setup pyenv: 21:42:46 system 21:42:46 3.8.13 21:42:46 3.9.13 21:42:46 3.10.13 21:42:46 * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version) 21:42:46 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-PIun from file:/tmp/.os_lf_venv 21:42:47 lf-activate-venv(): INFO: Installing: lftools 21:42:55 lf-activate-venv(): INFO: Adding /tmp/venv-PIun/bin to PATH 21:42:55 [builder-openstack-cron] $ /bin/bash /tmp/jenkins9454453072012037434.sh 21:42:55 ---> sudo-logs.sh 21:42:55 Archiving 'sudo' log.. 21:42:55 [builder-openstack-cron] $ /bin/bash /tmp/jenkins6654152183865255371.sh 21:42:55 ---> job-cost.sh 21:42:55 Setup pyenv: 21:42:56 system 21:42:56 3.8.13 21:42:56 3.9.13 21:42:56 3.10.13 21:42:56 * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version) 21:42:56 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-PIun from file:/tmp/.os_lf_venv 21:42:57 lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 21:43:03 lf-activate-venv(): INFO: Adding /tmp/venv-PIun/bin to PATH 21:43:03 INFO: No Stack... 21:43:03 INFO: Retrieving Pricing Info for: v3-standard-2 21:43:03 INFO: Archiving Costs 21:43:03 [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins1482774940751814127.sh 21:43:03 ---> logs-deploy.sh 21:43:03 Setup pyenv: 21:43:03 system 21:43:03 3.8.13 21:43:03 3.9.13 21:43:03 3.10.13 21:43:03 * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version) 21:43:04 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-PIun from file:/tmp/.os_lf_venv 21:43:05 lf-activate-venv(): INFO: Installing: lftools 21:43:13 lf-activate-venv(): INFO: Adding /tmp/venv-PIun/bin to PATH 21:43:13 WARNING: Nexus logging server not set 21:43:13 INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/builder-openstack-cron/64838/ 21:43:13 INFO: archiving logs to S3 21:43:14 ---> uname -a: 21:43:14 Linux prd-centos8-builder-2c-2g-20238.novalocal 4.18.0-553.5.1.el8.x86_64 #1 SMP Tue May 21 05:46:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux 21:43:14 21:43:14 21:43:14 ---> lscpu: 21:43:14 Architecture: x86_64 21:43:14 CPU op-mode(s): 32-bit, 64-bit 21:43:14 Byte Order: Little Endian 21:43:14 CPU(s): 2 21:43:14 On-line CPU(s) list: 0,1 21:43:14 Thread(s) per core: 1 21:43:14 Core(s) per socket: 1 21:43:14 Socket(s): 2 21:43:14 NUMA node(s): 1 21:43:14 Vendor ID: AuthenticAMD 21:43:14 CPU family: 23 21:43:14 Model: 49 21:43:14 Model name: AMD EPYC-Rome Processor 21:43:14 Stepping: 0 21:43:14 CPU MHz: 2799.998 21:43:14 BogoMIPS: 5599.99 21:43:14 Virtualization: AMD-V 21:43:14 Hypervisor vendor: KVM 21:43:14 Virtualization type: full 21:43:14 L1d cache: 32K 21:43:14 L1i cache: 32K 21:43:14 L2 cache: 512K 21:43:14 L3 cache: 16384K 21:43:14 NUMA node0 CPU(s): 0,1 21:43:14 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities 21:43:14 21:43:14 21:43:14 ---> nproc: 21:43:14 2 21:43:14 21:43:14 21:43:14 ---> df -h: 21:43:14 Filesystem Size Used Avail Use% Mounted on 21:43:14 devtmpfs 3.8G 0 3.8G 0% /dev 21:43:14 tmpfs 3.8G 0 3.8G 0% /dev/shm 21:43:14 tmpfs 3.8G 17M 3.8G 1% /run 21:43:14 tmpfs 3.8G 0 3.8G 0% /sys/fs/cgroup 21:43:14 /dev/vda1 40G 8.4G 32G 21% / 21:43:14 tmpfs 770M 0 770M 0% /run/user/1001 21:43:14 21:43:14 21:43:14 ---> free -m: 21:43:14 total used free shared buff/cache available 21:43:14 Mem: 7697 612 4843 19 2240 6790 21:43:14 Swap: 1023 0 1023 21:43:14 21:43:14 21:43:14 ---> ip addr: 21:43:14 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 21:43:14 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 21:43:14 inet 127.0.0.1/8 scope host lo 21:43:14 valid_lft forever preferred_lft forever 21:43:14 inet6 ::1/128 scope host 21:43:14 valid_lft forever preferred_lft forever 21:43:14 2: eth0: mtu 1458 qdisc mq state UP group default qlen 1000 21:43:14 link/ether fa:16:3e:6f:fe:16 brd ff:ff:ff:ff:ff:ff 21:43:14 altname enp0s3 21:43:14 altname ens3 21:43:14 inet 10.30.171.222/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0 21:43:14 valid_lft 85704sec preferred_lft 85704sec 21:43:14 inet6 fe80::f816:3eff:fe6f:fe16/64 scope link 21:43:14 valid_lft forever preferred_lft forever 21:43:14 3: docker0: mtu 1458 qdisc noqueue state DOWN group default 21:43:14 link/ether 02:42:91:80:28:d4 brd ff:ff:ff:ff:ff:ff 21:43:14 inet 10.250.0.254/24 brd 10.250.0.255 scope global docker0 21:43:14 valid_lft forever preferred_lft forever 21:43:14 21:43:14 21:43:14 ---> sar -b -r -n DEV: 21:43:14 Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-builder-5e6ee0fb-b6d9-4116-90d4-35c890e2b0f7.nov) 09/08/2024 _x86_64_ (2 CPU) 21:43:14 21:43:14 21:31:32 LINUX RESTART (2 CPU) 21:43:14 21:43:14 09:32:03 PM tps rtps wtps bread/s bwrtn/s 21:43:14 09:33:01 PM 155.84 30.66 125.18 7480.18 24957.51 21:43:14 09:34:01 PM 115.96 4.20 111.76 142.60 10640.91 21:43:14 09:35:01 PM 16.91 0.00 16.91 0.00 1766.72 21:43:14 09:36:01 PM 2.77 0.03 2.73 0.53 83.82 21:43:14 09:37:01 PM 0.40 0.00 0.40 0.00 6.58 21:43:14 09:38:01 PM 0.32 0.00 0.32 0.00 5.63 21:43:14 09:39:01 PM 0.12 0.00 0.12 0.00 0.77 21:43:14 09:40:01 PM 0.08 0.00 0.08 0.00 0.67 21:43:14 09:41:01 PM 0.17 0.00 0.17 0.00 1.22 21:43:14 09:42:01 PM 0.17 0.00 0.17 0.00 2.10 21:43:14 09:43:01 PM 10.18 0.50 9.68 63.71 148.85 21:43:14 Average: 27.15 3.13 24.02 678.26 3354.42 21:43:14 21:43:14 09:32:03 PM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 21:43:14 09:33:01 PM 5181672 6967964 2700752 34.26 2688 1976824 1025616 11.48 230668 2173104 101528 21:43:14 09:34:01 PM 4974148 6961556 2908276 36.90 2688 2164740 978216 10.95 251536 2305368 40652 21:43:14 09:35:01 PM 4977216 6964092 2905208 36.86 2688 2164744 978216 10.95 251536 2305568 4 21:43:14 09:36:01 PM 4976472 6963364 2905952 36.87 2688 2164760 978216 10.95 251540 2306392 4 21:43:14 09:37:01 PM 4976384 6963280 2906040 36.87 2688 2164764 978216 10.95 251540 2306844 4 21:43:14 09:38:01 PM 4976380 6963276 2906044 36.87 2688 2164764 978216 10.95 251540 2306812 4 21:43:14 09:39:01 PM 4976356 6963252 2906068 36.87 2688 2164764 978216 10.95 251540 2306876 4 21:43:14 09:40:01 PM 4975784 6962684 2906640 36.87 2688 2164768 997324 11.17 251540 2307236 4 21:43:14 09:41:01 PM 4976256 6963148 2906168 36.87 2688 2164768 997324 11.17 251540 2306832 4 21:43:14 09:42:01 PM 4976100 6962996 2906324 36.87 2688 2164772 997324 11.17 251540 2306820 4 21:43:14 09:43:01 PM 4995412 6985760 2887012 36.63 2688 2168224 948404 10.62 411192 2128512 1500 21:43:14 Average: 4996562 6965579 2885862 36.61 2688 2147990 985026 11.03 264156 2278215 13065 21:43:14 21:43:14 09:32:03 PM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 21:43:14 09:33:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:43:14 09:33:01 PM eth0 302.52 190.38 1750.89 64.35 0.00 0.00 0.00 0.00 21:43:14 09:33:01 PM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:43:14 09:34:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:43:14 09:34:01 PM eth0 67.35 57.39 559.57 9.61 0.00 0.00 0.00 0.00 21:43:14 09:34:01 PM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:43:14 09:35:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:43:14 09:35:01 PM eth0 0.87 0.60 0.63 0.37 0.00 0.00 0.00 0.00 21:43:14 09:35:01 PM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:43:14 09:36:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:43:14 09:36:01 PM eth0 0.63 0.38 0.34 0.14 0.00 0.00 0.00 0.00 21:43:14 09:36:01 PM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:43:14 09:37:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:43:14 09:37:01 PM eth0 0.57 0.42 0.34 0.14 0.00 0.00 0.00 0.00 21:43:14 09:37:01 PM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:43:14 09:38:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:43:14 09:38:01 PM eth0 0.75 0.52 0.47 0.21 0.00 0.00 0.00 0.00 21:43:14 09:38:01 PM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:43:14 09:39:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:43:14 09:39:01 PM eth0 0.52 0.40 0.33 0.14 0.00 0.00 0.00 0.00 21:43:14 09:39:01 PM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:43:14 09:40:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:43:14 09:40:01 PM eth0 0.53 0.40 0.33 0.14 0.00 0.00 0.00 0.00 21:43:14 09:40:01 PM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:43:14 09:41:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:43:14 09:41:01 PM eth0 0.47 0.42 0.33 0.14 0.00 0.00 0.00 0.00 21:43:14 09:41:01 PM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:43:14 09:42:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:43:14 09:42:01 PM eth0 0.53 0.38 0.34 0.14 0.00 0.00 0.00 0.00 21:43:14 09:42:01 PM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:43:14 09:43:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:43:14 09:43:01 PM eth0 15.98 13.33 13.46 7.24 0.00 0.00 0.00 0.00 21:43:14 09:43:01 PM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:43:14 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:43:14 Average: eth0 34.71 23.55 206.89 7.34 0.00 0.00 0.00 0.00 21:43:14 Average: docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:43:14 21:43:14 21:43:14 ---> sar -P ALL: 21:43:14 Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-builder-5e6ee0fb-b6d9-4116-90d4-35c890e2b0f7.nov) 09/08/2024 _x86_64_ (2 CPU) 21:43:14 21:43:14 21:31:32 LINUX RESTART (2 CPU) 21:43:14 21:43:14 09:32:03 PM CPU %user %nice %system %iowait %steal %idle 21:43:14 09:33:01 PM all 40.15 0.00 7.47 4.19 0.10 48.09 21:43:14 09:33:01 PM 0 46.49 0.00 8.97 5.99 0.10 38.44 21:43:14 09:33:01 PM 1 33.84 0.00 5.97 2.39 0.10 57.69 21:43:14 09:34:01 PM all 35.45 0.00 5.53 2.83 0.11 56.09 21:43:14 09:34:01 PM 0 54.61 0.00 7.06 2.45 0.10 35.77 21:43:14 09:34:01 PM 1 16.28 0.00 3.99 3.21 0.12 76.40 21:43:14 09:35:01 PM all 0.41 0.00 0.18 0.51 0.03 98.86 21:43:14 09:35:01 PM 0 0.17 0.00 0.20 0.47 0.02 99.15 21:43:14 09:35:01 PM 1 0.65 0.00 0.17 0.55 0.05 98.58 21:43:14 09:36:01 PM all 0.39 0.00 0.11 0.02 0.03 99.45 21:43:14 09:36:01 PM 0 0.22 0.00 0.10 0.03 0.03 99.62 21:43:14 09:36:01 PM 1 0.57 0.00 0.12 0.00 0.03 99.28 21:43:14 09:37:01 PM all 0.38 0.00 0.08 0.00 0.04 99.49 21:43:14 09:37:01 PM 0 0.23 0.00 0.07 0.00 0.05 99.65 21:43:14 09:37:01 PM 1 0.53 0.00 0.10 0.00 0.03 99.33 21:43:14 09:38:01 PM all 0.41 0.00 0.06 0.00 0.03 99.51 21:43:14 09:38:01 PM 0 0.37 0.00 0.08 0.00 0.02 99.53 21:43:14 09:38:01 PM 1 0.45 0.00 0.03 0.00 0.03 99.48 21:43:14 09:39:01 PM all 0.41 0.00 0.05 0.00 0.05 99.49 21:43:14 09:39:01 PM 0 0.23 0.00 0.07 0.00 0.05 99.65 21:43:14 09:39:01 PM 1 0.58 0.00 0.03 0.00 0.05 99.33 21:43:14 09:40:01 PM all 0.38 0.00 0.07 0.00 0.05 99.50 21:43:14 09:40:01 PM 0 0.15 0.00 0.08 0.00 0.07 99.70 21:43:14 09:40:01 PM 1 0.62 0.00 0.05 0.00 0.03 99.30 21:43:14 09:41:01 PM all 0.40 0.00 0.08 0.00 0.04 99.47 21:43:14 09:41:01 PM 0 0.52 0.00 0.08 0.00 0.03 99.37 21:43:14 09:41:01 PM 1 0.28 0.00 0.08 0.00 0.05 99.58 21:43:14 09:42:01 PM all 0.28 0.00 0.08 0.00 0.04 99.61 21:43:14 09:42:01 PM 0 0.28 0.00 0.03 0.00 0.02 99.67 21:43:14 09:42:01 PM 1 0.27 0.00 0.12 0.00 0.07 99.55 21:43:14 09:43:01 PM all 17.88 0.00 2.00 0.10 0.07 79.94 21:43:14 09:43:01 PM 0 19.77 0.00 2.07 0.13 0.07 77.96 21:43:14 09:43:01 PM 1 15.99 0.00 1.94 0.07 0.07 81.94 21:43:14 21:43:14 Average: CPU %user %nice %system %iowait %steal %idle 21:43:14 Average: all 8.66 0.00 1.41 0.68 0.05 89.20 21:43:14 Average: 0 11.05 0.00 1.68 0.81 0.05 86.42 21:43:14 Average: 1 6.28 0.00 1.13 0.56 0.06 91.98 21:43:14 21:43:14 21:43:14