18:32:44 Started by timer 18:32:44 Running as SYSTEM 18:32:44 [EnvInject] - Loading node environment variables. 18:32:44 Building remotely on prd-centos8-builder-2c-2g-1817 (centos8-builder-2c-2g) in workspace /w/workspace/builder-openstack-cron 18:32:44 [ssh-agent] Looking for ssh-agent implementation... 18:32:44 [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) 18:32:44 $ ssh-agent 18:32:44 SSH_AUTH_SOCK=/tmp/ssh-xuWyVxSmScqu/agent.5443 18:32:44 SSH_AGENT_PID=5445 18:32:44 [ssh-agent] Started. 18:32:44 Running ssh-add (command line suppressed) 18:32:44 Identity added: /w/workspace/builder-openstack-cron@tmp/private_key_18206038455719894570.key (/w/workspace/builder-openstack-cron@tmp/private_key_18206038455719894570.key) 18:32:44 [ssh-agent] Using credentials jenkins (jenkins-ssh) 18:32:44 The recommended git tool is: NONE 18:32:47 using credential jenkins-ssh 18:32:47 Wiping out workspace first. 18:32:47 Cloning the remote Git repository 18:32:47 Cloning repository git://devvexx.opendaylight.org/mirror/releng/builder 18:32:47 > git init /w/workspace/builder-openstack-cron # timeout=10 18:32:47 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/releng/builder 18:32:47 > git --version # timeout=10 18:32:47 > git --version # 'git version 2.43.0' 18:32:47 using GIT_SSH to set credentials jenkins-ssh 18:32:47 [INFO] Currently running in a labeled security context 18:32:47 [INFO] Currently SELinux is 'enforcing' on the host 18:32:47 > /usr/bin/chcon --type=ssh_home_t /w/workspace/builder-openstack-cron@tmp/jenkins-gitclient-ssh8020902639930965193.key 18:32:47 Verifying host key using known hosts file 18:32:47 You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. 18:32:47 > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/releng/builder +refs/heads/*:refs/remotes/origin/* # timeout=10 18:32:49 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/releng/builder # timeout=10 18:32:49 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 18:32:50 Avoid second fetch 18:32:50 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 18:32:50 Checking out Revision 6cd405ccab649fcd7832ee14748bdee1c721ff40 (refs/remotes/origin/master) 18:32:50 > git config core.sparsecheckout # timeout=10 18:32:50 > git checkout -f 6cd405ccab649fcd7832ee14748bdee1c721ff40 # timeout=10 18:32:50 Commit message: "Chore: Update global-jjb to the latest v0.92.5" 18:32:50 > git rev-list --no-walk 6cd405ccab649fcd7832ee14748bdee1c721ff40 # timeout=10 18:32:50 > git remote # timeout=10 18:32:50 > git submodule init # timeout=10 18:32:51 > git submodule sync # timeout=10 18:32:51 > git config --get remote.origin.url # timeout=10 18:32:51 > git submodule init # timeout=10 18:32:51 > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10 18:32:51 > git config --get submodule.global-jjb.url # timeout=10 18:32:51 > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10 18:32:51 > git config --get submodule.packer/common-packer.url # timeout=10 18:32:51 > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10 18:32:51 > git submodule update --init --recursive global-jjb # timeout=10 18:32:52 > git submodule update --init --recursive packer/common-packer # timeout=10 18:32:56 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 18:32:56 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 18:32:56 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 18:32:56 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 18:32:56 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 18:32:56 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 18:32:56 Run condition [Boolean condition] enabling prebuild for step [BuilderChain] 18:32:56 No emails were triggered. 18:32:56 provisioning config files... 18:32:56 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml 18:32:56 copy managed file [npmrc] to file:/home/jenkins/.npmrc 18:32:56 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 18:32:56 [builder-openstack-cron] $ /bin/bash /tmp/jenkins2876285468998903050.sh 18:32:56 ---> python-tools-install.sh 18:32:56 Setup pyenv: 18:32:56 system 18:32:56 * 3.8.13 (set by /opt/pyenv/version) 18:32:56 * 3.9.13 (set by /opt/pyenv/version) 18:32:56 * 3.10.13 (set by /opt/pyenv/version) 18:32:56 * 3.11.7 (set by /opt/pyenv/version) 18:33:01 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-ZFGF 18:33:01 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 18:33:01 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 18:33:01 lf-activate-venv(): INFO: Attempting to install with network-safe options... 18:33:05 lf-activate-venv(): INFO: Base packages installed successfully 18:33:05 lf-activate-venv(): INFO: Installing additional packages: lftools 18:33:33 lf-activate-venv(): INFO: Adding /tmp/venv-ZFGF/bin to PATH 18:33:33 Generating Requirements File 18:33:55 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 18:33:55 httplib2 0.31.0 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible. 18:33:55 Python 3.11.7 18:33:55 pip 25.2 from /tmp/venv-ZFGF/lib/python3.11/site-packages/pip (python 3.11) 18:33:56 appdirs==1.4.4 18:33:56 argcomplete==3.6.2 18:33:56 aspy.yaml==1.3.0 18:33:56 attrs==25.3.0 18:33:56 autopage==0.5.2 18:33:56 beautifulsoup4==4.14.0 18:33:56 boto3==1.40.40 18:33:56 botocore==1.40.40 18:33:56 bs4==0.0.2 18:33:56 cachetools==5.5.2 18:33:56 certifi==2025.8.3 18:33:56 cffi==2.0.0 18:33:56 cfgv==3.4.0 18:33:56 chardet==5.2.0 18:33:56 charset-normalizer==3.4.3 18:33:56 click==8.3.0 18:33:56 cliff==4.11.0 18:33:56 cmd2==2.7.0 18:33:56 cryptography==3.3.2 18:33:56 debtcollector==3.0.0 18:33:56 decorator==5.2.1 18:33:56 defusedxml==0.7.1 18:33:56 Deprecated==1.2.18 18:33:56 distlib==0.4.0 18:33:56 dnspython==2.8.0 18:33:56 docker==7.1.0 18:33:56 dogpile.cache==1.4.1 18:33:56 durationpy==0.10 18:33:56 email-validator==2.3.0 18:33:56 filelock==3.19.1 18:33:56 future==1.0.0 18:33:56 gitdb==4.0.12 18:33:56 GitPython==3.1.45 18:33:56 google-auth==2.40.3 18:33:56 httplib2==0.31.0 18:33:56 identify==2.6.14 18:33:56 idna==3.10 18:33:56 importlib-resources==1.5.0 18:33:56 iso8601==2.1.0 18:33:56 Jinja2==3.1.6 18:33:56 jmespath==1.0.1 18:33:56 jsonpatch==1.33 18:33:56 jsonpointer==3.0.0 18:33:56 jsonschema==4.25.1 18:33:56 jsonschema-specifications==2025.9.1 18:33:56 keystoneauth1==5.12.0 18:33:56 kubernetes==33.1.0 18:33:56 lftools==0.37.14 18:33:56 lxml==6.0.2 18:33:56 markdown-it-py==4.0.0 18:33:56 MarkupSafe==3.0.2 18:33:56 mdurl==0.1.2 18:33:56 msgpack==1.1.1 18:33:56 multi_key_dict==2.0.3 18:33:56 munch==4.0.0 18:33:56 netaddr==1.3.0 18:33:56 niet==1.4.2 18:33:56 nodeenv==1.9.1 18:33:56 oauth2client==4.1.3 18:33:56 oauthlib==3.3.1 18:33:56 openstacksdk==4.7.1 18:33:56 os-service-types==1.8.0 18:33:56 osc-lib==4.2.0 18:33:56 oslo.config==10.0.0 18:33:56 oslo.context==6.1.0 18:33:56 oslo.i18n==6.6.0 18:33:56 oslo.log==7.2.1 18:33:56 oslo.serialization==5.8.0 18:33:56 oslo.utils==9.1.0 18:33:56 packaging==25.0 18:33:56 pbr==7.0.1 18:33:56 platformdirs==4.4.0 18:33:56 prettytable==3.16.0 18:33:56 psutil==7.1.0 18:33:56 pyasn1==0.6.1 18:33:56 pyasn1_modules==0.4.2 18:33:56 pycparser==2.23 18:33:56 pygerrit2==2.0.15 18:33:56 PyGithub==2.8.1 18:33:56 Pygments==2.19.2 18:33:56 PyJWT==2.10.1 18:33:56 PyNaCl==1.6.0 18:33:56 pyparsing==2.4.7 18:33:56 pyperclip==1.11.0 18:33:56 pyrsistent==0.20.0 18:33:56 python-cinderclient==9.8.0 18:33:56 python-dateutil==2.9.0.post0 18:33:56 python-heatclient==4.3.0 18:33:56 python-jenkins==1.8.3 18:33:56 python-keystoneclient==5.7.0 18:33:56 python-magnumclient==4.9.0 18:33:56 python-openstackclient==8.2.0 18:33:56 python-swiftclient==4.8.0 18:33:56 PyYAML==6.0.3 18:33:56 referencing==0.36.2 18:33:56 requests==2.32.5 18:33:56 requests-oauthlib==2.0.0 18:33:56 requestsexceptions==1.4.0 18:33:56 rfc3986==2.0.0 18:33:56 rich==14.1.0 18:33:56 rich-argparse==1.7.1 18:33:56 rpds-py==0.27.1 18:33:56 rsa==4.9.1 18:33:56 ruamel.yaml==0.18.15 18:33:56 ruamel.yaml.clib==0.2.14 18:33:56 s3transfer==0.14.0 18:33:56 simplejson==3.20.2 18:33:56 six==1.17.0 18:33:56 smmap==5.0.2 18:33:56 soupsieve==2.8 18:33:56 stevedore==5.5.0 18:33:56 tabulate==0.9.0 18:33:56 toml==0.10.2 18:33:56 tomlkit==0.13.3 18:33:56 tqdm==4.67.1 18:33:56 typing_extensions==4.15.0 18:33:56 tzdata==2025.2 18:33:56 urllib3==1.26.20 18:33:56 virtualenv==20.34.0 18:33:56 wcwidth==0.2.14 18:33:56 websocket-client==1.8.0 18:33:56 wrapt==1.17.3 18:33:56 xdg==6.0.0 18:33:56 xmltodict==1.0.2 18:33:56 yq==3.4.3 18:33:56 [EnvInject] - Injecting environment variables from a build step. 18:33:56 [EnvInject] - Injecting as environment variables the properties content 18:33:56 OS_CLOUD=vex 18:33:56 18:33:56 [EnvInject] - Variables injected successfully. 18:33:56 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 18:33:56 Run condition [Boolean condition] enabling perform for step [Execute shell] 18:33:56 [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins17154549702683585622.sh 18:33:56 ---> Orphaned k8s clusters 18:33:56 Setup pyenv: 18:33:56 system 18:33:56 3.8.13 18:33:56 3.9.13 18:33:56 3.10.13 18:33:56 * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version) 18:33:56 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-ZFGF from file:/tmp/.os_lf_venv 18:33:56 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 18:33:56 lf-activate-venv(): INFO: Attempting to install with network-safe options... 18:33:58 lf-activate-venv(): INFO: Base packages installed successfully 18:33:58 lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 18:34:05 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 18:34:05 lftools 0.37.14 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible. 18:34:06 lf-activate-venv(): INFO: Adding /tmp/venv-ZFGF/bin to PATH 18:34:10 -----> Delete orphaned cluster 18:34:10 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 18:34:10 Run condition [Boolean condition] enabling perform for step [Execute shell] 18:34:10 [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins3896754789037973502.sh 18:34:10 ---> Orphaned stacks 18:34:10 Setup pyenv: 18:34:11 system 18:34:11 3.8.13 18:34:11 3.9.13 18:34:11 3.10.13 18:34:11 * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version) 18:34:11 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-ZFGF from file:/tmp/.os_lf_venv 18:34:11 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 18:34:11 lf-activate-venv(): INFO: Attempting to install with network-safe options... 18:34:13 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 18:34:13 lftools 0.37.14 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible. 18:34:13 lf-activate-venv(): INFO: Base packages installed successfully 18:34:13 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 18:34:32 lf-activate-venv(): INFO: Adding /tmp/venv-ZFGF/bin to PATH 18:34:32 + mapfile -t OS_COE_CLUSTERS_ID 18:34:32 ++ awk '{print $1}' 18:34:32 ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name 18:34:32 ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)' 18:34:34 + echo '-----> Active clusters -> stacks' 18:34:34 -----> Active clusters -> stacks 18:34:34 + OS_COE_STACKS=() 18:34:34 + [[ 0 -gt 0 ]] 18:34:34 + mapfile -t OS_STACKS 18:34:34 ++ awk '{print $1}' 18:34:34 ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED 18:34:36 + echo '-----> Active stacks' 18:34:36 -----> Active stacks 18:34:36 + for stack in "${OS_STACKS[@]}" 18:34:36 + echo releng-openflowplugin-csit-1node-sanity-only-scandium-493 18:34:36 releng-openflowplugin-csit-1node-sanity-only-scandium-493 18:34:36 + echo '-----> Delete orphaned stacks' 18:34:36 -----> Delete orphaned stacks 18:34:36 + for STACK_NAME in "${OS_STACKS[@]}" 18:34:36 + [[ 0 -gt 0 ]] 18:34:36 + stack_in_jenkins releng-openflowplugin-csit-1node-sanity-only-scandium-493 https://jenkins.opendaylight.org/releng https://jenkins.opendaylight.org/sandbox 18:34:36 + STACK_NAME=releng-openflowplugin-csit-1node-sanity-only-scandium-493 18:34:36 + builds=() 18:34:36 + for jenkins in "${@:2}" 18:34:36 + PARAMS='tree=computer[executors[currentExecutable[url]],' 18:34:36 + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]' 18:34:36 + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 18:34:36 + JENKINS_URL='https://jenkins.opendaylight.org/releng/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 18:34:36 ++ curl -s -w '\n\n%{http_code}' --globoff -H Content-Type:application/json 'https://jenkins.opendaylight.org/releng/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 18:34:36 + resp='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/74031/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/aaa-maven-merge-master/2097/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/controller-maven-merge-11.0.x/171/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/transportpce-sonar/464/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/bgpcep-maven-merge-0.22.x/260/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.maven.MavenModuleSetBuild","url":"https://jenkins.opendaylight.org/releng/job/distribution-merge-managed-scandium/2706/"}}],"oneOffExecutors":[]}]} 18:34:36 18:34:36 200' 18:34:36 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/74031/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/aaa-maven-merge-master/2097/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/controller-maven-merge-11.0.x/171/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/transportpce-sonar/464/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/bgpcep-maven-merge-0.22.x/260/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.maven.MavenModuleSetBuild","url":"https://jenkins.opendaylight.org/releng/job/distribution-merge-managed-scandium/2706/"}}],"oneOffExecutors":[]}]} 18:34:36 18:34:36 200' 18:34:36 ++ head -n1 18:34:36 + json_data='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/74031/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/aaa-maven-merge-master/2097/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/controller-maven-merge-11.0.x/171/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/transportpce-sonar/464/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/bgpcep-maven-merge-0.22.x/260/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.maven.MavenModuleSetBuild","url":"https://jenkins.opendaylight.org/releng/job/distribution-merge-managed-scandium/2706/"}}],"oneOffExecutors":[]}]}' 18:34:36 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/74031/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/aaa-maven-merge-master/2097/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/controller-maven-merge-11.0.x/171/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/transportpce-sonar/464/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/bgpcep-maven-merge-0.22.x/260/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.maven.MavenModuleSetBuild","url":"https://jenkins.opendaylight.org/releng/job/distribution-merge-managed-scandium/2706/"}}],"oneOffExecutors":[]}]} 18:34:36 18:34:36 200' 18:34:36 ++ awk 'END {print $NF}' 18:34:36 + status=200 18:34:36 + '[' 200 '!=' 200 ']' 18:34:36 + [[ https://jenkins.opendaylight.org/releng == *\j\e\n\k\i\n\s\.*\.\o\r\g ]] 18:34:36 + [[ https://jenkins.opendaylight.org/releng == *\j\e\n\k\i\n\s\.*\.\i\o ]] 18:34:36 ++ echo https://jenkins.opendaylight.org/releng 18:34:36 ++ sed 's/\/*$//' 18:34:36 ++ awk -F/ '{print $NF}' 18:34:36 + silo=releng 18:34:36 + export silo 18:34:36 + builds=(${builds[@]} $(echo "$json_data" | jq -r '.computer[].executors[].currentExecutable.url' | grep -v null | awk -F'/' '{print ENVIRON["silo"] "-" $6 "-" $7}')) 18:34:36 ++ awk -F/ '{print ENVIRON["silo"] "-" $6 "-" $7}' 18:34:36 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/74031/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/aaa-maven-merge-master/2097/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/controller-maven-merge-11.0.x/171/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/transportpce-sonar/464/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/bgpcep-maven-merge-0.22.x/260/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.maven.MavenModuleSetBuild","url":"https://jenkins.opendaylight.org/releng/job/distribution-merge-managed-scandium/2706/"}}],"oneOffExecutors":[]}]}' 18:34:36 ++ jq -r '.computer[].executors[].currentExecutable.url' 18:34:36 ++ grep -v null 18:34:36 + for jenkins in "${@:2}" 18:34:36 + PARAMS='tree=computer[executors[currentExecutable[url]],' 18:34:36 + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]' 18:34:36 + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 18:34:36 + JENKINS_URL='https://jenkins.opendaylight.org/sandbox/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 18:34:36 ++ curl -s -w '\n\n%{http_code}' --globoff -H Content-Type:application/json 'https://jenkins.opendaylight.org/sandbox/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 18:34:36 + resp='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]} 18:34:36 18:34:36 200' 18:34:36 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]} 18:34:36 18:34:36 200' 18:34:36 ++ head -n1 18:34:36 + json_data='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}' 18:34:36 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]} 18:34:36 18:34:36 200' 18:34:36 ++ awk 'END {print $NF}' 18:34:36 + status=200 18:34:36 + '[' 200 '!=' 200 ']' 18:34:36 + [[ https://jenkins.opendaylight.org/sandbox == *\j\e\n\k\i\n\s\.*\.\o\r\g ]] 18:34:36 + [[ https://jenkins.opendaylight.org/sandbox == *\j\e\n\k\i\n\s\.*\.\i\o ]] 18:34:36 ++ echo https://jenkins.opendaylight.org/sandbox 18:34:36 ++ sed 's/\/*$//' 18:34:36 ++ awk -F/ '{print $NF}' 18:34:36 + silo=sandbox 18:34:36 + export silo 18:34:36 + builds=(${builds[@]} $(echo "$json_data" | jq -r '.computer[].executors[].currentExecutable.url' | grep -v null | awk -F'/' '{print ENVIRON["silo"] "-" $6 "-" $7}')) 18:34:36 ++ awk -F/ '{print ENVIRON["silo"] "-" $6 "-" $7}' 18:34:36 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}' 18:34:36 ++ jq -r '.computer[].executors[].currentExecutable.url' 18:34:36 ++ grep -v null 18:34:36 + [[ releng-builder-openstack-cron-74031 releng-openflowplugin-csit-1node-sanity-only-scandium-493 releng-integration-sanity-test-scandium-498 releng-aaa-maven-merge-master-2097 releng-controller-maven-merge-11.0.x-171 releng-transportpce-sonar-464 releng-bgpcep-maven-merge-0.22.x-260 releng-distribution-merge-managed-scandium-2706 =~ releng-openflowplugin-csit-1node-sanity-only-scandium-493 ]] 18:34:36 + return 0 18:34:36 + continue 18:34:36 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 18:34:36 Run condition [Boolean condition] enabling perform for step [Execute shell] 18:34:36 [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins9745445931742130334.sh 18:34:36 ---> Orphaned servers 18:34:36 Setup pyenv: 18:34:36 system 18:34:36 3.8.13 18:34:36 3.9.13 18:34:36 3.10.13 18:34:36 * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version) 18:34:37 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-ZFGF from file:/tmp/.os_lf_venv 18:34:37 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 18:34:37 lf-activate-venv(): INFO: Attempting to install with network-safe options... 18:34:38 lf-activate-venv(): INFO: Base packages installed successfully 18:34:38 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 18:34:53 lf-activate-venv(): INFO: Adding /tmp/venv-ZFGF/bin to PATH 18:35:00 -----> Active servers 18:35:00 prd-centos8-builder-2c-2g-1817 18:35:00 prd-ubuntu2204-docker-8c-8g-1816 18:35:00 prd-ubuntu2204-docker-2c-2g-1815 18:35:00 prd-ubuntu2204-docker-4c-4g-1814 18:35:00 prd-ubuntu2204-docker-4c-4g-1813 18:35:00 prd-ubuntu2204-docker-8c-8g-1810 18:35:00 prd-ubuntu2204-docker-4c-4g-1799 18:35:00 prd-centos8-robot-2c-8g-1728 18:35:00 prd-centos8-robot-2c-8g-1727 18:35:00 prd-centos8-robot-2c-8g-1726 18:35:00 prd-centos8-robot-2c-8g-773 18:35:00 prd-queue-intque-2c-1g-772 18:35:00 -----> Delete orphaned servers 18:35:01 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 18:35:01 Run condition [Boolean condition] enabling perform for step [Execute shell] 18:35:01 [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins10461784298623726968.sh 18:35:01 ---> Orphaned ports 18:35:01 Setup pyenv: 18:35:01 system 18:35:01 3.8.13 18:35:01 3.9.13 18:35:01 3.10.13 18:35:01 * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version) 18:35:01 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-ZFGF from file:/tmp/.os_lf_venv 18:35:01 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 18:35:01 lf-activate-venv(): INFO: Attempting to install with network-safe options... 18:35:03 lf-activate-venv(): INFO: Base packages installed successfully 18:35:03 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] python-openstackclient 18:35:16 lf-activate-venv(): INFO: Adding /tmp/venv-ZFGF/bin to PATH 18:35:17 No orphaned ports to process. 18:35:17 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 18:35:17 Run condition [Boolean condition] enabling perform for step [Execute shell] 18:35:17 [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins1979261533097380900.sh 18:35:17 ---> Orphaned volumes 18:35:17 + source /home/jenkins/lf-env.sh 18:35:17 + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 18:35:17 ++ mktemp -d /tmp/venv-XXXX 18:35:17 + lf_venv=/tmp/venv-8Gp7 18:35:17 + local venv_file=/tmp/.os_lf_venv 18:35:17 + local python=python3 18:35:17 + local options 18:35:17 + local set_path=true 18:35:17 + local install_args= 18:35:17 ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 18:35:17 + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\''' 18:35:17 + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\''' 18:35:17 ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 18:35:17 + true 18:35:17 + case $1 in 18:35:17 + python=python3 18:35:17 + shift 2 18:35:17 + true 18:35:17 + case $1 in 18:35:17 + shift 18:35:17 + break 18:35:17 + case $python in 18:35:17 + local pkg_list= 18:35:17 + [[ -d /opt/pyenv ]] 18:35:17 + echo 'Setup pyenv:' 18:35:17 Setup pyenv: 18:35:17 + export PYENV_ROOT=/opt/pyenv 18:35:17 + PYENV_ROOT=/opt/pyenv 18:35:17 + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin 18:35:17 + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin 18:35:17 + pyenv versions 18:35:18 system 18:35:18 3.8.13 18:35:18 3.9.13 18:35:18 3.10.13 18:35:18 * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version) 18:35:18 + command -v pyenv 18:35:18 ++ pyenv init - --no-rehash 18:35:18 + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); 18:35:18 for i in ${!paths[@]}; do 18:35:18 if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; 18:35:18 fi; done; 18:35:18 echo "${paths[*]}"'\'')" 18:35:18 export PATH="/opt/pyenv/shims:${PATH}" 18:35:18 export PYENV_SHELL=bash 18:35:18 source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\'' 18:35:18 pyenv() { 18:35:18 local command 18:35:18 command="${1:-}" 18:35:18 if [ "$#" -gt 0 ]; then 18:35:18 shift 18:35:18 fi 18:35:18 18:35:18 case "$command" in 18:35:18 rehash|shell) 18:35:18 eval "$(pyenv "sh-$command" "$@")" 18:35:18 ;; 18:35:18 *) 18:35:18 command pyenv "$command" "$@" 18:35:18 ;; 18:35:18 esac 18:35:18 }' 18:35:18 +++ bash --norc -ec 'IFS=:; paths=($PATH); 18:35:18 for i in ${!paths[@]}; do 18:35:18 if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; 18:35:18 fi; done; 18:35:18 echo "${paths[*]}"' 18:35:18 ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin 18:35:18 ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin 18:35:18 ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin 18:35:18 ++ export PYENV_SHELL=bash 18:35:18 ++ PYENV_SHELL=bash 18:35:18 ++ source /opt/pyenv/libexec/../completions/pyenv.bash 18:35:18 +++ complete -F _pyenv pyenv 18:35:18 ++ lf-pyver python3 18:35:18 ++ local py_version_xy=python3 18:35:18 ++ local py_version_xyz= 18:35:18 ++ awk '{ print $1 }' 18:35:18 ++ pyenv versions 18:35:18 ++ local command 18:35:18 ++ command=versions 18:35:18 ++ '[' 1 -gt 0 ']' 18:35:18 ++ shift 18:35:18 ++ case "$command" in 18:35:18 ++ command pyenv versions 18:35:18 ++ pyenv versions 18:35:18 ++ sed 's/^[ *]* //' 18:35:18 ++ grep -E '^[0-9.]*[0-9]$' 18:35:18 ++ [[ ! -s /tmp/.pyenv_versions ]] 18:35:18 +++ sort -V 18:35:18 +++ grep '^3' /tmp/.pyenv_versions 18:35:18 +++ tail -n 1 18:35:18 ++ py_version_xyz=3.11.7 18:35:18 ++ [[ -z 3.11.7 ]] 18:35:18 ++ echo 3.11.7 18:35:18 ++ return 0 18:35:18 + pyenv local 3.11.7 18:35:18 + local command 18:35:18 + command=local 18:35:18 + '[' 2 -gt 0 ']' 18:35:18 + shift 18:35:18 + case "$command" in 18:35:18 + command pyenv local 3.11.7 18:35:18 + pyenv local 3.11.7 18:35:18 + for arg in "$@" 18:35:18 + case $arg in 18:35:18 + pkg_list+='lftools[openstack] ' 18:35:18 + for arg in "$@" 18:35:18 + case $arg in 18:35:18 + pkg_list+='kubernetes ' 18:35:18 + for arg in "$@" 18:35:18 + case $arg in 18:35:18 + pkg_list+='niet ' 18:35:18 + for arg in "$@" 18:35:18 + case $arg in 18:35:18 + pkg_list+='python-heatclient ' 18:35:18 + for arg in "$@" 18:35:18 + case $arg in 18:35:18 + pkg_list+='python-openstackclient ' 18:35:18 + for arg in "$@" 18:35:18 + case $arg in 18:35:18 + pkg_list+='python-magnumclient ' 18:35:18 + for arg in "$@" 18:35:18 + case $arg in 18:35:18 + pkg_list+='yq ' 18:35:18 + [[ -f /tmp/.os_lf_venv ]] 18:35:18 ++ cat /tmp/.os_lf_venv 18:35:18 + lf_venv=/tmp/venv-ZFGF 18:35:18 + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-ZFGF from' file:/tmp/.os_lf_venv 18:35:18 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-ZFGF from file:/tmp/.os_lf_venv 18:35:18 + echo 'lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)' 18:35:18 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 18:35:18 + local 'pip_opts=--upgrade --quiet' 18:35:18 + pip_opts='--upgrade --quiet --trusted-host pypi.org' 18:35:18 + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org' 18:35:18 + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org' 18:35:18 + [[ -n '' ]] 18:35:18 + [[ -n '' ]] 18:35:18 + echo 'lf-activate-venv(): INFO: Attempting to install with network-safe options...' 18:35:18 lf-activate-venv(): INFO: Attempting to install with network-safe options... 18:35:18 + /tmp/venv-ZFGF/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org pip 'setuptools<66' virtualenv 18:35:20 + echo 'lf-activate-venv(): INFO: Base packages installed successfully' 18:35:20 lf-activate-venv(): INFO: Base packages installed successfully 18:35:20 + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ]] 18:35:20 + echo 'lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ' 18:35:20 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 18:35:20 + /tmp/venv-ZFGF/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 18:35:37 + type python3 18:35:37 + true 18:35:37 + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-ZFGF/bin to PATH' 18:35:37 lf-activate-venv(): INFO: Adding /tmp/venv-ZFGF/bin to PATH 18:35:37 + PATH=/tmp/venv-ZFGF/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin 18:35:37 + return 0 18:35:37 + mapfile -t os_volumes 18:35:37 ++ openstack --os-cloud vex volume list -f value -c ID --status Available 18:35:40 + '[' 0 -eq 0 ']' 18:35:40 + echo 'No orphaned volumes found.' 18:35:40 No orphaned volumes found. 18:35:40 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 18:35:40 Run condition [Boolean condition] enabling perform for step [Execute shell] 18:35:40 [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins14609629550686309323.sh 18:35:40 ---> Protect in-use images 18:35:40 Setup pyenv: 18:35:40 system 18:35:40 3.8.13 18:35:40 3.9.13 18:35:40 3.10.13 18:35:40 * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version) 18:35:40 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-ZFGF from file:/tmp/.os_lf_venv 18:35:40 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 18:35:40 lf-activate-venv(): INFO: Attempting to install with network-safe options... 18:35:42 lf-activate-venv(): INFO: Base packages installed successfully 18:35:42 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient 18:35:55 lf-activate-venv(): INFO: Adding /tmp/venv-ZFGF/bin to PATH 18:35:55 INFO: There are images to protect defined in jenkins-config. 18:35:55 INFO: There are additional images to protect in the jjb dir. 18:35:55 INFO: Protecting the following images: 18:35:55 ZZCI - CentOS 7 - builder - x86_64 - 20240701-060130.538 18:35:55 ZZCI - CentOS 7 - devstack-rocky - x86_64 - 20221101-000109.537" # Unused 18:35:55 ZZCI - CentOS 7 - devstack-stein - x86_64 - 20221101-010107.368" # Unused 18:35:55 ZZCI - CentOS 7 - devstack - x86_64 - 20240601-230133.464" # Unused 18:35:55 ZZCI - CentOS 7 - docker - x86_64 - 20240601-220142.195 18:35:55 ZZCI - CentOS 7 - helm - x86_64 - 20230301-000133.034 18:35:55 ZZCI - CentOS 7 - robot - x86_64 - 20240601-220241.858 18:35:55 ZZCI - CentOS Stream 8 - builder - x86_64 - 20240601-160217.263 18:35:55 ZZCI - CentOS Stream 8 - robot - x86_64 - 20240601-010231.803 18:35:55 ZZCI - Ubuntu 18.04 - docker - x86_64 - 20250201-040221.796 18:35:55 ZZCI - Ubuntu 18.04 - helm - x86_64 - 20230301-140059.950 18:35:55 ZZCI - Ubuntu 20.04 - docker - x86_64 - 20250201-160239.450 18:35:55 ZZCI - Ubuntu 22.04 - builder - x86_64 - 20250201-010426.857 18:35:55 ZZCI - Ubuntu 22.04 - devstack - x86_64 - 20231031-095146.118" # Unused 18:35:55 ZZCI - Ubuntu 22.04 - docker - x86_64 - 20250201-170115.786 18:35:55 ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 - 20250201-060151.911 18:35:57 Protected setting for ZZCI - CentOS 7 - builder - x86_64 - 20240701-060130.538: True 18:35:59 No Image found for ZZCI - CentOS 7 - devstack-rocky - x86_64 - 20221101-000109.537" # Unused 18:35:59 Build step 'Conditional step (single)' marked build as failure 18:35:59 $ ssh-agent -k 18:35:59 unset SSH_AUTH_SOCK; 18:35:59 unset SSH_AGENT_PID; 18:35:59 echo Agent pid 5445 killed; 18:35:59 [ssh-agent] Stopped. 18:35:59 [PostBuildScript] - [INFO] Executing post build scripts. 18:35:59 [builder-openstack-cron] $ /bin/bash /tmp/jenkins5444978894257382937.sh 18:35:59 ---> sysstat.sh 18:35:59 [builder-openstack-cron] $ /bin/bash /tmp/jenkins6660083562632113948.sh 18:35:59 ---> package-listing.sh 18:35:59 ++ tr '[:upper:]' '[:lower:]' 18:35:59 ++ facter osfamily 18:35:59 + OS_FAMILY=redhat 18:35:59 + workspace=/w/workspace/builder-openstack-cron 18:35:59 + START_PACKAGES=/tmp/packages_start.txt 18:35:59 + END_PACKAGES=/tmp/packages_end.txt 18:35:59 + DIFF_PACKAGES=/tmp/packages_diff.txt 18:35:59 + PACKAGES=/tmp/packages_start.txt 18:35:59 + '[' /w/workspace/builder-openstack-cron ']' 18:35:59 + PACKAGES=/tmp/packages_end.txt 18:35:59 + case "${OS_FAMILY}" in 18:35:59 + rpm -qa 18:35:59 + sort 18:36:00 + '[' -f /tmp/packages_start.txt ']' 18:36:00 + '[' -f /tmp/packages_end.txt ']' 18:36:00 + diff /tmp/packages_start.txt /tmp/packages_end.txt 18:36:00 + '[' /w/workspace/builder-openstack-cron ']' 18:36:00 + mkdir -p /w/workspace/builder-openstack-cron/archives/ 18:36:00 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/builder-openstack-cron/archives/ 18:36:00 [builder-openstack-cron] $ /bin/bash /tmp/jenkins18253247127902198960.sh 18:36:00 ---> capture-instance-metadata.sh 18:36:00 Setup pyenv: 18:36:00 system 18:36:00 3.8.13 18:36:00 3.9.13 18:36:00 3.10.13 18:36:00 * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version) 18:36:00 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-ZFGF from file:/tmp/.os_lf_venv 18:36:00 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 18:36:00 lf-activate-venv(): INFO: Attempting to install with network-safe options... 18:36:02 lf-activate-venv(): INFO: Base packages installed successfully 18:36:02 lf-activate-venv(): INFO: Installing additional packages: lftools 18:36:12 lf-activate-venv(): INFO: Adding /tmp/venv-ZFGF/bin to PATH 18:36:12 INFO: Running in OpenStack, capturing instance metadata 18:36:12 [builder-openstack-cron] $ /bin/bash /tmp/jenkins14474844785322441240.sh 18:36:12 provisioning config files... 18:36:12 Could not find credentials [logs] for builder-openstack-cron #74031 18:36:12 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/builder-openstack-cron@tmp/config17277793378803680284tmp 18:36:12 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] 18:36:12 Run condition [Regular expression match] enabling perform for step [Provide Configuration files] 18:36:12 provisioning config files... 18:36:12 copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials 18:36:12 [EnvInject] - Injecting environment variables from a build step. 18:36:12 [EnvInject] - Injecting as environment variables the properties content 18:36:12 SERVER_ID=logs 18:36:12 18:36:12 [EnvInject] - Variables injected successfully. 18:36:12 [builder-openstack-cron] $ /bin/bash /tmp/jenkins15610169484943613923.sh 18:36:12 ---> create-netrc.sh 18:36:12 WARN: Log server credential not found. 18:36:12 [builder-openstack-cron] $ /bin/bash /tmp/jenkins18290205014666685054.sh 18:36:12 ---> python-tools-install.sh 18:36:12 Setup pyenv: 18:36:12 system 18:36:12 3.8.13 18:36:12 3.9.13 18:36:12 3.10.13 18:36:13 * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version) 18:36:13 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-ZFGF from file:/tmp/.os_lf_venv 18:36:13 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 18:36:13 lf-activate-venv(): INFO: Attempting to install with network-safe options... 18:36:15 lf-activate-venv(): INFO: Base packages installed successfully 18:36:15 lf-activate-venv(): INFO: Installing additional packages: lftools 18:36:24 lf-activate-venv(): INFO: Adding /tmp/venv-ZFGF/bin to PATH 18:36:24 [builder-openstack-cron] $ /bin/bash /tmp/jenkins7711474092462414527.sh 18:36:24 ---> sudo-logs.sh 18:36:24 Archiving 'sudo' log.. 18:36:24 [builder-openstack-cron] $ /bin/bash /tmp/jenkins13545111297717482104.sh 18:36:24 ---> job-cost.sh 18:36:24 Setup pyenv: 18:36:25 system 18:36:25 3.8.13 18:36:25 3.9.13 18:36:25 3.10.13 18:36:25 * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version) 18:36:25 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-ZFGF from file:/tmp/.os_lf_venv 18:36:25 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 18:36:25 lf-activate-venv(): INFO: Attempting to install with network-safe options... 18:36:27 lf-activate-venv(): INFO: Base packages installed successfully 18:36:27 lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 18:36:34 lf-activate-venv(): INFO: Adding /tmp/venv-ZFGF/bin to PATH 18:36:34 INFO: No Stack... 18:36:35 INFO: Retrieving Pricing Info for: v3-standard-2 18:36:35 INFO: Archiving Costs 18:36:35 [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins3163065443762274773.sh 18:36:35 ---> logs-deploy.sh 18:36:35 Setup pyenv: 18:36:35 system 18:36:35 3.8.13 18:36:35 3.9.13 18:36:35 3.10.13 18:36:35 * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version) 18:36:35 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-ZFGF from file:/tmp/.os_lf_venv 18:36:35 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 18:36:35 lf-activate-venv(): INFO: Attempting to install with network-safe options... 18:36:37 lf-activate-venv(): INFO: Base packages installed successfully 18:36:37 lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 18:36:49 lf-activate-venv(): INFO: Adding /tmp/venv-ZFGF/bin to PATH 18:36:49 WARNING: Nexus logging server not set 18:36:49 INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/builder-openstack-cron/74031/ 18:36:49 INFO: archiving logs to S3 18:36:51 ---> uname -a: 18:36:51 Linux prd-centos8-builder-2c-2g-1817.novalocal 4.18.0-553.5.1.el8.x86_64 #1 SMP Tue May 21 05:46:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux 18:36:51 18:36:51 18:36:51 ---> lscpu: 18:36:51 Architecture: x86_64 18:36:51 CPU op-mode(s): 32-bit, 64-bit 18:36:51 Byte Order: Little Endian 18:36:51 CPU(s): 2 18:36:51 On-line CPU(s) list: 0,1 18:36:51 Thread(s) per core: 1 18:36:51 Core(s) per socket: 1 18:36:51 Socket(s): 2 18:36:51 NUMA node(s): 1 18:36:51 Vendor ID: AuthenticAMD 18:36:51 CPU family: 23 18:36:51 Model: 49 18:36:51 Model name: AMD EPYC-Rome Processor 18:36:51 Stepping: 0 18:36:51 CPU MHz: 2799.998 18:36:51 BogoMIPS: 5599.99 18:36:51 Virtualization: AMD-V 18:36:51 Hypervisor vendor: KVM 18:36:51 Virtualization type: full 18:36:51 L1d cache: 32K 18:36:51 L1i cache: 32K 18:36:51 L2 cache: 512K 18:36:51 L3 cache: 16384K 18:36:51 NUMA node0 CPU(s): 0,1 18:36:51 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities 18:36:51 18:36:51 18:36:51 ---> nproc: 18:36:51 2 18:36:51 18:36:51 18:36:51 ---> df -h: 18:36:51 Filesystem Size Used Avail Use% Mounted on 18:36:51 devtmpfs 3.8G 0 3.8G 0% /dev 18:36:51 tmpfs 3.8G 0 3.8G 0% /dev/shm 18:36:51 tmpfs 3.8G 17M 3.8G 1% /run 18:36:51 tmpfs 3.8G 0 3.8G 0% /sys/fs/cgroup 18:36:51 /dev/vda1 40G 8.4G 32G 22% / 18:36:51 tmpfs 770M 0 770M 0% /run/user/1001 18:36:51 18:36:51 18:36:51 ---> free -m: 18:36:51 total used free shared buff/cache available 18:36:51 Mem: 7697 631 4800 19 2265 6768 18:36:51 Swap: 1023 0 1023 18:36:51 18:36:51 18:36:51 ---> ip addr: 18:36:51 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 18:36:51 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 18:36:51 inet 127.0.0.1/8 scope host lo 18:36:51 valid_lft forever preferred_lft forever 18:36:51 inet6 ::1/128 scope host 18:36:51 valid_lft forever preferred_lft forever 18:36:51 2: eth0: mtu 1458 qdisc mq state UP group default qlen 1000 18:36:51 link/ether fa:16:3e:81:e9:45 brd ff:ff:ff:ff:ff:ff 18:36:51 altname enp0s3 18:36:51 altname ens3 18:36:51 inet 10.30.171.233/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0 18:36:51 valid_lft 86117sec preferred_lft 86117sec 18:36:51 inet6 fe80::f816:3eff:fe81:e945/64 scope link 18:36:51 valid_lft forever preferred_lft forever 18:36:51 3: docker0: mtu 1458 qdisc noqueue state DOWN group default 18:36:51 link/ether 02:42:b3:d0:41:68 brd ff:ff:ff:ff:ff:ff 18:36:51 inet 10.250.0.254/24 brd 10.250.0.255 scope global docker0 18:36:51 valid_lft forever preferred_lft forever 18:36:51 18:36:51 18:36:51 ---> sar -b -r -n DEV: 18:36:51 Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-builder-5e6ee0fb-b6d9-4116-90d4-35c890e2b0f7.nov) 09/27/2025 _x86_64_ (2 CPU) 18:36:51 18:36:51 18:32:04 LINUX RESTART (2 CPU) 18:36:51 18:36:51 06:33:01 PM tps rtps wtps bread/s bwrtn/s 18:36:51 06:34:01 PM 120.93 0.62 120.31 22.93 10545.88 18:36:51 06:35:01 PM 57.56 0.68 56.87 103.72 6908.32 18:36:51 06:36:01 PM 32.57 0.17 32.41 13.33 1285.52 18:36:51 Average: 70.35 0.49 69.86 46.66 6246.30 18:36:51 18:36:51 06:33:01 PM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 18:36:51 06:34:01 PM 5008304 6974496 2874116 36.46 2688 2142848 952372 10.66 202148 2321872 143620 18:36:51 06:35:01 PM 5011860 7020636 2870560 36.42 2688 2184180 908056 10.17 233520 2282412 27764 18:36:51 06:36:01 PM 4973548 6984040 2908872 36.90 2688 2185924 945316 10.58 422992 2131020 12108 18:36:51 Average: 4997904 6993057 2884516 36.59 2688 2170984 935248 10.47 286220 2245101 61164 18:36:51 18:36:51 06:33:01 PM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 18:36:51 06:34:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 18:36:51 06:34:01 PM eth0 84.69 73.22 1058.63 9.79 0.00 0.00 0.00 0.00 18:36:51 06:34:01 PM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 18:36:51 06:35:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 18:36:51 06:35:01 PM eth0 61.46 52.42 604.04 10.42 0.00 0.00 0.00 0.00 18:36:51 06:35:01 PM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 18:36:51 06:36:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 18:36:51 06:36:01 PM eth0 20.29 20.16 16.53 13.85 0.00 0.00 0.00 0.00 18:36:51 06:36:01 PM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 18:36:51 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 18:36:51 Average: eth0 55.48 48.60 559.70 11.36 0.00 0.00 0.00 0.00 18:36:51 Average: docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 18:36:51 18:36:51 18:36:51 ---> sar -P ALL: 18:36:51 Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-builder-5e6ee0fb-b6d9-4116-90d4-35c890e2b0f7.nov) 09/27/2025 _x86_64_ (2 CPU) 18:36:51 18:36:51 18:32:04 LINUX RESTART (2 CPU) 18:36:51 18:36:51 06:33:01 PM CPU %user %nice %system %iowait %steal %idle 18:36:51 06:34:01 PM all 35.43 0.00 5.34 1.17 0.10 57.95 18:36:51 06:34:01 PM 0 36.49 0.00 5.31 1.26 0.10 56.84 18:36:51 06:34:01 PM 1 34.37 0.00 5.38 1.08 0.10 59.06 18:36:51 06:35:01 PM all 31.55 0.00 4.36 0.62 0.08 63.39 18:36:51 06:35:01 PM 0 30.29 0.00 4.06 0.40 0.08 65.16 18:36:51 06:35:01 PM 1 32.80 0.00 4.66 0.83 0.08 61.62 18:36:51 06:36:01 PM all 36.36 0.00 3.75 0.17 0.08 59.64 18:36:51 06:36:01 PM 0 44.25 0.00 4.00 0.15 0.08 51.52 18:36:51 06:36:01 PM 1 28.46 0.00 3.50 0.20 0.08 67.76 18:36:51 Average: all 34.45 0.00 4.48 0.66 0.09 60.33 18:36:51 Average: 0 37.01 0.00 4.46 0.60 0.09 57.84 18:36:51 Average: 1 31.88 0.00 4.51 0.71 0.09 62.81 18:36:51 18:36:51 18:36:51