06:32:05  Started by timer
06:32:05  Running as SYSTEM
06:32:05  [EnvInject] - Loading node environment variables.
06:32:06  Building remotely on prd-centos8-builder-2c-2g-1435 (centos8-builder-2c-2g) in workspace /w/workspace/builder-openstack-cron
06:32:06  [ssh-agent] Looking for ssh-agent implementation...
06:32:06  [ssh-agent]   Exec ssh-agent (binary ssh-agent on a remote machine)
06:32:06  $ ssh-agent
06:32:06  SSH_AUTH_SOCK=/tmp/ssh-vawCeEtMOLGE/agent.5452
06:32:06  SSH_AGENT_PID=5453
06:32:06  [ssh-agent] Started.
06:32:06  Running ssh-add (command line suppressed)
06:32:06  Identity added: /w/workspace/builder-openstack-cron@tmp/private_key_17838903435086985497.key (/w/workspace/builder-openstack-cron@tmp/private_key_17838903435086985497.key)
06:32:06  [ssh-agent] Using credentials jenkins (jenkins-ssh)
06:32:06  The recommended git tool is: NONE
06:32:09  using credential jenkins-ssh
06:32:09  Wiping out workspace first.
06:32:09  Cloning the remote Git repository
06:32:09  Cloning repository git://devvexx.opendaylight.org/mirror/releng/builder
06:32:09   > git init /w/workspace/builder-openstack-cron # timeout=10
06:32:09  Fetching upstream changes from git://devvexx.opendaylight.org/mirror/releng/builder
06:32:09   > git --version # timeout=10
06:32:09   > git --version # 'git version 2.43.0'
06:32:09  using GIT_SSH to set credentials jenkins-ssh
06:32:09  [INFO] Currently running in a labeled security context
06:32:09  [INFO] Currently SELinux is 'enforcing' on the host
06:32:09   > /usr/bin/chcon --type=ssh_home_t /w/workspace/builder-openstack-cron@tmp/jenkins-gitclient-ssh841410171538740626.key
06:32:09  Verifying host key using known hosts file
06:32:09  You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
06:32:09   > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/releng/builder +refs/heads/*:refs/remotes/origin/* # timeout=10
06:32:11   > git config remote.origin.url git://devvexx.opendaylight.org/mirror/releng/builder # timeout=10
06:32:11   > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
06:32:12  Avoid second fetch
06:32:12   > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
06:32:12  Checking out Revision 6cd405ccab649fcd7832ee14748bdee1c721ff40 (refs/remotes/origin/master)
06:32:12   > git config core.sparsecheckout # timeout=10
06:32:12   > git checkout -f 6cd405ccab649fcd7832ee14748bdee1c721ff40 # timeout=10
06:32:12  Commit message: "Chore: Update global-jjb to the latest v0.92.5"
06:32:12   > git rev-list --no-walk 6cd405ccab649fcd7832ee14748bdee1c721ff40 # timeout=10
06:32:12   > git remote # timeout=10
06:32:12   > git submodule init # timeout=10
06:32:12   > git submodule sync # timeout=10
06:32:12   > git config --get remote.origin.url # timeout=10
06:32:12   > git submodule init # timeout=10
06:32:12   > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10
06:32:12   > git config --get submodule.global-jjb.url # timeout=10
06:32:12   > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10
06:32:12   > git config --get submodule.packer/common-packer.url # timeout=10
06:32:12   > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10
06:32:13   > git submodule update --init --recursive global-jjb # timeout=10
06:32:14   > git submodule update --init --recursive packer/common-packer # timeout=10
06:32:17  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
06:32:17  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
06:32:17  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
06:32:17  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
06:32:17  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
06:32:17  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
06:32:17  Run condition [Boolean condition] enabling prebuild for step [BuilderChain]
06:32:17  No emails were triggered.
06:32:17  provisioning config files...
06:32:18  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
06:32:18  copy managed file [npmrc] to file:/home/jenkins/.npmrc
06:32:18  copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
06:32:18  [builder-openstack-cron] $ /bin/bash /tmp/jenkins13173390072431164921.sh
06:32:18  ---> python-tools-install.sh
06:32:18  Setup pyenv:
06:32:18    system
06:32:18  * 3.8.13 (set by /opt/pyenv/version)
06:32:18  * 3.9.13 (set by /opt/pyenv/version)
06:32:18  * 3.10.13 (set by /opt/pyenv/version)
06:32:18  * 3.11.7 (set by /opt/pyenv/version)
06:32:22  lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-R1Vi
06:32:22  lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
06:32:22  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
06:32:22  lf-activate-venv(): INFO: Attempting to install with network-safe options...
06:32:27  lf-activate-venv(): INFO: Base packages installed successfully
06:32:27  lf-activate-venv(): INFO: Installing additional packages: lftools 
06:32:53  lf-activate-venv(): INFO: Adding /tmp/venv-R1Vi/bin to PATH
06:32:53  Generating Requirements File
06:33:14  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
06:33:14  httplib2 0.31.0 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible.
06:33:14  Python 3.11.7
06:33:14  pip 25.2 from /tmp/venv-R1Vi/lib/python3.11/site-packages/pip (python 3.11)
06:33:15  appdirs==1.4.4
06:33:15  argcomplete==3.6.2
06:33:15  aspy.yaml==1.3.0
06:33:15  attrs==25.3.0
06:33:15  autopage==0.5.2
06:33:15  beautifulsoup4==4.13.5
06:33:15  boto3==1.40.39
06:33:15  botocore==1.40.39
06:33:15  bs4==0.0.2
06:33:15  cachetools==5.5.2
06:33:15  certifi==2025.8.3
06:33:15  cffi==2.0.0
06:33:15  cfgv==3.4.0
06:33:15  chardet==5.2.0
06:33:15  charset-normalizer==3.4.3
06:33:15  click==8.3.0
06:33:15  cliff==4.11.0
06:33:15  cmd2==2.7.0
06:33:15  cryptography==3.3.2
06:33:15  debtcollector==3.0.0
06:33:15  decorator==5.2.1
06:33:15  defusedxml==0.7.1
06:33:15  Deprecated==1.2.18
06:33:15  distlib==0.4.0
06:33:15  dnspython==2.8.0
06:33:15  docker==7.1.0
06:33:15  dogpile.cache==1.4.1
06:33:15  durationpy==0.10
06:33:15  email-validator==2.3.0
06:33:15  filelock==3.19.1
06:33:15  future==1.0.0
06:33:15  gitdb==4.0.12
06:33:15  GitPython==3.1.45
06:33:15  google-auth==2.40.3
06:33:15  httplib2==0.31.0
06:33:15  identify==2.6.14
06:33:15  idna==3.10
06:33:15  importlib-resources==1.5.0
06:33:15  iso8601==2.1.0
06:33:15  Jinja2==3.1.6
06:33:15  jmespath==1.0.1
06:33:15  jsonpatch==1.33
06:33:15  jsonpointer==3.0.0
06:33:15  jsonschema==4.25.1
06:33:15  jsonschema-specifications==2025.9.1
06:33:15  keystoneauth1==5.12.0
06:33:15  kubernetes==33.1.0
06:33:15  lftools==0.37.14
06:33:15  lxml==6.0.2
06:33:15  markdown-it-py==4.0.0
06:33:15  MarkupSafe==3.0.2
06:33:15  mdurl==0.1.2
06:33:15  msgpack==1.1.1
06:33:15  multi_key_dict==2.0.3
06:33:15  munch==4.0.0
06:33:15  netaddr==1.3.0
06:33:15  niet==1.4.2
06:33:15  nodeenv==1.9.1
06:33:15  oauth2client==4.1.3
06:33:15  oauthlib==3.3.1
06:33:15  openstacksdk==4.7.1
06:33:15  os-service-types==1.8.0
06:33:15  osc-lib==4.2.0
06:33:15  oslo.config==10.0.0
06:33:15  oslo.context==6.1.0
06:33:15  oslo.i18n==6.6.0
06:33:15  oslo.log==7.2.1
06:33:15  oslo.serialization==5.8.0
06:33:15  oslo.utils==9.1.0
06:33:15  packaging==25.0
06:33:15  pbr==7.0.1
06:33:15  platformdirs==4.4.0
06:33:15  prettytable==3.16.0
06:33:15  psutil==7.1.0
06:33:15  pyasn1==0.6.1
06:33:15  pyasn1_modules==0.4.2
06:33:15  pycparser==2.23
06:33:15  pygerrit2==2.0.15
06:33:15  PyGithub==2.8.1
06:33:15  Pygments==2.19.2
06:33:15  PyJWT==2.10.1
06:33:15  PyNaCl==1.6.0
06:33:15  pyparsing==2.4.7
06:33:15  pyperclip==1.10.0
06:33:15  pyrsistent==0.20.0
06:33:15  python-cinderclient==9.8.0
06:33:15  python-dateutil==2.9.0.post0
06:33:15  python-heatclient==4.3.0
06:33:15  python-jenkins==1.8.3
06:33:15  python-keystoneclient==5.7.0
06:33:15  python-magnumclient==4.9.0
06:33:15  python-openstackclient==8.2.0
06:33:15  python-swiftclient==4.8.0
06:33:15  PyYAML==6.0.3
06:33:15  referencing==0.36.2
06:33:15  requests==2.32.5
06:33:15  requests-oauthlib==2.0.0
06:33:15  requestsexceptions==1.4.0
06:33:15  rfc3986==2.0.0
06:33:15  rich==14.1.0
06:33:15  rich-argparse==1.7.1
06:33:15  rpds-py==0.27.1
06:33:15  rsa==4.9.1
06:33:15  ruamel.yaml==0.18.15
06:33:15  ruamel.yaml.clib==0.2.14
06:33:15  s3transfer==0.14.0
06:33:15  simplejson==3.20.1
06:33:15  six==1.17.0
06:33:15  smmap==5.0.2
06:33:15  soupsieve==2.8
06:33:15  stevedore==5.5.0
06:33:15  tabulate==0.9.0
06:33:15  toml==0.10.2
06:33:15  tomlkit==0.13.3
06:33:15  tqdm==4.67.1
06:33:15  typing_extensions==4.15.0
06:33:15  tzdata==2025.2
06:33:15  urllib3==1.26.20
06:33:15  virtualenv==20.34.0
06:33:15  wcwidth==0.2.14
06:33:15  websocket-client==1.8.0
06:33:15  wrapt==1.17.3
06:33:15  xdg==6.0.0
06:33:15  xmltodict==1.0.2
06:33:15  yq==3.4.3
06:33:15  [EnvInject] - Injecting environment variables from a build step.
06:33:15  [EnvInject] - Injecting as environment variables the properties content 
06:33:15  OS_CLOUD=vex
06:33:15  
06:33:15  [EnvInject] - Variables injected successfully.
06:33:15  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
06:33:15  Run condition [Boolean condition] enabling perform for step [Execute shell]
06:33:15  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins12354087807515588708.sh
06:33:15  ---> Orphaned k8s clusters
06:33:15  Setup pyenv:
06:33:15    system
06:33:15    3.8.13
06:33:15    3.9.13
06:33:15    3.10.13
06:33:15  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
06:33:15  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-R1Vi from file:/tmp/.os_lf_venv
06:33:15  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
06:33:15  lf-activate-venv(): INFO: Attempting to install with network-safe options...
06:33:17  lf-activate-venv(): INFO: Base packages installed successfully
06:33:17  lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 
06:33:24  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
06:33:24  lftools 0.37.14 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible.
06:33:24  lf-activate-venv(): INFO: Adding /tmp/venv-R1Vi/bin to PATH
06:33:27  -----> Delete orphaned cluster
06:33:27  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
06:33:27  Run condition [Boolean condition] enabling perform for step [Execute shell]
06:33:27  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins13752711179692051278.sh
06:33:27  ---> Orphaned stacks
06:33:27  Setup pyenv:
06:33:27    system
06:33:27    3.8.13
06:33:27    3.9.13
06:33:27    3.10.13
06:33:27  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
06:33:28  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-R1Vi from file:/tmp/.os_lf_venv
06:33:28  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
06:33:28  lf-activate-venv(): INFO: Attempting to install with network-safe options...
06:33:30  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
06:33:30  lftools 0.37.14 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible.
06:33:30  lf-activate-venv(): INFO: Base packages installed successfully
06:33:30  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 
06:33:49  lf-activate-venv(): INFO: Adding /tmp/venv-R1Vi/bin to PATH
06:33:49  + mapfile -t OS_COE_CLUSTERS_ID
06:33:49  ++ awk '{print $1}'
06:33:49  ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name
06:33:49  ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)'
06:33:51  + echo '-----> Active clusters -> stacks'
06:33:51  -----> Active clusters -> stacks
06:33:51  + OS_COE_STACKS=()
06:33:51  + [[ 0 -gt 0 ]]
06:33:51  + mapfile -t OS_STACKS
06:33:51  ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED
06:33:51  ++ awk '{print $1}'
06:33:52  + echo '-----> Active stacks'
06:33:52  -----> Active stacks
06:33:52  + for stack in "${OS_STACKS[@]}"
06:33:52  + echo releng-openflowplugin-csit-1node-sanity-only-scandium-493
06:33:52  releng-openflowplugin-csit-1node-sanity-only-scandium-493
06:33:52  + echo '-----> Delete orphaned stacks'
06:33:52  -----> Delete orphaned stacks
06:33:52  + for STACK_NAME in "${OS_STACKS[@]}"
06:33:52  + [[ 0 -gt 0 ]]
06:33:52  + stack_in_jenkins releng-openflowplugin-csit-1node-sanity-only-scandium-493 https://jenkins.opendaylight.org/releng https://jenkins.opendaylight.org/sandbox
06:33:52  + STACK_NAME=releng-openflowplugin-csit-1node-sanity-only-scandium-493
06:33:52  + builds=()
06:33:52  + for jenkins in "${@:2}"
06:33:52  + PARAMS='tree=computer[executors[currentExecutable[url]],'
06:33:52  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]'
06:33:52  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
06:33:52  + JENKINS_URL='https://jenkins.opendaylight.org/releng/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
06:33:52  ++ curl -s -w '\n\n%{http_code}' --globoff -H Content-Type:application/json 'https://jenkins.opendaylight.org/releng/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
06:33:52  + resp='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73995/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]}
06:33:52  
06:33:52  200'
06:33:52  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73995/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]}
06:33:52  
06:33:52  200'
06:33:52  ++ head -n1
06:33:52  + json_data='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73995/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]}'
06:33:52  ++ awk 'END {print $NF}'
06:33:52  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73995/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]}
06:33:52  
06:33:52  200'
06:33:52  + status=200
06:33:52  + '[' 200 '!=' 200 ']'
06:33:52  + [[ https://jenkins.opendaylight.org/releng == *\j\e\n\k\i\n\s\.*\.\o\r\g ]]
06:33:52  + [[ https://jenkins.opendaylight.org/releng == *\j\e\n\k\i\n\s\.*\.\i\o ]]
06:33:52  ++ awk -F/ '{print $NF}'
06:33:52  ++ sed 's/\/*$//'
06:33:52  ++ echo https://jenkins.opendaylight.org/releng
06:33:52  + silo=releng
06:33:52  + export silo
06:33:52  + builds=(${builds[@]} $(echo "$json_data" |             jq -r '.computer[].executors[].currentExecutable.url'             | grep -v null | awk -F'/' '{print ENVIRON["silo"] "-" $6 "-" $7}'))
06:33:52  ++ grep -v null
06:33:52  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73995/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]}'
06:33:52  ++ jq -r '.computer[].executors[].currentExecutable.url'
06:33:52  ++ awk -F/ '{print ENVIRON["silo"] "-" $6 "-" $7}'
06:33:52  + for jenkins in "${@:2}"
06:33:52  + PARAMS='tree=computer[executors[currentExecutable[url]],'
06:33:52  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]'
06:33:52  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
06:33:52  + JENKINS_URL='https://jenkins.opendaylight.org/sandbox/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
06:33:52  ++ curl -s -w '\n\n%{http_code}' --globoff -H Content-Type:application/json 'https://jenkins.opendaylight.org/sandbox/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
06:33:52  + resp='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}
06:33:52  
06:33:52  200'
06:33:52  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}
06:33:52  
06:33:52  200'
06:33:52  ++ head -n1
06:33:52  + json_data='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}'
06:33:52  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}
06:33:52  
06:33:52  200'
06:33:52  ++ awk 'END {print $NF}'
06:33:52  + status=200
06:33:52  + '[' 200 '!=' 200 ']'
06:33:52  + [[ https://jenkins.opendaylight.org/sandbox == *\j\e\n\k\i\n\s\.*\.\o\r\g ]]
06:33:52  + [[ https://jenkins.opendaylight.org/sandbox == *\j\e\n\k\i\n\s\.*\.\i\o ]]
06:33:52  ++ echo https://jenkins.opendaylight.org/sandbox
06:33:52  ++ awk -F/ '{print $NF}'
06:33:52  ++ sed 's/\/*$//'
06:33:52  + silo=sandbox
06:33:52  + export silo
06:33:52  + builds=(${builds[@]} $(echo "$json_data" |             jq -r '.computer[].executors[].currentExecutable.url'             | grep -v null | awk -F'/' '{print ENVIRON["silo"] "-" $6 "-" $7}'))
06:33:52  ++ jq -r '.computer[].executors[].currentExecutable.url'
06:33:52  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}'
06:33:52  ++ awk -F/ '{print ENVIRON["silo"] "-" $6 "-" $7}'
06:33:52  ++ grep -v null
06:33:52  + [[ releng-builder-openstack-cron-73995 releng-openflowplugin-csit-1node-sanity-only-scandium-493 releng-integration-sanity-test-scandium-498 =~ releng-openflowplugin-csit-1node-sanity-only-scandium-493 ]]
06:33:52  + return 0
06:33:52  + continue
06:33:52  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
06:33:52  Run condition [Boolean condition] enabling perform for step [Execute shell]
06:33:52  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins16763959737405514016.sh
06:33:52  ---> Orphaned servers
06:33:52  Setup pyenv:
06:33:53    system
06:33:53    3.8.13
06:33:53    3.9.13
06:33:53    3.10.13
06:33:53  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
06:33:53  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-R1Vi from file:/tmp/.os_lf_venv
06:33:53  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
06:33:53  lf-activate-venv(): INFO: Attempting to install with network-safe options...
06:33:55  lf-activate-venv(): INFO: Base packages installed successfully
06:33:55  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
06:34:10  lf-activate-venv(): INFO: Adding /tmp/venv-R1Vi/bin to PATH
06:34:16  -----> Active servers
06:34:16  prd-ubuntu2204-docker-8c-8g-1438
06:34:16  prd-ubuntu2204-builder-2c-2g-1436
06:34:16  prd-ubuntu2204-docker-4c-4g-1437
06:34:16  prd-centos8-builder-2c-2g-1435
06:34:16  prd-ubuntu2204-docker-4c-4g-1434
06:34:16  prd-centos8-robot-2c-8g-1430
06:34:16  prd-centos8-robot-2c-8g-1429
06:34:16  prd-centos8-robot-2c-8g-773
06:34:16  prd-queue-intque-2c-1g-772
06:34:16  -----> Delete orphaned servers
06:34:16  Deleting orphaned server: prd-ubuntu2204-docker-8c-8g-1438
06:34:19  AttributeError: 'Server' object has no attribute 'created'. Did you mean: 'create'?
06:34:20  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
06:34:20  Run condition [Boolean condition] enabling perform for step [Execute shell]
06:34:20  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins13803976509099393695.sh
06:34:20  ---> Orphaned ports
06:34:20  Setup pyenv:
06:34:20    system
06:34:20    3.8.13
06:34:20    3.9.13
06:34:20    3.10.13
06:34:20  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
06:34:20  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-R1Vi from file:/tmp/.os_lf_venv
06:34:20  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
06:34:20  lf-activate-venv(): INFO: Attempting to install with network-safe options...
06:34:22  lf-activate-venv(): INFO: Base packages installed successfully
06:34:22  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] python-openstackclient 
06:34:35  lf-activate-venv(): INFO: Adding /tmp/venv-R1Vi/bin to PATH
06:34:36  No orphaned ports to process.
06:34:36  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
06:34:36  Run condition [Boolean condition] enabling perform for step [Execute shell]
06:34:36  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins7117814385378609752.sh
06:34:36  ---> Orphaned volumes
06:34:36  + source /home/jenkins/lf-env.sh
06:34:36  + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
06:34:36  ++ mktemp -d /tmp/venv-XXXX
06:34:36  + lf_venv=/tmp/venv-0Izj
06:34:36  + local venv_file=/tmp/.os_lf_venv
06:34:36  + local python=python3
06:34:36  + local options
06:34:36  + local set_path=true
06:34:36  + local install_args=
06:34:36  ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
06:34:36  + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
06:34:36  + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
06:34:36  ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
06:34:36  + true
06:34:36  + case $1 in
06:34:36  + python=python3
06:34:36  + shift 2
06:34:36  + true
06:34:36  + case $1 in
06:34:36  + shift
06:34:36  + break
06:34:36  + case $python in
06:34:36  + local pkg_list=
06:34:36  + [[ -d /opt/pyenv ]]
06:34:36  + echo 'Setup pyenv:'
06:34:36  Setup pyenv:
06:34:36  + export PYENV_ROOT=/opt/pyenv
06:34:36  + PYENV_ROOT=/opt/pyenv
06:34:36  + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
06:34:36  + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
06:34:36  + pyenv versions
06:34:37    system
06:34:37    3.8.13
06:34:37    3.9.13
06:34:37    3.10.13
06:34:37  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
06:34:37  + command -v pyenv
06:34:37  ++ pyenv init - --no-rehash
06:34:37  + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); 
06:34:37  for i in ${!paths[@]}; do 
06:34:37  if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; 
06:34:37  fi; done; 
06:34:37  echo "${paths[*]}"'\'')"
06:34:37  export PATH="/opt/pyenv/shims:${PATH}"
06:34:37  export PYENV_SHELL=bash
06:34:37  source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\''
06:34:37  pyenv() {
06:34:37    local command
06:34:37    command="${1:-}"
06:34:37    if [ "$#" -gt 0 ]; then
06:34:37      shift
06:34:37    fi
06:34:37  
06:34:37    case "$command" in
06:34:37    rehash|shell)
06:34:37      eval "$(pyenv "sh-$command" "$@")"
06:34:37      ;;
06:34:37    *)
06:34:37      command pyenv "$command" "$@"
06:34:37      ;;
06:34:37    esac
06:34:37  }'
06:34:37  +++ bash --norc -ec 'IFS=:; paths=($PATH); 
06:34:37  for i in ${!paths[@]}; do 
06:34:37  if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; 
06:34:37  fi; done; 
06:34:37  echo "${paths[*]}"'
06:34:37  ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
06:34:37  ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
06:34:37  ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
06:34:37  ++ export PYENV_SHELL=bash
06:34:37  ++ PYENV_SHELL=bash
06:34:37  ++ source /opt/pyenv/libexec/../completions/pyenv.bash
06:34:37  +++ complete -F _pyenv pyenv
06:34:37  ++ lf-pyver python3
06:34:37  ++ local py_version_xy=python3
06:34:37  ++ local py_version_xyz=
06:34:37  ++ awk '{ print $1 }'
06:34:37  ++ pyenv versions
06:34:37  ++ local command
06:34:37  ++ command=versions
06:34:37  ++ '[' 1 -gt 0 ']'
06:34:37  ++ shift
06:34:37  ++ case "$command" in
06:34:37  ++ command pyenv versions
06:34:37  ++ pyenv versions
06:34:37  ++ sed 's/^[ *]* //'
06:34:37  ++ grep -E '^[0-9.]*[0-9]$'
06:34:37  ++ [[ ! -s /tmp/.pyenv_versions ]]
06:34:37  +++ grep '^3' /tmp/.pyenv_versions
06:34:37  +++ sort -V
06:34:37  +++ tail -n 1
06:34:37  ++ py_version_xyz=3.11.7
06:34:37  ++ [[ -z 3.11.7 ]]
06:34:37  ++ echo 3.11.7
06:34:37  ++ return 0
06:34:37  + pyenv local 3.11.7
06:34:37  + local command
06:34:37  + command=local
06:34:37  + '[' 2 -gt 0 ']'
06:34:37  + shift
06:34:37  + case "$command" in
06:34:37  + command pyenv local 3.11.7
06:34:37  + pyenv local 3.11.7
06:34:37  + for arg in "$@"
06:34:37  + case $arg in
06:34:37  + pkg_list+='lftools[openstack] '
06:34:37  + for arg in "$@"
06:34:37  + case $arg in
06:34:37  + pkg_list+='kubernetes '
06:34:37  + for arg in "$@"
06:34:37  + case $arg in
06:34:37  + pkg_list+='niet '
06:34:37  + for arg in "$@"
06:34:37  + case $arg in
06:34:37  + pkg_list+='python-heatclient '
06:34:37  + for arg in "$@"
06:34:37  + case $arg in
06:34:37  + pkg_list+='python-openstackclient '
06:34:37  + for arg in "$@"
06:34:37  + case $arg in
06:34:37  + pkg_list+='python-magnumclient '
06:34:37  + for arg in "$@"
06:34:37  + case $arg in
06:34:37  + pkg_list+='yq '
06:34:37  + [[ -f /tmp/.os_lf_venv ]]
06:34:37  ++ cat /tmp/.os_lf_venv
06:34:37  + lf_venv=/tmp/venv-R1Vi
06:34:37  + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-R1Vi from' file:/tmp/.os_lf_venv
06:34:37  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-R1Vi from file:/tmp/.os_lf_venv
06:34:37  + echo 'lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)'
06:34:37  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
06:34:37  + local 'pip_opts=--upgrade --quiet'
06:34:37  + pip_opts='--upgrade --quiet --trusted-host pypi.org'
06:34:37  + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org'
06:34:37  + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org'
06:34:37  + [[ -n '' ]]
06:34:37  + [[ -n '' ]]
06:34:37  + echo 'lf-activate-venv(): INFO: Attempting to install with network-safe options...'
06:34:37  lf-activate-venv(): INFO: Attempting to install with network-safe options...
06:34:37  + /tmp/venv-R1Vi/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org pip 'setuptools<66' virtualenv
06:34:39  + echo 'lf-activate-venv(): INFO: Base packages installed successfully'
06:34:39  lf-activate-venv(): INFO: Base packages installed successfully
06:34:39  + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq  ]]
06:34:39  + echo 'lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq '
06:34:39  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
06:34:39  + /tmp/venv-R1Vi/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
06:34:56  + type python3
06:34:56  + true
06:34:56  + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-R1Vi/bin to PATH'
06:34:56  lf-activate-venv(): INFO: Adding /tmp/venv-R1Vi/bin to PATH
06:34:56  + PATH=/tmp/venv-R1Vi/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
06:34:56  + return 0
06:34:56  + mapfile -t os_volumes
06:34:56  ++ openstack --os-cloud vex volume list -f value -c ID --status Available
06:34:58  + '[' 0 -eq 0 ']'
06:34:58  + echo 'No orphaned volumes found.'
06:34:58  No orphaned volumes found.
06:34:58  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
06:34:58  Run condition [Boolean condition] enabling perform for step [Execute shell]
06:34:58  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins14960529534857355904.sh
06:34:58  ---> Protect in-use images
06:34:58  Setup pyenv:
06:34:59    system
06:34:59    3.8.13
06:34:59    3.9.13
06:34:59    3.10.13
06:34:59  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
06:34:59  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-R1Vi from file:/tmp/.os_lf_venv
06:34:59  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
06:34:59  lf-activate-venv(): INFO: Attempting to install with network-safe options...
06:35:01  lf-activate-venv(): INFO: Base packages installed successfully
06:35:01  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient 
06:35:15  lf-activate-venv(): INFO: Adding /tmp/venv-R1Vi/bin to PATH
06:35:15  INFO: There are images to protect defined in jenkins-config.
06:35:15  INFO: There are additional images to protect in the jjb dir.
06:35:15  INFO: Protecting the following images:
06:35:15  ZZCI - CentOS 7 - builder - x86_64 - 20240701-060130.538
06:35:15  ZZCI - CentOS 7 - devstack-rocky - x86_64 - 20221101-000109.537"  # Unused
06:35:15  ZZCI - CentOS 7 - devstack-stein - x86_64 - 20221101-010107.368"  # Unused
06:35:15  ZZCI - CentOS 7 - devstack - x86_64 - 20240601-230133.464"  # Unused
06:35:15  ZZCI - CentOS 7 - docker - x86_64 - 20240601-220142.195
06:35:15  ZZCI - CentOS 7 - helm - x86_64 - 20230301-000133.034
06:35:15  ZZCI - CentOS 7 - robot - x86_64 - 20240601-220241.858
06:35:15  ZZCI - CentOS Stream 8 - builder - x86_64 - 20240601-160217.263
06:35:15  ZZCI - CentOS Stream 8 - robot - x86_64 - 20240601-010231.803
06:35:15  ZZCI - Ubuntu 18.04 - docker - x86_64 - 20250201-040221.796
06:35:15  ZZCI - Ubuntu 18.04 - helm - x86_64 - 20230301-140059.950
06:35:15  ZZCI - Ubuntu 20.04 - docker - x86_64 - 20250201-160239.450
06:35:15  ZZCI - Ubuntu 22.04 - builder - x86_64 - 20250201-010426.857
06:35:15  ZZCI - Ubuntu 22.04 - devstack - x86_64 - 20231031-095146.118"  # Unused
06:35:15  ZZCI - Ubuntu 22.04 - docker - x86_64 - 20250201-170115.786
06:35:15  ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 - 20250201-060151.911
06:35:17  Protected setting for ZZCI - CentOS 7 - builder - x86_64 - 20240701-060130.538: True
06:35:18  No Image found for ZZCI - CentOS 7 - devstack-rocky - x86_64 - 20221101-000109.537"  # Unused
06:35:18  Build step 'Conditional step (single)' marked build as failure
06:35:18  $ ssh-agent -k
06:35:18  unset SSH_AUTH_SOCK;
06:35:18  unset SSH_AGENT_PID;
06:35:18  echo Agent pid 5453 killed;
06:35:18  [ssh-agent] Stopped.
06:35:18  [PostBuildScript] - [INFO] Executing post build scripts.
06:35:18  [builder-openstack-cron] $ /bin/bash /tmp/jenkins1750252498638929264.sh
06:35:18  ---> sysstat.sh
06:35:19  [builder-openstack-cron] $ /bin/bash /tmp/jenkins3571625906769852088.sh
06:35:19  ---> package-listing.sh
06:35:19  ++ facter osfamily
06:35:19  ++ tr '[:upper:]' '[:lower:]'
06:35:19  + OS_FAMILY=redhat
06:35:19  + workspace=/w/workspace/builder-openstack-cron
06:35:19  + START_PACKAGES=/tmp/packages_start.txt
06:35:19  + END_PACKAGES=/tmp/packages_end.txt
06:35:19  + DIFF_PACKAGES=/tmp/packages_diff.txt
06:35:19  + PACKAGES=/tmp/packages_start.txt
06:35:19  + '[' /w/workspace/builder-openstack-cron ']'
06:35:19  + PACKAGES=/tmp/packages_end.txt
06:35:19  + case "${OS_FAMILY}" in
06:35:19  + rpm -qa
06:35:19  + sort
06:35:20  + '[' -f /tmp/packages_start.txt ']'
06:35:20  + '[' -f /tmp/packages_end.txt ']'
06:35:20  + diff /tmp/packages_start.txt /tmp/packages_end.txt
06:35:20  + '[' /w/workspace/builder-openstack-cron ']'
06:35:20  + mkdir -p /w/workspace/builder-openstack-cron/archives/
06:35:20  + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/builder-openstack-cron/archives/
06:35:20  [builder-openstack-cron] $ /bin/bash /tmp/jenkins1399051888832272326.sh
06:35:20  ---> capture-instance-metadata.sh
06:35:20  Setup pyenv:
06:35:20    system
06:35:20    3.8.13
06:35:20    3.9.13
06:35:20    3.10.13
06:35:20  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
06:35:20  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-R1Vi from file:/tmp/.os_lf_venv
06:35:20  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
06:35:20  lf-activate-venv(): INFO: Attempting to install with network-safe options...
06:35:22  lf-activate-venv(): INFO: Base packages installed successfully
06:35:22  lf-activate-venv(): INFO: Installing additional packages: lftools 
06:35:32  lf-activate-venv(): INFO: Adding /tmp/venv-R1Vi/bin to PATH
06:35:32  INFO: Running in OpenStack, capturing instance metadata
06:35:32  [builder-openstack-cron] $ /bin/bash /tmp/jenkins9933274679869394041.sh
06:35:32  provisioning config files...
06:35:32  Could not find credentials [logs] for builder-openstack-cron #73995
06:35:32  copy managed file [jenkins-log-archives-settings] to file:/w/workspace/builder-openstack-cron@tmp/config2336741830896703501tmp
06:35:32  Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index]
06:35:32  Run condition [Regular expression match] enabling perform for step [Provide Configuration files]
06:35:32  provisioning config files...
06:35:33  copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials
06:35:33  [EnvInject] - Injecting environment variables from a build step.
06:35:33  [EnvInject] - Injecting as environment variables the properties content 
06:35:33  SERVER_ID=logs
06:35:33  
06:35:33  [EnvInject] - Variables injected successfully.
06:35:33  [builder-openstack-cron] $ /bin/bash /tmp/jenkins11400859834496789462.sh
06:35:33  ---> create-netrc.sh
06:35:33  WARN: Log server credential not found.
06:35:33  [builder-openstack-cron] $ /bin/bash /tmp/jenkins5730438370806129920.sh
06:35:33  ---> python-tools-install.sh
06:35:33  Setup pyenv:
06:35:33    system
06:35:33    3.8.13
06:35:33    3.9.13
06:35:33    3.10.13
06:35:33  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
06:35:33  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-R1Vi from file:/tmp/.os_lf_venv
06:35:33  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
06:35:33  lf-activate-venv(): INFO: Attempting to install with network-safe options...
06:35:35  lf-activate-venv(): INFO: Base packages installed successfully
06:35:35  lf-activate-venv(): INFO: Installing additional packages: lftools 
06:35:45  lf-activate-venv(): INFO: Adding /tmp/venv-R1Vi/bin to PATH
06:35:45  [builder-openstack-cron] $ /bin/bash /tmp/jenkins12442370440921448502.sh
06:35:45  ---> sudo-logs.sh
06:35:45  Archiving 'sudo' log..
06:35:45  [builder-openstack-cron] $ /bin/bash /tmp/jenkins13977322416409860898.sh
06:35:45  ---> job-cost.sh
06:35:45  Setup pyenv:
06:35:46    system
06:35:46    3.8.13
06:35:46    3.9.13
06:35:46    3.10.13
06:35:46  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
06:35:46  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-R1Vi from file:/tmp/.os_lf_venv
06:35:46  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
06:35:46  lf-activate-venv(): INFO: Attempting to install with network-safe options...
06:35:48  lf-activate-venv(): INFO: Base packages installed successfully
06:35:48  lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
06:35:55  lf-activate-venv(): INFO: Adding /tmp/venv-R1Vi/bin to PATH
06:35:55  INFO: No Stack...
06:35:55  INFO: Retrieving Pricing Info for: v3-standard-2
06:35:56  INFO: Archiving Costs
06:35:56  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins14241716878533303129.sh
06:35:56  ---> logs-deploy.sh
06:35:56  Setup pyenv:
06:35:56    system
06:35:56    3.8.13
06:35:56    3.9.13
06:35:56    3.10.13
06:35:56  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
06:35:56  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-R1Vi from file:/tmp/.os_lf_venv
06:35:56  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
06:35:56  lf-activate-venv(): INFO: Attempting to install with network-safe options...
06:35:58  lf-activate-venv(): INFO: Base packages installed successfully
06:35:58  lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 
06:36:09  lf-activate-venv(): INFO: Adding /tmp/venv-R1Vi/bin to PATH
06:36:09  WARNING: Nexus logging server not set
06:36:09  INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/builder-openstack-cron/73995/
06:36:09  INFO: archiving logs to S3
06:36:10  ---> uname -a:
06:36:10  Linux prd-centos8-builder-2c-2g-1435.novalocal 4.18.0-553.5.1.el8.x86_64 #1 SMP Tue May 21 05:46:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
06:36:10  
06:36:10  
06:36:10  ---> lscpu:
06:36:10  Architecture:        x86_64
06:36:10  CPU op-mode(s):      32-bit, 64-bit
06:36:10  Byte Order:          Little Endian
06:36:10  CPU(s):              2
06:36:10  On-line CPU(s) list: 0,1
06:36:10  Thread(s) per core:  1
06:36:10  Core(s) per socket:  1
06:36:10  Socket(s):           2
06:36:10  NUMA node(s):        1
06:36:10  Vendor ID:           AuthenticAMD
06:36:10  CPU family:          23
06:36:10  Model:               49
06:36:10  Model name:          AMD EPYC-Rome Processor
06:36:10  Stepping:            0
06:36:10  CPU MHz:             2800.000
06:36:10  BogoMIPS:            5600.00
06:36:10  Virtualization:      AMD-V
06:36:10  Hypervisor vendor:   KVM
06:36:10  Virtualization type: full
06:36:10  L1d cache:           32K
06:36:10  L1i cache:           32K
06:36:10  L2 cache:            512K
06:36:10  L3 cache:            16384K
06:36:10  NUMA node0 CPU(s):   0,1
06:36:10  Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
06:36:10  
06:36:10  
06:36:10  ---> nproc:
06:36:10  2
06:36:10  
06:36:10  
06:36:10  ---> df -h:
06:36:10  Filesystem      Size  Used Avail Use% Mounted on
06:36:10  devtmpfs        3.8G     0  3.8G   0% /dev
06:36:10  tmpfs           3.8G     0  3.8G   0% /dev/shm
06:36:10  tmpfs           3.8G   17M  3.8G   1% /run
06:36:10  tmpfs           3.8G     0  3.8G   0% /sys/fs/cgroup
06:36:10  /dev/vda1        40G  8.4G   32G  22% /
06:36:10  tmpfs           770M     0  770M   0% /run/user/1001
06:36:10  
06:36:10  
06:36:10  ---> free -m:
06:36:10                total        used        free      shared  buff/cache   available
06:36:10  Mem:           7697         621        4810          19        2266        6779
06:36:10  Swap:          1023           0        1023
06:36:10  
06:36:10  
06:36:10  ---> ip addr:
06:36:10  1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
06:36:10      link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
06:36:10      inet 127.0.0.1/8 scope host lo
06:36:10         valid_lft forever preferred_lft forever
06:36:10      inet6 ::1/128 scope host 
06:36:10         valid_lft forever preferred_lft forever
06:36:10  2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1458 qdisc mq state UP group default qlen 1000
06:36:10      link/ether fa:16:3e:49:ab:43 brd ff:ff:ff:ff:ff:ff
06:36:10      altname enp0s3
06:36:10      altname ens3
06:36:10      inet 10.30.171.56/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0
06:36:10         valid_lft 86122sec preferred_lft 86122sec
06:36:10      inet6 fe80::f816:3eff:fe49:ab43/64 scope link 
06:36:10         valid_lft forever preferred_lft forever
06:36:10  3: docker0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1458 qdisc noqueue state DOWN group default 
06:36:10      link/ether 02:42:f6:33:80:f8 brd ff:ff:ff:ff:ff:ff
06:36:10      inet 10.250.0.254/24 brd 10.250.0.255 scope global docker0
06:36:10         valid_lft forever preferred_lft forever
06:36:10  
06:36:10  
06:36:10  ---> sar -b -r -n DEV:
06:36:10  Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-builder-5e6ee0fb-b6d9-4116-90d4-35c890e2b0f7.nov) 	09/26/2025 	_x86_64_	(2 CPU)
06:36:10  
06:36:10  06:31:27     LINUX RESTART	(2 CPU)
06:36:10  
06:36:10  06:32:02 AM       tps      rtps      wtps   bread/s   bwrtn/s
06:36:10  06:33:01 AM    212.74     10.34    202.41   2029.96   7419.60
06:36:10  06:34:01 AM    105.71      0.72    105.00    103.97  11623.64
06:36:10  06:35:01 AM     31.58      0.50     31.08     34.13   1280.85
06:36:10  06:36:01 AM     30.69      0.50     30.19     63.71    831.27
06:36:10  Average:        94.69      2.98     91.71    551.80   5280.10
06:36:10  
06:36:10  06:32:02 AM kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
06:36:10  06:33:01 AM   5156236   7032952   2726196     34.59      2688   2058824    923028     10.34    201620   2201252    177700
06:36:10  06:34:01 AM   4939504   6948748   2942928     37.34      2688   2184384    979316     10.97    233616   2357560     27236
06:36:10  06:35:01 AM   4989312   6998124   2893120     36.70      2688   2184084    935280     10.47    269140   2271464      8876
06:36:10  06:36:01 AM   4962920   6977224   2919512     37.04      2688   2189208    954200     10.68    423712   2143748     25108
06:36:10  Average:      5011993   6989262   2870439     36.42      2688   2154125    947956     10.61    282022   2243506     59730
06:36:10  
06:36:10  06:32:02 AM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
06:36:10  06:33:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
06:36:10  06:33:01 AM      eth0    255.12    170.57   1810.45     60.67      0.00      0.00      0.00      0.00
06:36:10  06:33:01 AM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
06:36:10  06:34:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
06:36:10  06:34:01 AM      eth0     72.66     57.78    739.19     11.18      0.00      0.00      0.00      0.00
06:36:10  06:34:01 AM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
06:36:10  06:35:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
06:36:10  06:35:01 AM      eth0     23.60     23.38     26.95      9.04      0.00      0.00      0.00      0.00
06:36:10  06:35:01 AM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
06:36:10  06:36:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
06:36:10  06:36:01 AM      eth0     22.29     20.56     18.92     10.79      0.00      0.00      0.00      0.00
06:36:10  06:36:01 AM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
06:36:10  Average:           lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
06:36:10  Average:         eth0     92.74     67.65    644.04     22.76      0.00      0.00      0.00      0.00
06:36:10  Average:      docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
06:36:10  
06:36:10  
06:36:10  ---> sar -P ALL:
06:36:10  Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-builder-5e6ee0fb-b6d9-4116-90d4-35c890e2b0f7.nov) 	09/26/2025 	_x86_64_	(2 CPU)
06:36:10  
06:36:10  06:31:27     LINUX RESTART	(2 CPU)
06:36:10  
06:36:10  06:32:02 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
06:36:10  06:33:01 AM     all     37.73      0.00      6.51      1.81      0.10     53.85
06:36:10  06:33:01 AM       0     43.82      0.00      7.42      0.99      0.10     47.67
06:36:10  06:33:01 AM       1     31.65      0.00      5.60      2.63      0.10     60.01
06:36:10  06:34:01 AM     all     34.88      0.00      5.13      0.98      0.10     58.91
06:36:10  06:34:01 AM       0     49.91      0.00      6.18      0.78      0.10     43.03
06:36:10  06:34:01 AM       1     19.87      0.00      4.08      1.18      0.10     74.76
06:36:10  06:35:01 AM     all     33.66      0.00      3.69      0.24      0.09     62.32
06:36:10  06:35:01 AM       0     50.78      0.00      4.89      0.27      0.08     43.98
06:36:10  06:35:01 AM       1     16.52      0.00      2.49      0.22      0.10     80.67
06:36:10  06:36:01 AM     all     38.12      0.00      4.25      0.18      0.09     57.36
06:36:10  06:36:01 AM       0     50.49      0.00      5.15      0.23      0.10     44.02
06:36:10  06:36:01 AM       1     25.74      0.00      3.35      0.12      0.08     70.70
06:36:10  Average:        all     36.09      0.00      4.89      0.80      0.10     58.13
06:36:10  Average:          0     48.78      0.00      5.90      0.57      0.10     44.66
06:36:10  Average:          1     23.41      0.00      3.88      1.03      0.10     71.59
06:36:10  
06:36:10  
06:36:10