21:32:11  Started by timer
21:32:11  Running as SYSTEM
21:32:11  [EnvInject] - Loading node environment variables.
21:32:11  Building remotely on prd-centos8-builder-2c-2g-1286 (centos8-builder-2c-2g) in workspace /w/workspace/builder-openstack-cron
21:32:11  [ssh-agent] Looking for ssh-agent implementation...
21:32:11  [ssh-agent]   Exec ssh-agent (binary ssh-agent on a remote machine)
21:32:11  $ ssh-agent
21:32:11  SSH_AUTH_SOCK=/tmp/ssh-4H9IO7MwgYXT/agent.5444
21:32:11  SSH_AGENT_PID=5445
21:32:11  [ssh-agent] Started.
21:32:11  Running ssh-add (command line suppressed)
21:32:11  Identity added: /w/workspace/builder-openstack-cron@tmp/private_key_307350202183214780.key (/w/workspace/builder-openstack-cron@tmp/private_key_307350202183214780.key)
21:32:11  [ssh-agent] Using credentials jenkins (jenkins-ssh)
21:32:11  The recommended git tool is: NONE
21:32:14  using credential jenkins-ssh
21:32:14  Wiping out workspace first.
21:32:14  Cloning the remote Git repository
21:32:14  Cloning repository git://devvexx.opendaylight.org/mirror/releng/builder
21:32:14   > git init /w/workspace/builder-openstack-cron # timeout=10
21:32:14  Fetching upstream changes from git://devvexx.opendaylight.org/mirror/releng/builder
21:32:14   > git --version # timeout=10
21:32:14   > git --version # 'git version 2.43.0'
21:32:14  using GIT_SSH to set credentials jenkins-ssh
21:32:14  [INFO] Currently running in a labeled security context
21:32:14  [INFO] Currently SELinux is 'enforcing' on the host
21:32:14   > /usr/bin/chcon --type=ssh_home_t /w/workspace/builder-openstack-cron@tmp/jenkins-gitclient-ssh13737180581614199041.key
21:32:14  Verifying host key using known hosts file
21:32:14  You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
21:32:14   > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/releng/builder +refs/heads/*:refs/remotes/origin/* # timeout=10
21:32:17   > git config remote.origin.url git://devvexx.opendaylight.org/mirror/releng/builder # timeout=10
21:32:17   > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
21:32:17  Avoid second fetch
21:32:17   > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
21:32:17  Checking out Revision 6cd405ccab649fcd7832ee14748bdee1c721ff40 (refs/remotes/origin/master)
21:32:17   > git config core.sparsecheckout # timeout=10
21:32:17   > git checkout -f 6cd405ccab649fcd7832ee14748bdee1c721ff40 # timeout=10
21:32:18  Commit message: "Chore: Update global-jjb to the latest v0.92.5"
21:32:18   > git rev-list --no-walk 6cd405ccab649fcd7832ee14748bdee1c721ff40 # timeout=10
21:32:18   > git remote # timeout=10
21:32:18   > git submodule init # timeout=10
21:32:18   > git submodule sync # timeout=10
21:32:18   > git config --get remote.origin.url # timeout=10
21:32:18   > git submodule init # timeout=10
21:32:18   > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10
21:32:18   > git config --get submodule.global-jjb.url # timeout=10
21:32:18   > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10
21:32:18   > git config --get submodule.packer/common-packer.url # timeout=10
21:32:18   > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10
21:32:18   > git submodule update --init --recursive global-jjb # timeout=10
21:32:19   > git submodule update --init --recursive packer/common-packer # timeout=10
21:32:23  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
21:32:23  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
21:32:23  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
21:32:23  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
21:32:23  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
21:32:23  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
21:32:23  Run condition [Boolean condition] enabling prebuild for step [BuilderChain]
21:32:23  No emails were triggered.
21:32:23  provisioning config files...
21:32:24  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
21:32:24  copy managed file [npmrc] to file:/home/jenkins/.npmrc
21:32:24  copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
21:32:24  [builder-openstack-cron] $ /bin/bash /tmp/jenkins13635643686028034340.sh
21:32:24  ---> python-tools-install.sh
21:32:24  Setup pyenv:
21:32:24    system
21:32:24  * 3.8.13 (set by /opt/pyenv/version)
21:32:24  * 3.9.13 (set by /opt/pyenv/version)
21:32:24  * 3.10.13 (set by /opt/pyenv/version)
21:32:24  * 3.11.7 (set by /opt/pyenv/version)
21:32:29  lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-WQpI
21:32:29  lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
21:32:29  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
21:32:29  lf-activate-venv(): INFO: Attempting to install with network-safe options...
21:32:33  lf-activate-venv(): INFO: Base packages installed successfully
21:32:33  lf-activate-venv(): INFO: Installing additional packages: lftools 
21:33:00  lf-activate-venv(): INFO: Adding /tmp/venv-WQpI/bin to PATH
21:33:00  Generating Requirements File
21:33:20  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
21:33:20  httplib2 0.31.0 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible.
21:33:21  Python 3.11.7
21:33:21  pip 25.2 from /tmp/venv-WQpI/lib/python3.11/site-packages/pip (python 3.11)
21:33:21  appdirs==1.4.4
21:33:21  argcomplete==3.6.2
21:33:21  aspy.yaml==1.3.0
21:33:21  attrs==25.3.0
21:33:21  autopage==0.5.2
21:33:21  beautifulsoup4==4.13.5
21:33:21  boto3==1.40.39
21:33:21  botocore==1.40.39
21:33:21  bs4==0.0.2
21:33:21  cachetools==5.5.2
21:33:21  certifi==2025.8.3
21:33:21  cffi==2.0.0
21:33:21  cfgv==3.4.0
21:33:21  chardet==5.2.0
21:33:21  charset-normalizer==3.4.3
21:33:21  click==8.3.0
21:33:21  cliff==4.11.0
21:33:21  cmd2==2.7.0
21:33:21  cryptography==3.3.2
21:33:21  debtcollector==3.0.0
21:33:21  decorator==5.2.1
21:33:21  defusedxml==0.7.1
21:33:21  Deprecated==1.2.18
21:33:21  distlib==0.4.0
21:33:21  dnspython==2.8.0
21:33:21  docker==7.1.0
21:33:21  dogpile.cache==1.4.1
21:33:21  durationpy==0.10
21:33:21  email-validator==2.3.0
21:33:21  filelock==3.19.1
21:33:21  future==1.0.0
21:33:21  gitdb==4.0.12
21:33:21  GitPython==3.1.45
21:33:21  google-auth==2.40.3
21:33:21  httplib2==0.31.0
21:33:21  identify==2.6.14
21:33:21  idna==3.10
21:33:21  importlib-resources==1.5.0
21:33:21  iso8601==2.1.0
21:33:21  Jinja2==3.1.6
21:33:21  jmespath==1.0.1
21:33:21  jsonpatch==1.33
21:33:21  jsonpointer==3.0.0
21:33:21  jsonschema==4.25.1
21:33:21  jsonschema-specifications==2025.9.1
21:33:21  keystoneauth1==5.12.0
21:33:21  kubernetes==33.1.0
21:33:21  lftools==0.37.14
21:33:21  lxml==6.0.2
21:33:21  markdown-it-py==4.0.0
21:33:21  MarkupSafe==3.0.2
21:33:21  mdurl==0.1.2
21:33:21  msgpack==1.1.1
21:33:21  multi_key_dict==2.0.3
21:33:21  munch==4.0.0
21:33:21  netaddr==1.3.0
21:33:21  niet==1.4.2
21:33:21  nodeenv==1.9.1
21:33:21  oauth2client==4.1.3
21:33:21  oauthlib==3.3.1
21:33:21  openstacksdk==4.7.1
21:33:21  os-service-types==1.8.0
21:33:21  osc-lib==4.2.0
21:33:21  oslo.config==10.0.0
21:33:21  oslo.context==6.1.0
21:33:21  oslo.i18n==6.6.0
21:33:21  oslo.log==7.2.1
21:33:21  oslo.serialization==5.8.0
21:33:21  oslo.utils==9.1.0
21:33:21  packaging==25.0
21:33:21  pbr==7.0.1
21:33:21  platformdirs==4.4.0
21:33:21  prettytable==3.16.0
21:33:21  psutil==7.1.0
21:33:21  pyasn1==0.6.1
21:33:21  pyasn1_modules==0.4.2
21:33:21  pycparser==2.23
21:33:21  pygerrit2==2.0.15
21:33:21  PyGithub==2.8.1
21:33:21  Pygments==2.19.2
21:33:21  PyJWT==2.10.1
21:33:21  PyNaCl==1.6.0
21:33:21  pyparsing==2.4.7
21:33:21  pyperclip==1.10.0
21:33:21  pyrsistent==0.20.0
21:33:21  python-cinderclient==9.8.0
21:33:21  python-dateutil==2.9.0.post0
21:33:21  python-heatclient==4.3.0
21:33:21  python-jenkins==1.8.3
21:33:21  python-keystoneclient==5.7.0
21:33:21  python-magnumclient==4.9.0
21:33:21  python-openstackclient==8.2.0
21:33:21  python-swiftclient==4.8.0
21:33:21  PyYAML==6.0.3
21:33:21  referencing==0.36.2
21:33:21  requests==2.32.5
21:33:21  requests-oauthlib==2.0.0
21:33:21  requestsexceptions==1.4.0
21:33:21  rfc3986==2.0.0
21:33:21  rich==14.1.0
21:33:21  rich-argparse==1.7.1
21:33:21  rpds-py==0.27.1
21:33:21  rsa==4.9.1
21:33:21  ruamel.yaml==0.18.15
21:33:21  ruamel.yaml.clib==0.2.14
21:33:21  s3transfer==0.14.0
21:33:21  simplejson==3.20.1
21:33:21  six==1.17.0
21:33:21  smmap==5.0.2
21:33:21  soupsieve==2.8
21:33:21  stevedore==5.5.0
21:33:21  tabulate==0.9.0
21:33:21  toml==0.10.2
21:33:21  tomlkit==0.13.3
21:33:21  tqdm==4.67.1
21:33:21  typing_extensions==4.15.0
21:33:21  tzdata==2025.2
21:33:21  urllib3==1.26.20
21:33:21  virtualenv==20.34.0
21:33:21  wcwidth==0.2.14
21:33:21  websocket-client==1.8.0
21:33:21  wrapt==1.17.3
21:33:21  xdg==6.0.0
21:33:21  xmltodict==1.0.2
21:33:21  yq==3.4.3
21:33:21  [EnvInject] - Injecting environment variables from a build step.
21:33:21  [EnvInject] - Injecting as environment variables the properties content 
21:33:21  OS_CLOUD=vex
21:33:21  
21:33:21  [EnvInject] - Variables injected successfully.
21:33:21  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
21:33:21  Run condition [Boolean condition] enabling perform for step [Execute shell]
21:33:21  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins12709726158514297904.sh
21:33:21  ---> Orphaned k8s clusters
21:33:21  Setup pyenv:
21:33:22    system
21:33:22    3.8.13
21:33:22    3.9.13
21:33:22    3.10.13
21:33:22  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
21:33:22  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-WQpI from file:/tmp/.os_lf_venv
21:33:22  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
21:33:22  lf-activate-venv(): INFO: Attempting to install with network-safe options...
21:33:24  lf-activate-venv(): INFO: Base packages installed successfully
21:33:24  lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 
21:33:31  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
21:33:31  lftools 0.37.14 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible.
21:33:31  lf-activate-venv(): INFO: Adding /tmp/venv-WQpI/bin to PATH
21:33:34  -----> Delete orphaned cluster
21:33:34  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
21:33:34  Run condition [Boolean condition] enabling perform for step [Execute shell]
21:33:34  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins15142459854581357803.sh
21:33:34  ---> Orphaned stacks
21:33:34  Setup pyenv:
21:33:34    system
21:33:34    3.8.13
21:33:34    3.9.13
21:33:34    3.10.13
21:33:34  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
21:33:35  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-WQpI from file:/tmp/.os_lf_venv
21:33:35  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
21:33:35  lf-activate-venv(): INFO: Attempting to install with network-safe options...
21:33:37  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
21:33:37  lftools 0.37.14 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible.
21:33:37  lf-activate-venv(): INFO: Base packages installed successfully
21:33:37  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 
21:33:57  lf-activate-venv(): INFO: Adding /tmp/venv-WQpI/bin to PATH
21:33:57  + mapfile -t OS_COE_CLUSTERS_ID
21:33:57  ++ awk '{print $1}'
21:33:57  ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name
21:33:57  ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)'
21:33:59  + echo '-----> Active clusters -> stacks'
21:33:59  -----> Active clusters -> stacks
21:33:59  + OS_COE_STACKS=()
21:33:59  + [[ 0 -gt 0 ]]
21:33:59  + mapfile -t OS_STACKS
21:33:59  ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED
21:33:59  ++ awk '{print $1}'
21:34:01  + echo '-----> Active stacks'
21:34:01  -----> Active stacks
21:34:01  + for stack in "${OS_STACKS[@]}"
21:34:01  + echo releng-openflowplugin-csit-1node-sanity-only-scandium-493
21:34:01  releng-openflowplugin-csit-1node-sanity-only-scandium-493
21:34:01  + echo '-----> Delete orphaned stacks'
21:34:01  -----> Delete orphaned stacks
21:34:01  + for STACK_NAME in "${OS_STACKS[@]}"
21:34:01  + [[ 0 -gt 0 ]]
21:34:01  + stack_in_jenkins releng-openflowplugin-csit-1node-sanity-only-scandium-493 https://jenkins.opendaylight.org/releng https://jenkins.opendaylight.org/sandbox
21:34:01  + STACK_NAME=releng-openflowplugin-csit-1node-sanity-only-scandium-493
21:34:01  + builds=()
21:34:01  + for jenkins in "${@:2}"
21:34:01  + PARAMS='tree=computer[executors[currentExecutable[url]],'
21:34:01  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]'
21:34:01  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
21:34:01  + JENKINS_URL='https://jenkins.opendaylight.org/releng/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
21:34:01  ++ curl -s -w '\n\n%{http_code}' --globoff -H Content-Type:application/json 'https://jenkins.opendaylight.org/releng/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
21:34:01  + resp='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73986/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]}
21:34:01  
21:34:01  200'
21:34:01  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73986/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]}
21:34:01  
21:34:01  200'
21:34:01  ++ head -n1
21:34:01  + json_data='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73986/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]}'
21:34:01  ++ awk 'END {print $NF}'
21:34:01  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73986/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]}
21:34:01  
21:34:01  200'
21:34:01  + status=200
21:34:01  + '[' 200 '!=' 200 ']'
21:34:01  + [[ https://jenkins.opendaylight.org/releng == *\j\e\n\k\i\n\s\.*\.\o\r\g ]]
21:34:01  + [[ https://jenkins.opendaylight.org/releng == *\j\e\n\k\i\n\s\.*\.\i\o ]]
21:34:01  ++ sed 's/\/*$//'
21:34:01  ++ echo https://jenkins.opendaylight.org/releng
21:34:01  ++ awk -F/ '{print $NF}'
21:34:01  + silo=releng
21:34:01  + export silo
21:34:01  + builds=(${builds[@]} $(echo "$json_data" |             jq -r '.computer[].executors[].currentExecutable.url'             | grep -v null | awk -F'/' '{print ENVIRON["silo"] "-" $6 "-" $7}'))
21:34:01  ++ grep -v null
21:34:01  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73986/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]}'
21:34:01  ++ jq -r '.computer[].executors[].currentExecutable.url'
21:34:01  ++ awk -F/ '{print ENVIRON["silo"] "-" $6 "-" $7}'
21:34:01  + for jenkins in "${@:2}"
21:34:01  + PARAMS='tree=computer[executors[currentExecutable[url]],'
21:34:01  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]'
21:34:01  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
21:34:01  + JENKINS_URL='https://jenkins.opendaylight.org/sandbox/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
21:34:01  ++ curl -s -w '\n\n%{http_code}' --globoff -H Content-Type:application/json 'https://jenkins.opendaylight.org/sandbox/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
21:34:01  + resp='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}
21:34:01  
21:34:01  200'
21:34:01  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}
21:34:01  
21:34:01  200'
21:34:01  ++ head -n1
21:34:01  + json_data='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}'
21:34:01  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}
21:34:01  
21:34:01  200'
21:34:01  ++ awk 'END {print $NF}'
21:34:01  + status=200
21:34:01  + '[' 200 '!=' 200 ']'
21:34:01  + [[ https://jenkins.opendaylight.org/sandbox == *\j\e\n\k\i\n\s\.*\.\o\r\g ]]
21:34:01  + [[ https://jenkins.opendaylight.org/sandbox == *\j\e\n\k\i\n\s\.*\.\i\o ]]
21:34:01  ++ echo https://jenkins.opendaylight.org/sandbox
21:34:01  ++ sed 's/\/*$//'
21:34:01  ++ awk -F/ '{print $NF}'
21:34:01  + silo=sandbox
21:34:01  + export silo
21:34:01  + builds=(${builds[@]} $(echo "$json_data" |             jq -r '.computer[].executors[].currentExecutable.url'             | grep -v null | awk -F'/' '{print ENVIRON["silo"] "-" $6 "-" $7}'))
21:34:01  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}'
21:34:01  ++ awk -F/ '{print ENVIRON["silo"] "-" $6 "-" $7}'
21:34:01  ++ jq -r '.computer[].executors[].currentExecutable.url'
21:34:01  ++ grep -v null
21:34:01  + [[ releng-builder-openstack-cron-73986 releng-openflowplugin-csit-1node-sanity-only-scandium-493 releng-integration-sanity-test-scandium-498 =~ releng-openflowplugin-csit-1node-sanity-only-scandium-493 ]]
21:34:01  + return 0
21:34:01  + continue
21:34:01  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
21:34:01  Run condition [Boolean condition] enabling perform for step [Execute shell]
21:34:01  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins16789128928533141.sh
21:34:01  ---> Orphaned servers
21:34:01  Setup pyenv:
21:34:01    system
21:34:01    3.8.13
21:34:01    3.9.13
21:34:01    3.10.13
21:34:01  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
21:34:01  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-WQpI from file:/tmp/.os_lf_venv
21:34:01  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
21:34:01  lf-activate-venv(): INFO: Attempting to install with network-safe options...
21:34:03  lf-activate-venv(): INFO: Base packages installed successfully
21:34:03  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
21:34:18  lf-activate-venv(): INFO: Adding /tmp/venv-WQpI/bin to PATH
21:34:24  -----> Active servers
21:34:24  prd-centos8-builder-2c-2g-1286
21:34:24  prd-ubuntu2204-docker-8c-8g-1285
21:34:24  prd-centos8-robot-2c-8g-1039
21:34:24  prd-centos8-robot-2c-8g-773
21:34:24  prd-queue-intque-2c-1g-772
21:34:24  -----> Delete orphaned servers
21:34:25  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
21:34:25  Run condition [Boolean condition] enabling perform for step [Execute shell]
21:34:25  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins16881226930061572164.sh
21:34:25  ---> Orphaned ports
21:34:25  Setup pyenv:
21:34:25    system
21:34:25    3.8.13
21:34:25    3.9.13
21:34:25    3.10.13
21:34:25  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
21:34:25  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-WQpI from file:/tmp/.os_lf_venv
21:34:25  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
21:34:25  lf-activate-venv(): INFO: Attempting to install with network-safe options...
21:34:27  lf-activate-venv(): INFO: Base packages installed successfully
21:34:27  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] python-openstackclient 
21:34:39  lf-activate-venv(): INFO: Adding /tmp/venv-WQpI/bin to PATH
21:34:41  No orphaned ports to process.
21:34:41  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
21:34:41  Run condition [Boolean condition] enabling perform for step [Execute shell]
21:34:41  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins14821129677916582666.sh
21:34:41  ---> Orphaned volumes
21:34:41  + source /home/jenkins/lf-env.sh
21:34:41  + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
21:34:41  ++ mktemp -d /tmp/venv-XXXX
21:34:41  + lf_venv=/tmp/venv-O75K
21:34:41  + local venv_file=/tmp/.os_lf_venv
21:34:41  + local python=python3
21:34:41  + local options
21:34:41  + local set_path=true
21:34:41  + local install_args=
21:34:41  ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
21:34:41  + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
21:34:41  + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
21:34:41  ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
21:34:41  + true
21:34:41  + case $1 in
21:34:41  + python=python3
21:34:41  + shift 2
21:34:41  + true
21:34:41  + case $1 in
21:34:41  + shift
21:34:41  + break
21:34:41  + case $python in
21:34:41  + local pkg_list=
21:34:41  + [[ -d /opt/pyenv ]]
21:34:41  + echo 'Setup pyenv:'
21:34:41  Setup pyenv:
21:34:41  + export PYENV_ROOT=/opt/pyenv
21:34:41  + PYENV_ROOT=/opt/pyenv
21:34:41  + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
21:34:41  + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
21:34:41  + pyenv versions
21:34:41    system
21:34:41    3.8.13
21:34:41    3.9.13
21:34:41    3.10.13
21:34:41  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
21:34:41  + command -v pyenv
21:34:41  ++ pyenv init - --no-rehash
21:34:41  + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); 
21:34:41  for i in ${!paths[@]}; do 
21:34:41  if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; 
21:34:41  fi; done; 
21:34:41  echo "${paths[*]}"'\'')"
21:34:41  export PATH="/opt/pyenv/shims:${PATH}"
21:34:41  export PYENV_SHELL=bash
21:34:41  source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\''
21:34:41  pyenv() {
21:34:41    local command
21:34:41    command="${1:-}"
21:34:41    if [ "$#" -gt 0 ]; then
21:34:41      shift
21:34:41    fi
21:34:41  
21:34:41    case "$command" in
21:34:41    rehash|shell)
21:34:41      eval "$(pyenv "sh-$command" "$@")"
21:34:41      ;;
21:34:41    *)
21:34:41      command pyenv "$command" "$@"
21:34:41      ;;
21:34:41    esac
21:34:41  }'
21:34:41  +++ bash --norc -ec 'IFS=:; paths=($PATH); 
21:34:41  for i in ${!paths[@]}; do 
21:34:41  if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; 
21:34:41  fi; done; 
21:34:41  echo "${paths[*]}"'
21:34:41  ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
21:34:41  ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
21:34:41  ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
21:34:41  ++ export PYENV_SHELL=bash
21:34:41  ++ PYENV_SHELL=bash
21:34:41  ++ source /opt/pyenv/libexec/../completions/pyenv.bash
21:34:41  +++ complete -F _pyenv pyenv
21:34:41  ++ lf-pyver python3
21:34:41  ++ local py_version_xy=python3
21:34:41  ++ local py_version_xyz=
21:34:41  ++ sed 's/^[ *]* //'
21:34:41  ++ pyenv versions
21:34:41  ++ local command
21:34:41  ++ command=versions
21:34:41  ++ '[' 1 -gt 0 ']'
21:34:41  ++ shift
21:34:41  ++ case "$command" in
21:34:41  ++ command pyenv versions
21:34:41  ++ pyenv versions
21:34:41  ++ awk '{ print $1 }'
21:34:41  ++ grep -E '^[0-9.]*[0-9]$'
21:34:41  ++ [[ ! -s /tmp/.pyenv_versions ]]
21:34:41  +++ tail -n 1
21:34:41  +++ grep '^3' /tmp/.pyenv_versions
21:34:41  +++ sort -V
21:34:41  ++ py_version_xyz=3.11.7
21:34:41  ++ [[ -z 3.11.7 ]]
21:34:41  ++ echo 3.11.7
21:34:41  ++ return 0
21:34:41  + pyenv local 3.11.7
21:34:41  + local command
21:34:41  + command=local
21:34:41  + '[' 2 -gt 0 ']'
21:34:41  + shift
21:34:41  + case "$command" in
21:34:41  + command pyenv local 3.11.7
21:34:41  + pyenv local 3.11.7
21:34:42  + for arg in "$@"
21:34:42  + case $arg in
21:34:42  + pkg_list+='lftools[openstack] '
21:34:42  + for arg in "$@"
21:34:42  + case $arg in
21:34:42  + pkg_list+='kubernetes '
21:34:42  + for arg in "$@"
21:34:42  + case $arg in
21:34:42  + pkg_list+='niet '
21:34:42  + for arg in "$@"
21:34:42  + case $arg in
21:34:42  + pkg_list+='python-heatclient '
21:34:42  + for arg in "$@"
21:34:42  + case $arg in
21:34:42  + pkg_list+='python-openstackclient '
21:34:42  + for arg in "$@"
21:34:42  + case $arg in
21:34:42  + pkg_list+='python-magnumclient '
21:34:42  + for arg in "$@"
21:34:42  + case $arg in
21:34:42  + pkg_list+='yq '
21:34:42  + [[ -f /tmp/.os_lf_venv ]]
21:34:42  ++ cat /tmp/.os_lf_venv
21:34:42  + lf_venv=/tmp/venv-WQpI
21:34:42  + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-WQpI from' file:/tmp/.os_lf_venv
21:34:42  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-WQpI from file:/tmp/.os_lf_venv
21:34:42  + echo 'lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)'
21:34:42  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
21:34:42  + local 'pip_opts=--upgrade --quiet'
21:34:42  + pip_opts='--upgrade --quiet --trusted-host pypi.org'
21:34:42  + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org'
21:34:42  + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org'
21:34:42  + [[ -n '' ]]
21:34:42  + [[ -n '' ]]
21:34:42  + echo 'lf-activate-venv(): INFO: Attempting to install with network-safe options...'
21:34:42  lf-activate-venv(): INFO: Attempting to install with network-safe options...
21:34:42  + /tmp/venv-WQpI/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org pip 'setuptools<66' virtualenv
21:34:44  + echo 'lf-activate-venv(): INFO: Base packages installed successfully'
21:34:44  lf-activate-venv(): INFO: Base packages installed successfully
21:34:44  + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq  ]]
21:34:44  + echo 'lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq '
21:34:44  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
21:34:44  + /tmp/venv-WQpI/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
21:35:00  + type python3
21:35:00  + true
21:35:00  + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-WQpI/bin to PATH'
21:35:00  lf-activate-venv(): INFO: Adding /tmp/venv-WQpI/bin to PATH
21:35:00  + PATH=/tmp/venv-WQpI/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
21:35:00  + return 0
21:35:00  + mapfile -t os_volumes
21:35:00  ++ openstack --os-cloud vex volume list -f value -c ID --status Available
21:35:02  + '[' 0 -eq 0 ']'
21:35:02  + echo 'No orphaned volumes found.'
21:35:02  No orphaned volumes found.
21:35:03  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
21:35:03  Run condition [Boolean condition] enabling perform for step [Execute shell]
21:35:03  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins7002514886702344087.sh
21:35:03  ---> Protect in-use images
21:35:03  Setup pyenv:
21:35:03    system
21:35:03    3.8.13
21:35:03    3.9.13
21:35:03    3.10.13
21:35:03  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
21:35:03  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-WQpI from file:/tmp/.os_lf_venv
21:35:03  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
21:35:03  lf-activate-venv(): INFO: Attempting to install with network-safe options...
21:35:05  lf-activate-venv(): INFO: Base packages installed successfully
21:35:05  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient 
21:35:19  lf-activate-venv(): INFO: Adding /tmp/venv-WQpI/bin to PATH
21:35:19  INFO: There are images to protect defined in jenkins-config.
21:35:19  INFO: There are additional images to protect in the jjb dir.
21:35:19  INFO: Protecting the following images:
21:35:19  ZZCI - CentOS 7 - builder - x86_64 - 20240701-060130.538
21:35:19  ZZCI - CentOS 7 - devstack-rocky - x86_64 - 20221101-000109.537"  # Unused
21:35:19  ZZCI - CentOS 7 - devstack-stein - x86_64 - 20221101-010107.368"  # Unused
21:35:19  ZZCI - CentOS 7 - devstack - x86_64 - 20240601-230133.464"  # Unused
21:35:19  ZZCI - CentOS 7 - docker - x86_64 - 20240601-220142.195
21:35:19  ZZCI - CentOS 7 - helm - x86_64 - 20230301-000133.034
21:35:19  ZZCI - CentOS 7 - robot - x86_64 - 20240601-220241.858
21:35:19  ZZCI - CentOS Stream 8 - builder - x86_64 - 20240601-160217.263
21:35:19  ZZCI - CentOS Stream 8 - robot - x86_64 - 20240601-010231.803
21:35:19  ZZCI - Ubuntu 18.04 - docker - x86_64 - 20250201-040221.796
21:35:19  ZZCI - Ubuntu 18.04 - helm - x86_64 - 20230301-140059.950
21:35:19  ZZCI - Ubuntu 20.04 - docker - x86_64 - 20250201-160239.450
21:35:19  ZZCI - Ubuntu 22.04 - builder - x86_64 - 20250201-010426.857
21:35:19  ZZCI - Ubuntu 22.04 - devstack - x86_64 - 20231031-095146.118"  # Unused
21:35:19  ZZCI - Ubuntu 22.04 - docker - x86_64 - 20250201-170115.786
21:35:19  ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 - 20250201-060151.911
21:35:21  Protected setting for ZZCI - CentOS 7 - builder - x86_64 - 20240701-060130.538: True
21:35:22  No Image found for ZZCI - CentOS 7 - devstack-rocky - x86_64 - 20221101-000109.537"  # Unused
21:35:22  Build step 'Conditional step (single)' marked build as failure
21:35:22  $ ssh-agent -k
21:35:22  unset SSH_AUTH_SOCK;
21:35:22  unset SSH_AGENT_PID;
21:35:22  echo Agent pid 5445 killed;
21:35:22  [ssh-agent] Stopped.
21:35:23  [PostBuildScript] - [INFO] Executing post build scripts.
21:35:23  [builder-openstack-cron] $ /bin/bash /tmp/jenkins3526429328700451954.sh
21:35:23  ---> sysstat.sh
21:35:23  [builder-openstack-cron] $ /bin/bash /tmp/jenkins16185067774795785007.sh
21:35:23  ---> package-listing.sh
21:35:23  ++ facter osfamily
21:35:23  ++ tr '[:upper:]' '[:lower:]'
21:35:23  + OS_FAMILY=redhat
21:35:23  + workspace=/w/workspace/builder-openstack-cron
21:35:23  + START_PACKAGES=/tmp/packages_start.txt
21:35:23  + END_PACKAGES=/tmp/packages_end.txt
21:35:23  + DIFF_PACKAGES=/tmp/packages_diff.txt
21:35:23  + PACKAGES=/tmp/packages_start.txt
21:35:23  + '[' /w/workspace/builder-openstack-cron ']'
21:35:23  + PACKAGES=/tmp/packages_end.txt
21:35:23  + case "${OS_FAMILY}" in
21:35:23  + rpm -qa
21:35:23  + sort
21:35:24  + '[' -f /tmp/packages_start.txt ']'
21:35:24  + '[' -f /tmp/packages_end.txt ']'
21:35:24  + diff /tmp/packages_start.txt /tmp/packages_end.txt
21:35:24  + '[' /w/workspace/builder-openstack-cron ']'
21:35:24  + mkdir -p /w/workspace/builder-openstack-cron/archives/
21:35:24  + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/builder-openstack-cron/archives/
21:35:24  [builder-openstack-cron] $ /bin/bash /tmp/jenkins7121344551280439763.sh
21:35:24  ---> capture-instance-metadata.sh
21:35:24  Setup pyenv:
21:35:24    system
21:35:24    3.8.13
21:35:24    3.9.13
21:35:24    3.10.13
21:35:24  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
21:35:24  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-WQpI from file:/tmp/.os_lf_venv
21:35:24  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
21:35:24  lf-activate-venv(): INFO: Attempting to install with network-safe options...
21:35:26  lf-activate-venv(): INFO: Base packages installed successfully
21:35:26  lf-activate-venv(): INFO: Installing additional packages: lftools 
21:35:36  lf-activate-venv(): INFO: Adding /tmp/venv-WQpI/bin to PATH
21:35:36  INFO: Running in OpenStack, capturing instance metadata
21:35:36  [builder-openstack-cron] $ /bin/bash /tmp/jenkins9316099347268849861.sh
21:35:36  provisioning config files...
21:35:36  Could not find credentials [logs] for builder-openstack-cron #73986
21:35:36  copy managed file [jenkins-log-archives-settings] to file:/w/workspace/builder-openstack-cron@tmp/config2735534313100360378tmp
21:35:36  Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index]
21:35:36  Run condition [Regular expression match] enabling perform for step [Provide Configuration files]
21:35:36  provisioning config files...
21:35:36  copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials
21:35:36  [EnvInject] - Injecting environment variables from a build step.
21:35:36  [EnvInject] - Injecting as environment variables the properties content 
21:35:36  SERVER_ID=logs
21:35:36  
21:35:36  [EnvInject] - Variables injected successfully.
21:35:36  [builder-openstack-cron] $ /bin/bash /tmp/jenkins9572233515595175940.sh
21:35:36  ---> create-netrc.sh
21:35:36  WARN: Log server credential not found.
21:35:36  [builder-openstack-cron] $ /bin/bash /tmp/jenkins1988393360433179043.sh
21:35:36  ---> python-tools-install.sh
21:35:36  Setup pyenv:
21:35:37    system
21:35:37    3.8.13
21:35:37    3.9.13
21:35:37    3.10.13
21:35:37  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
21:35:37  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-WQpI from file:/tmp/.os_lf_venv
21:35:37  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
21:35:37  lf-activate-venv(): INFO: Attempting to install with network-safe options...
21:35:39  lf-activate-venv(): INFO: Base packages installed successfully
21:35:39  lf-activate-venv(): INFO: Installing additional packages: lftools 
21:35:49  lf-activate-venv(): INFO: Adding /tmp/venv-WQpI/bin to PATH
21:35:49  [builder-openstack-cron] $ /bin/bash /tmp/jenkins3291302546035260061.sh
21:35:49  ---> sudo-logs.sh
21:35:49  Archiving 'sudo' log..
21:35:49  [builder-openstack-cron] $ /bin/bash /tmp/jenkins4690126709256587642.sh
21:35:49  ---> job-cost.sh
21:35:49  Setup pyenv:
21:35:49    system
21:35:49    3.8.13
21:35:49    3.9.13
21:35:49    3.10.13
21:35:49  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
21:35:50  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-WQpI from file:/tmp/.os_lf_venv
21:35:50  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
21:35:50  lf-activate-venv(): INFO: Attempting to install with network-safe options...
21:35:52  lf-activate-venv(): INFO: Base packages installed successfully
21:35:52  lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
21:35:59  lf-activate-venv(): INFO: Adding /tmp/venv-WQpI/bin to PATH
21:35:59  INFO: No Stack...
21:36:00  INFO: Retrieving Pricing Info for: v3-standard-2
21:36:00  INFO: Archiving Costs
21:36:00  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins6099718911740004582.sh
21:36:00  ---> logs-deploy.sh
21:36:00  Setup pyenv:
21:36:00    system
21:36:00    3.8.13
21:36:00    3.9.13
21:36:00    3.10.13
21:36:00  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
21:36:01  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-WQpI from file:/tmp/.os_lf_venv
21:36:01  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
21:36:01  lf-activate-venv(): INFO: Attempting to install with network-safe options...
21:36:03  lf-activate-venv(): INFO: Base packages installed successfully
21:36:03  lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 
21:36:14  lf-activate-venv(): INFO: Adding /tmp/venv-WQpI/bin to PATH
21:36:14  WARNING: Nexus logging server not set
21:36:14  INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/builder-openstack-cron/73986/
21:36:14  INFO: archiving logs to S3
21:36:15  ---> uname -a:
21:36:15  Linux prd-centos8-builder-2c-2g-1286.novalocal 4.18.0-553.5.1.el8.x86_64 #1 SMP Tue May 21 05:46:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
21:36:15  
21:36:15  
21:36:15  ---> lscpu:
21:36:15  Architecture:        x86_64
21:36:15  CPU op-mode(s):      32-bit, 64-bit
21:36:15  Byte Order:          Little Endian
21:36:15  CPU(s):              2
21:36:15  On-line CPU(s) list: 0,1
21:36:15  Thread(s) per core:  1
21:36:15  Core(s) per socket:  1
21:36:15  Socket(s):           2
21:36:15  NUMA node(s):        1
21:36:15  Vendor ID:           AuthenticAMD
21:36:15  CPU family:          23
21:36:15  Model:               49
21:36:15  Model name:          AMD EPYC-Rome Processor
21:36:15  Stepping:            0
21:36:15  CPU MHz:             2800.000
21:36:15  BogoMIPS:            5600.00
21:36:15  Virtualization:      AMD-V
21:36:15  Hypervisor vendor:   KVM
21:36:15  Virtualization type: full
21:36:15  L1d cache:           32K
21:36:15  L1i cache:           32K
21:36:15  L2 cache:            512K
21:36:15  L3 cache:            16384K
21:36:15  NUMA node0 CPU(s):   0,1
21:36:15  Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
21:36:15  
21:36:15  
21:36:15  ---> nproc:
21:36:15  2
21:36:15  
21:36:15  
21:36:15  ---> df -h:
21:36:15  Filesystem      Size  Used Avail Use% Mounted on
21:36:15  devtmpfs        3.8G     0  3.8G   0% /dev
21:36:15  tmpfs           3.8G     0  3.8G   0% /dev/shm
21:36:15  tmpfs           3.8G   17M  3.8G   1% /run
21:36:15  tmpfs           3.8G     0  3.8G   0% /sys/fs/cgroup
21:36:15  /dev/vda1        40G  8.4G   32G  22% /
21:36:15  tmpfs           770M     0  770M   0% /run/user/1001
21:36:15  
21:36:15  
21:36:15  ---> free -m:
21:36:15                total        used        free      shared  buff/cache   available
21:36:15  Mem:           7697         621        4813          19        2263        6779
21:36:15  Swap:          1023           0        1023
21:36:15  
21:36:15  
21:36:15  ---> ip addr:
21:36:15  1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
21:36:15      link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
21:36:15      inet 127.0.0.1/8 scope host lo
21:36:15         valid_lft forever preferred_lft forever
21:36:15      inet6 ::1/128 scope host 
21:36:15         valid_lft forever preferred_lft forever
21:36:15  2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1458 qdisc mq state UP group default qlen 1000
21:36:15      link/ether fa:16:3e:ae:1c:f8 brd ff:ff:ff:ff:ff:ff
21:36:15      altname enp0s3
21:36:15      altname ens3
21:36:15      inet 10.30.171.224/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0
21:36:15         valid_lft 86119sec preferred_lft 86119sec
21:36:15      inet6 fe80::f816:3eff:feae:1cf8/64 scope link 
21:36:15         valid_lft forever preferred_lft forever
21:36:15  3: docker0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1458 qdisc noqueue state DOWN group default 
21:36:15      link/ether 02:42:f0:63:9b:85 brd ff:ff:ff:ff:ff:ff
21:36:15      inet 10.250.0.254/24 brd 10.250.0.255 scope global docker0
21:36:15         valid_lft forever preferred_lft forever
21:36:15  
21:36:15  
21:36:15  ---> sar -b -r -n DEV:
21:36:15  Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-builder-5e6ee0fb-b6d9-4116-90d4-35c890e2b0f7.nov) 	09/25/2025 	_x86_64_	(2 CPU)
21:36:15  
21:36:15  21:31:30     LINUX RESTART	(2 CPU)
21:36:15  
21:36:15  09:32:01 PM       tps      rtps      wtps   bread/s   bwrtn/s
21:36:15  09:33:01 PM    222.09     19.44    202.65   5485.24   7177.26
21:36:15  09:34:01 PM    114.36      0.53    113.83     72.11  12252.42
21:36:15  09:35:01 PM     35.71      0.27     35.44     34.66   1827.41
21:36:15  09:36:01 PM     22.58      0.50     22.08     63.71    573.29
21:36:15  Average:        98.69      5.19     93.50   1413.99   5457.75
21:36:15  
21:36:15  09:32:01 PM kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
21:36:15  09:33:01 PM   5204860   7038696   2677572     33.97      2688   2016504    930280     10.42    200340   2153528    167204
21:36:15  09:34:01 PM   5024080   7029816   2858352     36.26      2688   2180960    920404     10.31    230000   2275604     42940
21:36:15  09:35:01 PM   4970444   6977044   2911988     36.94      2688   2181908    961328     10.76    267832   2291360     10760
21:36:15  09:36:01 PM   5005684   7017812   2876748     36.50      2688   2187028    916900     10.27    422756   2099864     26992
21:36:15  Average:      5051267   7015842   2831165     35.92      2688   2141600    932228     10.44    280232   2205089     61974
21:36:15  
21:36:15  09:32:01 PM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
21:36:15  09:33:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
21:36:15  09:33:01 PM      eth0    304.80    191.17   1782.11     62.87      0.00      0.00      0.00      0.00
21:36:15  09:33:01 PM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
21:36:15  09:34:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
21:36:15  09:34:01 PM      eth0     73.71     60.01    846.18     10.06      0.00      0.00      0.00      0.00
21:36:15  09:34:01 PM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
21:36:15  09:35:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
21:36:15  09:35:01 PM      eth0     22.61     22.96     26.49      9.75      0.00      0.00      0.00      0.00
21:36:15  09:35:01 PM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
21:36:15  09:36:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
21:36:15  09:36:01 PM      eth0     23.16     20.94     19.25     10.63      0.00      0.00      0.00      0.00
21:36:15  09:36:01 PM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
21:36:15  Average:           lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
21:36:15  Average:         eth0    106.07     73.77    668.53     23.33      0.00      0.00      0.00      0.00
21:36:15  Average:      docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
21:36:15  
21:36:15  
21:36:15  ---> sar -P ALL:
21:36:15  Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-builder-5e6ee0fb-b6d9-4116-90d4-35c890e2b0f7.nov) 	09/25/2025 	_x86_64_	(2 CPU)
21:36:15  
21:36:15  21:31:30     LINUX RESTART	(2 CPU)
21:36:15  
21:36:15  09:32:01 PM     CPU     %user     %nice   %system   %iowait    %steal     %idle
21:36:15  09:33:01 PM     all     40.28      0.00      7.05      2.35      0.10     50.22
21:36:15  09:33:01 PM       0     29.78      0.00      7.13      2.53      0.10     60.46
21:36:15  09:33:01 PM       1     50.78      0.00      6.96      2.18      0.10     39.98
21:36:15  09:34:01 PM     all     33.59      0.00      4.88      2.72      0.10     58.72
21:36:15  09:34:01 PM       0     18.15      0.00      3.85      2.00      0.10     75.90
21:36:15  09:34:01 PM       1     49.06      0.00      5.91      3.44      0.10     41.50
21:36:15  09:35:01 PM     all     34.97      0.00      3.67      0.31      0.08     60.97
21:36:15  09:35:01 PM       0     26.26      0.00      3.48      0.35      0.08     69.82
21:36:15  09:35:01 PM       1     43.68      0.00      3.85      0.27      0.08     52.12
21:36:15  09:36:01 PM     all     36.87      0.00      4.74      0.17      0.08     58.14
21:36:15  09:36:01 PM       0     19.81      0.00      4.18      0.13      0.08     75.80
21:36:15  09:36:01 PM       1     53.95      0.00      5.31      0.20      0.08     40.46
21:36:15  Average:        all     36.42      0.00      5.08      1.39      0.09     57.02
21:36:15  Average:          0     23.49      0.00      4.66      1.25      0.09     70.51
21:36:15  Average:          1     49.37      0.00      5.51      1.52      0.09     43.52
21:36:15  
21:36:15  
21:36:15