21:32:05  Started by timer
21:32:05  Running as SYSTEM
21:32:05  [EnvInject] - Loading node environment variables.
21:32:05  Building remotely on prd-centos8-builder-2c-2g-941 (centos8-builder-2c-2g) in workspace /w/workspace/builder-openstack-cron
21:32:06  [ssh-agent] Looking for ssh-agent implementation...
21:32:06  [ssh-agent]   Exec ssh-agent (binary ssh-agent on a remote machine)
21:32:06  $ ssh-agent
21:32:06  SSH_AUTH_SOCK=/tmp/ssh-f8qgzO4fnv2B/agent.5456
21:32:06  SSH_AGENT_PID=5457
21:32:06  [ssh-agent] Started.
21:32:06  Running ssh-add (command line suppressed)
21:32:06  Identity added: /w/workspace/builder-openstack-cron@tmp/private_key_16811834885561739708.key (/w/workspace/builder-openstack-cron@tmp/private_key_16811834885561739708.key)
21:32:06  [ssh-agent] Using credentials jenkins (jenkins-ssh)
21:32:06  The recommended git tool is: NONE
21:32:09  using credential jenkins-ssh
21:32:09  Wiping out workspace first.
21:32:09  Cloning the remote Git repository
21:32:09  Cloning repository git://devvexx.opendaylight.org/mirror/releng/builder
21:32:09   > git init /w/workspace/builder-openstack-cron # timeout=10
21:32:09  Fetching upstream changes from git://devvexx.opendaylight.org/mirror/releng/builder
21:32:09   > git --version # timeout=10
21:32:09   > git --version # 'git version 2.43.0'
21:32:09  using GIT_SSH to set credentials jenkins-ssh
21:32:09  [INFO] Currently running in a labeled security context
21:32:09  [INFO] Currently SELinux is 'enforcing' on the host
21:32:09   > /usr/bin/chcon --type=ssh_home_t /w/workspace/builder-openstack-cron@tmp/jenkins-gitclient-ssh6049043675936459186.key
21:32:09  Verifying host key using known hosts file
21:32:09  You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
21:32:09   > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/releng/builder +refs/heads/*:refs/remotes/origin/* # timeout=10
21:32:11   > git config remote.origin.url git://devvexx.opendaylight.org/mirror/releng/builder # timeout=10
21:32:11   > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
21:32:12  Avoid second fetch
21:32:12   > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
21:32:12  Checking out Revision 202d5eaf4e7a3a35bcb397374eb2ede98b8a5d3b (refs/remotes/origin/master)
21:32:12   > git config core.sparsecheckout # timeout=10
21:32:12   > git checkout -f 202d5eaf4e7a3a35bcb397374eb2ede98b8a5d3b # timeout=10
21:32:12  Commit message: "Merge "Chore: Add SPDX header to jenkins.ini.example""
21:32:12   > git rev-list --no-walk 202d5eaf4e7a3a35bcb397374eb2ede98b8a5d3b # timeout=10
21:32:12   > git remote # timeout=10
21:32:12   > git submodule init # timeout=10
21:32:12   > git submodule sync # timeout=10
21:32:13   > git config --get remote.origin.url # timeout=10
21:32:13   > git submodule init # timeout=10
21:32:13   > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10
21:32:13   > git config --get submodule.global-jjb.url # timeout=10
21:32:13   > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10
21:32:13   > git config --get submodule.packer/common-packer.url # timeout=10
21:32:13   > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10
21:32:13   > git submodule update --init --recursive global-jjb # timeout=10
21:32:14   > git submodule update --init --recursive packer/common-packer # timeout=10
21:32:18  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
21:32:18  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
21:32:18  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
21:32:18  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
21:32:18  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
21:32:18  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
21:32:18  Run condition [Boolean condition] enabling prebuild for step [BuilderChain]
21:32:18  No emails were triggered.
21:32:18  provisioning config files...
21:32:18  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
21:32:18  copy managed file [npmrc] to file:/home/jenkins/.npmrc
21:32:18  copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
21:32:18  [builder-openstack-cron] $ /bin/bash /tmp/jenkins5088199666043716014.sh
21:32:18  ---> python-tools-install.sh
21:32:18  Setup pyenv:
21:32:18    system
21:32:18  * 3.8.13 (set by /opt/pyenv/version)
21:32:18  * 3.9.13 (set by /opt/pyenv/version)
21:32:18  * 3.10.13 (set by /opt/pyenv/version)
21:32:18  * 3.11.7 (set by /opt/pyenv/version)
21:32:23  lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-driG
21:32:23  lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
21:32:23  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
21:32:23  lf-activate-venv(): INFO: Attempting to install with network-safe options...
21:32:27  lf-activate-venv(): INFO: Base packages installed successfully
21:32:27  lf-activate-venv(): INFO: Installing additional packages: lftools 
21:32:53  lf-activate-venv(): INFO: Adding /tmp/venv-driG/bin to PATH
21:32:53  Generating Requirements File
21:33:13  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
21:33:13  httplib2 0.31.0 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible.
21:33:13  Python 3.11.7
21:33:13  pip 25.2 from /tmp/venv-driG/lib/python3.11/site-packages/pip (python 3.11)
21:33:14  appdirs==1.4.4
21:33:14  argcomplete==3.6.2
21:33:14  aspy.yaml==1.3.0
21:33:14  attrs==25.3.0
21:33:14  autopage==0.5.2
21:33:14  beautifulsoup4==4.13.5
21:33:14  boto3==1.40.38
21:33:14  botocore==1.40.38
21:33:14  bs4==0.0.2
21:33:14  cachetools==5.5.2
21:33:14  certifi==2025.8.3
21:33:14  cffi==2.0.0
21:33:14  cfgv==3.4.0
21:33:14  chardet==5.2.0
21:33:14  charset-normalizer==3.4.3
21:33:14  click==8.3.0
21:33:14  cliff==4.11.0
21:33:14  cmd2==2.7.0
21:33:14  cryptography==3.3.2
21:33:14  debtcollector==3.0.0
21:33:14  decorator==5.2.1
21:33:14  defusedxml==0.7.1
21:33:14  Deprecated==1.2.18
21:33:14  distlib==0.4.0
21:33:14  dnspython==2.8.0
21:33:14  docker==7.1.0
21:33:14  dogpile.cache==1.4.1
21:33:14  durationpy==0.10
21:33:14  email-validator==2.3.0
21:33:14  filelock==3.19.1
21:33:14  future==1.0.0
21:33:14  gitdb==4.0.12
21:33:14  GitPython==3.1.45
21:33:14  google-auth==2.40.3
21:33:14  httplib2==0.31.0
21:33:14  identify==2.6.14
21:33:14  idna==3.10
21:33:14  importlib-resources==1.5.0
21:33:14  iso8601==2.1.0
21:33:14  Jinja2==3.1.6
21:33:14  jmespath==1.0.1
21:33:14  jsonpatch==1.33
21:33:14  jsonpointer==3.0.0
21:33:14  jsonschema==4.25.1
21:33:14  jsonschema-specifications==2025.9.1
21:33:14  keystoneauth1==5.12.0
21:33:14  kubernetes==33.1.0
21:33:14  lftools==0.37.14
21:33:14  lxml==6.0.2
21:33:14  markdown-it-py==4.0.0
21:33:14  MarkupSafe==3.0.2
21:33:14  mdurl==0.1.2
21:33:14  msgpack==1.1.1
21:33:14  multi_key_dict==2.0.3
21:33:14  munch==4.0.0
21:33:14  netaddr==1.3.0
21:33:14  niet==1.4.2
21:33:14  nodeenv==1.9.1
21:33:14  oauth2client==4.1.3
21:33:14  oauthlib==3.3.1
21:33:14  openstacksdk==4.7.1
21:33:14  os-service-types==1.8.0
21:33:14  osc-lib==4.2.0
21:33:14  oslo.config==10.0.0
21:33:14  oslo.context==6.1.0
21:33:14  oslo.i18n==6.6.0
21:33:14  oslo.log==7.2.1
21:33:14  oslo.serialization==5.8.0
21:33:14  oslo.utils==9.1.0
21:33:14  packaging==25.0
21:33:14  pbr==7.0.1
21:33:14  platformdirs==4.4.0
21:33:14  prettytable==3.16.0
21:33:14  psutil==7.1.0
21:33:14  pyasn1==0.6.1
21:33:14  pyasn1_modules==0.4.2
21:33:14  pycparser==2.23
21:33:14  pygerrit2==2.0.15
21:33:14  PyGithub==2.8.1
21:33:14  Pygments==2.19.2
21:33:14  PyJWT==2.10.1
21:33:14  PyNaCl==1.6.0
21:33:14  pyparsing==2.4.7
21:33:14  pyperclip==1.10.0
21:33:14  pyrsistent==0.20.0
21:33:14  python-cinderclient==9.8.0
21:33:14  python-dateutil==2.9.0.post0
21:33:14  python-heatclient==4.3.0
21:33:14  python-jenkins==1.8.3
21:33:14  python-keystoneclient==5.7.0
21:33:14  python-magnumclient==4.9.0
21:33:14  python-openstackclient==8.2.0
21:33:14  python-swiftclient==4.8.0
21:33:14  PyYAML==6.0.2
21:33:14  referencing==0.36.2
21:33:14  requests==2.32.5
21:33:14  requests-oauthlib==2.0.0
21:33:14  requestsexceptions==1.4.0
21:33:14  rfc3986==2.0.0
21:33:14  rich==14.1.0
21:33:14  rich-argparse==1.7.1
21:33:14  rpds-py==0.27.1
21:33:14  rsa==4.9.1
21:33:14  ruamel.yaml==0.18.15
21:33:14  ruamel.yaml.clib==0.2.14
21:33:14  s3transfer==0.14.0
21:33:14  simplejson==3.20.1
21:33:14  six==1.17.0
21:33:14  smmap==5.0.2
21:33:14  soupsieve==2.8
21:33:14  stevedore==5.5.0
21:33:14  tabulate==0.9.0
21:33:14  toml==0.10.2
21:33:14  tomlkit==0.13.3
21:33:14  tqdm==4.67.1
21:33:14  typing_extensions==4.15.0
21:33:14  tzdata==2025.2
21:33:14  urllib3==1.26.20
21:33:14  virtualenv==20.34.0
21:33:14  wcwidth==0.2.14
21:33:14  websocket-client==1.8.0
21:33:14  wrapt==1.17.3
21:33:14  xdg==6.0.0
21:33:14  xmltodict==1.0.2
21:33:14  yq==3.4.3
21:33:14  [EnvInject] - Injecting environment variables from a build step.
21:33:14  [EnvInject] - Injecting as environment variables the properties content 
21:33:14  OS_CLOUD=vex
21:33:14  
21:33:14  [EnvInject] - Variables injected successfully.
21:33:14  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
21:33:14  Run condition [Boolean condition] enabling perform for step [Execute shell]
21:33:14  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins3346838498462943488.sh
21:33:14  ---> Orphaned k8s clusters
21:33:14  Setup pyenv:
21:33:14    system
21:33:14    3.8.13
21:33:14    3.9.13
21:33:14    3.10.13
21:33:14  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
21:33:14  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-driG from file:/tmp/.os_lf_venv
21:33:14  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
21:33:14  lf-activate-venv(): INFO: Attempting to install with network-safe options...
21:33:16  lf-activate-venv(): INFO: Base packages installed successfully
21:33:16  lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 
21:33:23  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
21:33:23  lftools 0.37.14 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible.
21:33:24  lf-activate-venv(): INFO: Adding /tmp/venv-driG/bin to PATH
21:33:26  -----> Delete orphaned cluster
21:33:26  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
21:33:26  Run condition [Boolean condition] enabling perform for step [Execute shell]
21:33:26  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins12409606760470465990.sh
21:33:26  ---> Orphaned stacks
21:33:26  Setup pyenv:
21:33:26    system
21:33:26    3.8.13
21:33:26    3.9.13
21:33:26    3.10.13
21:33:26  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
21:33:27  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-driG from file:/tmp/.os_lf_venv
21:33:27  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
21:33:27  lf-activate-venv(): INFO: Attempting to install with network-safe options...
21:33:29  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
21:33:29  lftools 0.37.14 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible.
21:33:29  lf-activate-venv(): INFO: Base packages installed successfully
21:33:29  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 
21:33:45  lf-activate-venv(): INFO: Adding /tmp/venv-driG/bin to PATH
21:33:45  + mapfile -t OS_COE_CLUSTERS_ID
21:33:45  ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name
21:33:45  ++ awk '{print $1}'
21:33:45  ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)'
21:33:47  + echo '-----> Active clusters -> stacks'
21:33:47  -----> Active clusters -> stacks
21:33:47  + OS_COE_STACKS=()
21:33:47  + [[ 0 -gt 0 ]]
21:33:47  + mapfile -t OS_STACKS
21:33:47  ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED
21:33:47  ++ awk '{print $1}'
21:33:49  + echo '-----> Active stacks'
21:33:49  -----> Active stacks
21:33:49  + for stack in "${OS_STACKS[@]}"
21:33:49  + echo releng-openflowplugin-csit-1node-sanity-only-scandium-493
21:33:49  releng-openflowplugin-csit-1node-sanity-only-scandium-493
21:33:49  + echo '-----> Delete orphaned stacks'
21:33:49  -----> Delete orphaned stacks
21:33:49  + for STACK_NAME in "${OS_STACKS[@]}"
21:33:49  + [[ 0 -gt 0 ]]
21:33:49  + stack_in_jenkins releng-openflowplugin-csit-1node-sanity-only-scandium-493 https://jenkins.opendaylight.org/releng https://jenkins.opendaylight.org/sandbox
21:33:49  + STACK_NAME=releng-openflowplugin-csit-1node-sanity-only-scandium-493
21:33:49  + builds=()
21:33:49  + for jenkins in "${@:2}"
21:33:49  + PARAMS='tree=computer[executors[currentExecutable[url]],'
21:33:49  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]'
21:33:49  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
21:33:49  + JENKINS_URL='https://jenkins.opendaylight.org/releng/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
21:33:49  ++ curl -s -w '\n\n%{http_code}' --globoff -H Content-Type:application/json 'https://jenkins.opendaylight.org/releng/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
21:33:49  + resp='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73962/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]}
21:33:49  
21:33:49  200'
21:33:49  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73962/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]}
21:33:49  
21:33:49  200'
21:33:49  ++ head -n1
21:33:49  + json_data='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73962/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]}'
21:33:49  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73962/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]}
21:33:49  
21:33:49  200'
21:33:49  ++ awk 'END {print $NF}'
21:33:49  + status=200
21:33:49  + '[' 200 '!=' 200 ']'
21:33:49  + [[ https://jenkins.opendaylight.org/releng == *\j\e\n\k\i\n\s\.*\.\o\r\g ]]
21:33:49  + [[ https://jenkins.opendaylight.org/releng == *\j\e\n\k\i\n\s\.*\.\i\o ]]
21:33:49  ++ awk -F/ '{print $NF}'
21:33:49  ++ sed 's/\/*$//'
21:33:49  ++ echo https://jenkins.opendaylight.org/releng
21:33:49  + silo=releng
21:33:49  + export silo
21:33:49  + builds=(${builds[@]} $(echo "$json_data" |             jq -r '.computer[].executors[].currentExecutable.url'             | grep -v null | awk -F'/' '{print ENVIRON["silo"] "-" $6 "-" $7}'))
21:33:49  ++ grep -v null
21:33:49  ++ jq -r '.computer[].executors[].currentExecutable.url'
21:33:49  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73962/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]}'
21:33:49  ++ awk -F/ '{print ENVIRON["silo"] "-" $6 "-" $7}'
21:33:49  + for jenkins in "${@:2}"
21:33:49  + PARAMS='tree=computer[executors[currentExecutable[url]],'
21:33:49  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]'
21:33:49  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
21:33:49  + JENKINS_URL='https://jenkins.opendaylight.org/sandbox/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
21:33:49  ++ curl -s -w '\n\n%{http_code}' --globoff -H Content-Type:application/json 'https://jenkins.opendaylight.org/sandbox/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
21:33:49  + resp='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}
21:33:49  
21:33:49  200'
21:33:49  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}
21:33:49  
21:33:49  200'
21:33:49  ++ head -n1
21:33:49  + json_data='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}'
21:33:49  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}
21:33:49  
21:33:49  200'
21:33:49  ++ awk 'END {print $NF}'
21:33:49  + status=200
21:33:49  + '[' 200 '!=' 200 ']'
21:33:49  + [[ https://jenkins.opendaylight.org/sandbox == *\j\e\n\k\i\n\s\.*\.\o\r\g ]]
21:33:49  + [[ https://jenkins.opendaylight.org/sandbox == *\j\e\n\k\i\n\s\.*\.\i\o ]]
21:33:49  ++ echo https://jenkins.opendaylight.org/sandbox
21:33:49  ++ awk -F/ '{print $NF}'
21:33:49  ++ sed 's/\/*$//'
21:33:49  + silo=sandbox
21:33:49  + export silo
21:33:49  + builds=(${builds[@]} $(echo "$json_data" |             jq -r '.computer[].executors[].currentExecutable.url'             | grep -v null | awk -F'/' '{print ENVIRON["silo"] "-" $6 "-" $7}'))
21:33:49  ++ awk -F/ '{print ENVIRON["silo"] "-" $6 "-" $7}'
21:33:49  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}'
21:33:49  ++ jq -r '.computer[].executors[].currentExecutable.url'
21:33:49  ++ grep -v null
21:33:49  + [[ releng-builder-openstack-cron-73962 releng-openflowplugin-csit-1node-sanity-only-scandium-493 releng-integration-sanity-test-scandium-498 =~ releng-openflowplugin-csit-1node-sanity-only-scandium-493 ]]
21:33:49  + return 0
21:33:49  + continue
21:33:49  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
21:33:49  Run condition [Boolean condition] enabling perform for step [Execute shell]
21:33:49  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins17922509212691939526.sh
21:33:49  ---> Orphaned servers
21:33:49  Setup pyenv:
21:33:49    system
21:33:49    3.8.13
21:33:49    3.9.13
21:33:49    3.10.13
21:33:49  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
21:33:49  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-driG from file:/tmp/.os_lf_venv
21:33:49  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
21:33:49  lf-activate-venv(): INFO: Attempting to install with network-safe options...
21:33:51  lf-activate-venv(): INFO: Base packages installed successfully
21:33:51  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
21:34:08  lf-activate-venv(): INFO: Adding /tmp/venv-driG/bin to PATH
21:34:14  -----> Active servers
21:34:14  prd-centos8-builder-2c-2g-941
21:34:14  prd-ubuntu2204-docker-8c-8g-940
21:34:14  prd-centos8-robot-2c-8g-773
21:34:14  prd-queue-intque-2c-1g-772
21:34:14  prd-centos8-robot-2c-8g-144
21:34:14  prd-centos8-robot-2c-8g-141
21:34:14  prd-centos8-robot-2c-8g-136
21:34:14  prd-ubuntu2204-docker-8c-8g-128
21:34:14  -----> Delete orphaned servers
21:34:15  Deleting orphaned server: prd-centos8-robot-2c-8g-144
21:34:17  AttributeError: 'Server' object has no attribute 'created'. Did you mean: 'create'?
21:34:17  Deleting orphaned server: prd-centos8-robot-2c-8g-141
21:34:19  AttributeError: 'Server' object has no attribute 'created'. Did you mean: 'create'?
21:34:20  Deleting orphaned server: prd-centos8-robot-2c-8g-136
21:34:23  AttributeError: 'Server' object has no attribute 'created'. Did you mean: 'create'?
21:34:23  Deleting orphaned server: prd-ubuntu2204-docker-8c-8g-128
21:34:25  AttributeError: 'Server' object has no attribute 'created'. Did you mean: 'create'?
21:34:25  Build step 'Conditional step (single)' marked build as failure
21:34:25  $ ssh-agent -k
21:34:25  unset SSH_AUTH_SOCK;
21:34:25  unset SSH_AGENT_PID;
21:34:25  echo Agent pid 5457 killed;
21:34:25  [ssh-agent] Stopped.
21:34:26  [PostBuildScript] - [INFO] Executing post build scripts.
21:34:26  [builder-openstack-cron] $ /bin/bash /tmp/jenkins14597076225601004743.sh
21:34:26  ---> sysstat.sh
21:34:26  [builder-openstack-cron] $ /bin/bash /tmp/jenkins9836139260786299186.sh
21:34:26  ---> package-listing.sh
21:34:26  ++ facter osfamily
21:34:26  ++ tr '[:upper:]' '[:lower:]'
21:34:26  + OS_FAMILY=redhat
21:34:26  + workspace=/w/workspace/builder-openstack-cron
21:34:26  + START_PACKAGES=/tmp/packages_start.txt
21:34:26  + END_PACKAGES=/tmp/packages_end.txt
21:34:26  + DIFF_PACKAGES=/tmp/packages_diff.txt
21:34:26  + PACKAGES=/tmp/packages_start.txt
21:34:26  + '[' /w/workspace/builder-openstack-cron ']'
21:34:26  + PACKAGES=/tmp/packages_end.txt
21:34:26  + case "${OS_FAMILY}" in
21:34:26  + rpm -qa
21:34:26  + sort
21:34:27  + '[' -f /tmp/packages_start.txt ']'
21:34:27  + '[' -f /tmp/packages_end.txt ']'
21:34:27  + diff /tmp/packages_start.txt /tmp/packages_end.txt
21:34:27  + '[' /w/workspace/builder-openstack-cron ']'
21:34:27  + mkdir -p /w/workspace/builder-openstack-cron/archives/
21:34:27  + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/builder-openstack-cron/archives/
21:34:27  [builder-openstack-cron] $ /bin/bash /tmp/jenkins1818994683162658294.sh
21:34:27  ---> capture-instance-metadata.sh
21:34:27  Setup pyenv:
21:34:27    system
21:34:27    3.8.13
21:34:27    3.9.13
21:34:27    3.10.13
21:34:27  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
21:34:27  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-driG from file:/tmp/.os_lf_venv
21:34:27  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
21:34:27  lf-activate-venv(): INFO: Attempting to install with network-safe options...
21:34:29  lf-activate-venv(): INFO: Base packages installed successfully
21:34:29  lf-activate-venv(): INFO: Installing additional packages: lftools 
21:34:40  lf-activate-venv(): INFO: Adding /tmp/venv-driG/bin to PATH
21:34:40  INFO: Running in OpenStack, capturing instance metadata
21:34:40  [builder-openstack-cron] $ /bin/bash /tmp/jenkins3562556645868721518.sh
21:34:40  provisioning config files...
21:34:40  Could not find credentials [logs] for builder-openstack-cron #73962
21:34:40  copy managed file [jenkins-log-archives-settings] to file:/w/workspace/builder-openstack-cron@tmp/config17811987279126188433tmp
21:34:40  Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index]
21:34:40  Run condition [Regular expression match] enabling perform for step [Provide Configuration files]
21:34:40  provisioning config files...
21:34:41  copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials
21:34:41  [EnvInject] - Injecting environment variables from a build step.
21:34:41  [EnvInject] - Injecting as environment variables the properties content 
21:34:41  SERVER_ID=logs
21:34:41  
21:34:41  [EnvInject] - Variables injected successfully.
21:34:41  [builder-openstack-cron] $ /bin/bash /tmp/jenkins283132839224940099.sh
21:34:41  ---> create-netrc.sh
21:34:41  WARN: Log server credential not found.
21:34:41  [builder-openstack-cron] $ /bin/bash /tmp/jenkins4634223931906424809.sh
21:34:41  ---> python-tools-install.sh
21:34:41  Setup pyenv:
21:34:41    system
21:34:41    3.8.13
21:34:41    3.9.13
21:34:41    3.10.13
21:34:41  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
21:34:41  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-driG from file:/tmp/.os_lf_venv
21:34:41  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
21:34:41  lf-activate-venv(): INFO: Attempting to install with network-safe options...
21:34:43  lf-activate-venv(): INFO: Base packages installed successfully
21:34:43  lf-activate-venv(): INFO: Installing additional packages: lftools 
21:34:53  lf-activate-venv(): INFO: Adding /tmp/venv-driG/bin to PATH
21:34:53  [builder-openstack-cron] $ /bin/bash /tmp/jenkins7162881033692227499.sh
21:34:53  ---> sudo-logs.sh
21:34:53  Archiving 'sudo' log..
21:34:53  [builder-openstack-cron] $ /bin/bash /tmp/jenkins884978637332702394.sh
21:34:53  ---> job-cost.sh
21:34:53  Setup pyenv:
21:34:53    system
21:34:53    3.8.13
21:34:53    3.9.13
21:34:53    3.10.13
21:34:53  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
21:34:54  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-driG from file:/tmp/.os_lf_venv
21:34:54  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
21:34:54  lf-activate-venv(): INFO: Attempting to install with network-safe options...
21:34:55  lf-activate-venv(): INFO: Base packages installed successfully
21:34:55  lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
21:35:03  lf-activate-venv(): INFO: Adding /tmp/venv-driG/bin to PATH
21:35:03  INFO: No Stack...
21:35:03  INFO: Retrieving Pricing Info for: v3-standard-2
21:35:03  INFO: Archiving Costs
21:35:03  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins7189256994895474018.sh
21:35:03  ---> logs-deploy.sh
21:35:03  Setup pyenv:
21:35:04    system
21:35:04    3.8.13
21:35:04    3.9.13
21:35:04    3.10.13
21:35:04  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
21:35:04  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-driG from file:/tmp/.os_lf_venv
21:35:04  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
21:35:04  lf-activate-venv(): INFO: Attempting to install with network-safe options...
21:35:06  lf-activate-venv(): INFO: Base packages installed successfully
21:35:06  lf-activate-venv(): INFO: Installing additional packages: lftools 
21:35:18  lf-activate-venv(): INFO: Adding /tmp/venv-driG/bin to PATH
21:35:18  WARNING: Nexus logging server not set
21:35:18  INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/builder-openstack-cron/73962/
21:35:18  INFO: archiving logs to S3
21:35:19  ---> uname -a:
21:35:19  Linux prd-centos8-builder-2c-2g-941.novalocal 4.18.0-553.5.1.el8.x86_64 #1 SMP Tue May 21 05:46:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
21:35:19  
21:35:19  
21:35:19  ---> lscpu:
21:35:19  Architecture:        x86_64
21:35:19  CPU op-mode(s):      32-bit, 64-bit
21:35:19  Byte Order:          Little Endian
21:35:19  CPU(s):              2
21:35:19  On-line CPU(s) list: 0,1
21:35:19  Thread(s) per core:  1
21:35:19  Core(s) per socket:  1
21:35:19  Socket(s):           2
21:35:19  NUMA node(s):        1
21:35:19  Vendor ID:           AuthenticAMD
21:35:19  CPU family:          23
21:35:19  Model:               49
21:35:19  Model name:          AMD EPYC-Rome Processor
21:35:19  Stepping:            0
21:35:19  CPU MHz:             2799.998
21:35:19  BogoMIPS:            5599.99
21:35:19  Virtualization:      AMD-V
21:35:19  Hypervisor vendor:   KVM
21:35:19  Virtualization type: full
21:35:19  L1d cache:           32K
21:35:19  L1i cache:           32K
21:35:19  L2 cache:            512K
21:35:19  L3 cache:            16384K
21:35:19  NUMA node0 CPU(s):   0,1
21:35:19  Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
21:35:19  
21:35:19  
21:35:19  ---> nproc:
21:35:19  2
21:35:19  
21:35:19  
21:35:19  ---> df -h:
21:35:19  Filesystem      Size  Used Avail Use% Mounted on
21:35:19  devtmpfs        3.8G     0  3.8G   0% /dev
21:35:19  tmpfs           3.8G     0  3.8G   0% /dev/shm
21:35:19  tmpfs           3.8G   17M  3.8G   1% /run
21:35:19  tmpfs           3.8G     0  3.8G   0% /sys/fs/cgroup
21:35:19  /dev/vda1        40G  8.4G   32G  21% /
21:35:19  tmpfs           770M     0  770M   0% /run/user/1001
21:35:19  
21:35:19  
21:35:19  ---> free -m:
21:35:19                total        used        free      shared  buff/cache   available
21:35:19  Mem:           7697         635        4795          19        2266        6765
21:35:19  Swap:          1023           0        1023
21:35:19  
21:35:19  
21:35:19  ---> ip addr:
21:35:19  1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
21:35:19      link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
21:35:19      inet 127.0.0.1/8 scope host lo
21:35:19         valid_lft forever preferred_lft forever
21:35:19      inet6 ::1/128 scope host 
21:35:19         valid_lft forever preferred_lft forever
21:35:19  2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1458 qdisc mq state UP group default qlen 1000
21:35:19      link/ether fa:16:3e:0a:c3:de brd ff:ff:ff:ff:ff:ff
21:35:19      altname enp0s3
21:35:19      altname ens3
21:35:19      inet 10.30.171.245/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0
21:35:19         valid_lft 86173sec preferred_lft 86173sec
21:35:19      inet6 fe80::f816:3eff:fe0a:c3de/64 scope link 
21:35:19         valid_lft forever preferred_lft forever
21:35:19  3: docker0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1458 qdisc noqueue state DOWN group default 
21:35:19      link/ether 02:42:5b:1b:e4:e6 brd ff:ff:ff:ff:ff:ff
21:35:19      inet 10.250.0.254/24 brd 10.250.0.255 scope global docker0
21:35:19         valid_lft forever preferred_lft forever
21:35:19  
21:35:19  
21:35:19  ---> sar -b -r -n DEV:
21:35:19  Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-builder-5e6ee0fb-b6d9-4116-90d4-35c890e2b0f7.nov) 	09/24/2025 	_x86_64_	(2 CPU)
21:35:19  
21:35:19  21:31:27     LINUX RESTART	(2 CPU)
21:35:19  
21:35:19  09:32:01 PM       tps      rtps      wtps   bread/s   bwrtn/s
21:35:19  09:33:01 PM    205.26     11.56    193.70   3404.47   8230.21
21:35:19  09:34:01 PM    105.55      0.70    104.85    103.17  11543.40
21:35:19  09:35:01 PM     28.58      0.93     27.65     94.78   1227.20
21:35:19  Average:       113.14      4.40    108.74   1200.87   7000.59
21:35:19  
21:35:19  09:32:01 PM kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
21:35:19  09:33:01 PM   5130072   7010148   2752356     34.92      2688   2062212    944640     10.58    201348   2224912    178908
21:35:19  09:34:01 PM   4882376   6924876   3000052     38.06      2688   2218064    994372     11.13    235588   2410880     60376
21:35:19  09:35:01 PM   4914104   6937604   2968324     37.66      2688   2198488    980424     10.98    406836   2205412     21716
21:35:19  Average:      4975517   6957543   2906911     36.88      2688   2159588    973145     10.90    281257   2280401     87000
21:35:19  
21:35:19  09:32:01 PM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
21:35:19  09:33:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
21:35:19  09:33:01 PM      eth0    227.41    150.65   1764.80     57.47      0.00      0.00      0.00      0.00
21:35:19  09:33:01 PM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
21:35:19  09:34:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
21:35:19  09:34:01 PM      eth0     66.16     56.88    712.41     11.69      0.00      0.00      0.00      0.00
21:35:19  09:34:01 PM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
21:35:19  09:35:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
21:35:19  09:35:01 PM      eth0     26.41     24.46     31.28     15.15      0.00      0.00      0.00      0.00
21:35:19  09:35:01 PM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
21:35:19  Average:           lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
21:35:19  Average:         eth0    106.66     77.33    836.21     28.10      0.00      0.00      0.00      0.00
21:35:19  Average:      docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
21:35:19  
21:35:19  
21:35:19  ---> sar -P ALL:
21:35:19  Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-builder-5e6ee0fb-b6d9-4116-90d4-35c890e2b0f7.nov) 	09/24/2025 	_x86_64_	(2 CPU)
21:35:19  
21:35:19  21:31:27     LINUX RESTART	(2 CPU)
21:35:19  
21:35:19  09:32:01 PM     CPU     %user     %nice   %system   %iowait    %steal     %idle
21:35:19  09:33:01 PM     all     39.76      0.00      6.94      1.87      0.09     51.34
21:35:19  09:33:01 PM       0     32.95      0.00      7.21      2.73      0.08     57.01
21:35:19  09:33:01 PM       1     46.54      0.00      6.66      1.00      0.10     45.69
21:35:19  09:34:01 PM     all     35.41      0.00      5.11      1.07      0.09     58.32
21:35:19  09:34:01 PM       0     34.94      0.00      5.91      0.83      0.10     58.22
21:35:19  09:34:01 PM       1     35.88      0.00      4.32      1.30      0.08     58.42
21:35:19  09:35:01 PM     all     33.04      0.00      4.05      0.21      0.08     62.61
21:35:19  09:35:01 PM       0     16.13      0.00      3.22      0.23      0.08     80.33
21:35:19  09:35:01 PM       1     49.97      0.00      4.89      0.18      0.08     44.88
21:35:19  Average:        all     36.06      0.00      5.37      1.05      0.09     57.43
21:35:19  Average:          0     28.00      0.00      5.44      1.26      0.09     65.21
21:35:19  Average:          1     44.12      0.00      5.29      0.83      0.09     49.68
21:35:19  
21:35:19  
21:35:19