15:32:59  Started by timer
15:32:59  Running as SYSTEM
15:32:59  [EnvInject] - Loading node environment variables.
15:32:59  Building remotely on prd-centos8-builder-2c-2g-914 (centos8-builder-2c-2g) in workspace /w/workspace/builder-openstack-cron
15:32:59  [ssh-agent] Looking for ssh-agent implementation...
15:33:00  [ssh-agent]   Exec ssh-agent (binary ssh-agent on a remote machine)
15:33:00  $ ssh-agent
15:33:00  SSH_AUTH_SOCK=/tmp/ssh-zhDo6EjwFBhF/agent.5465
15:33:00  SSH_AGENT_PID=5466
15:33:00  [ssh-agent] Started.
15:33:00  Running ssh-add (command line suppressed)
15:33:00  Identity added: /w/workspace/builder-openstack-cron@tmp/private_key_10229831281721860017.key (/w/workspace/builder-openstack-cron@tmp/private_key_10229831281721860017.key)
15:33:00  [ssh-agent] Using credentials jenkins (jenkins-ssh)
15:33:00  The recommended git tool is: NONE
15:33:02  using credential jenkins-ssh
15:33:03  Wiping out workspace first.
15:33:03  Cloning the remote Git repository
15:33:03  Cloning repository git://devvexx.opendaylight.org/mirror/releng/builder
15:33:03   > git init /w/workspace/builder-openstack-cron # timeout=10
15:33:03  Fetching upstream changes from git://devvexx.opendaylight.org/mirror/releng/builder
15:33:03   > git --version # timeout=10
15:33:03   > git --version # 'git version 2.43.0'
15:33:03  using GIT_SSH to set credentials jenkins-ssh
15:33:03  [INFO] Currently running in a labeled security context
15:33:03  [INFO] Currently SELinux is 'enforcing' on the host
15:33:03   > /usr/bin/chcon --type=ssh_home_t /w/workspace/builder-openstack-cron@tmp/jenkins-gitclient-ssh15661700928895061423.key
15:33:03  Verifying host key using known hosts file
15:33:03  You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
15:33:03   > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/releng/builder +refs/heads/*:refs/remotes/origin/* # timeout=10
15:33:05   > git config remote.origin.url git://devvexx.opendaylight.org/mirror/releng/builder # timeout=10
15:33:05   > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
15:33:06  Avoid second fetch
15:33:06   > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
15:33:06  Checking out Revision 202d5eaf4e7a3a35bcb397374eb2ede98b8a5d3b (refs/remotes/origin/master)
15:33:06   > git config core.sparsecheckout # timeout=10
15:33:06   > git checkout -f 202d5eaf4e7a3a35bcb397374eb2ede98b8a5d3b # timeout=10
15:33:06  Commit message: "Merge "Chore: Add SPDX header to jenkins.ini.example""
15:33:06   > git rev-list --no-walk 202d5eaf4e7a3a35bcb397374eb2ede98b8a5d3b # timeout=10
15:33:06   > git remote # timeout=10
15:33:06   > git submodule init # timeout=10
15:33:06   > git submodule sync # timeout=10
15:33:06   > git config --get remote.origin.url # timeout=10
15:33:06   > git submodule init # timeout=10
15:33:06   > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10
15:33:06   > git config --get submodule.global-jjb.url # timeout=10
15:33:06   > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10
15:33:06   > git config --get submodule.packer/common-packer.url # timeout=10
15:33:06   > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10
15:33:07   > git submodule update --init --recursive global-jjb # timeout=10
15:33:08   > git submodule update --init --recursive packer/common-packer # timeout=10
15:33:12  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
15:33:12  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
15:33:12  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
15:33:12  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
15:33:12  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
15:33:12  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
15:33:12  Run condition [Boolean condition] enabling prebuild for step [BuilderChain]
15:33:12  No emails were triggered.
15:33:12  provisioning config files...
15:33:12  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
15:33:12  copy managed file [npmrc] to file:/home/jenkins/.npmrc
15:33:12  copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
15:33:12  [builder-openstack-cron] $ /bin/bash /tmp/jenkins14907224541937124085.sh
15:33:12  ---> python-tools-install.sh
15:33:12  Setup pyenv:
15:33:12    system
15:33:12  * 3.8.13 (set by /opt/pyenv/version)
15:33:12  * 3.9.13 (set by /opt/pyenv/version)
15:33:12  * 3.10.13 (set by /opt/pyenv/version)
15:33:12  * 3.11.7 (set by /opt/pyenv/version)
15:33:17  lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-b7PP
15:33:17  lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
15:33:17  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
15:33:17  lf-activate-venv(): INFO: Attempting to install with network-safe options...
15:33:21  lf-activate-venv(): INFO: Base packages installed successfully
15:33:21  lf-activate-venv(): INFO: Installing additional packages: lftools 
15:33:55  lf-activate-venv(): INFO: Adding /tmp/venv-b7PP/bin to PATH
15:33:55  Generating Requirements File
15:34:18  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
15:34:18  httplib2 0.31.0 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible.
15:34:19  Python 3.11.7
15:34:19  pip 25.2 from /tmp/venv-b7PP/lib/python3.11/site-packages/pip (python 3.11)
15:34:19  appdirs==1.4.4
15:34:19  argcomplete==3.6.2
15:34:19  aspy.yaml==1.3.0
15:34:19  attrs==25.3.0
15:34:19  autopage==0.5.2
15:34:19  beautifulsoup4==4.13.5
15:34:19  boto3==1.40.37
15:34:19  botocore==1.40.37
15:34:19  bs4==0.0.2
15:34:19  cachetools==5.5.2
15:34:19  certifi==2025.8.3
15:34:19  cffi==2.0.0
15:34:19  cfgv==3.4.0
15:34:19  chardet==5.2.0
15:34:19  charset-normalizer==3.4.3
15:34:19  click==8.3.0
15:34:19  cliff==4.11.0
15:34:19  cmd2==2.7.0
15:34:19  cryptography==3.3.2
15:34:19  debtcollector==3.0.0
15:34:19  decorator==5.2.1
15:34:19  defusedxml==0.7.1
15:34:19  Deprecated==1.2.18
15:34:19  distlib==0.4.0
15:34:19  dnspython==2.8.0
15:34:19  docker==7.1.0
15:34:19  dogpile.cache==1.4.1
15:34:19  durationpy==0.10
15:34:19  email-validator==2.3.0
15:34:19  filelock==3.19.1
15:34:19  future==1.0.0
15:34:19  gitdb==4.0.12
15:34:19  GitPython==3.1.45
15:34:19  google-auth==2.40.3
15:34:19  httplib2==0.31.0
15:34:19  identify==2.6.14
15:34:19  idna==3.10
15:34:19  importlib-resources==1.5.0
15:34:19  iso8601==2.1.0
15:34:19  Jinja2==3.1.6
15:34:19  jmespath==1.0.1
15:34:19  jsonpatch==1.33
15:34:19  jsonpointer==3.0.0
15:34:19  jsonschema==4.25.1
15:34:19  jsonschema-specifications==2025.9.1
15:34:19  keystoneauth1==5.12.0
15:34:19  kubernetes==33.1.0
15:34:19  lftools==0.37.14
15:34:19  lxml==6.0.2
15:34:19  markdown-it-py==4.0.0
15:34:19  MarkupSafe==3.0.2
15:34:19  mdurl==0.1.2
15:34:19  msgpack==1.1.1
15:34:19  multi_key_dict==2.0.3
15:34:19  munch==4.0.0
15:34:19  netaddr==1.3.0
15:34:19  niet==1.4.2
15:34:19  nodeenv==1.9.1
15:34:19  oauth2client==4.1.3
15:34:19  oauthlib==3.3.1
15:34:19  openstacksdk==4.7.1
15:34:19  os-service-types==1.8.0
15:34:19  osc-lib==4.2.0
15:34:19  oslo.config==10.0.0
15:34:19  oslo.context==6.1.0
15:34:19  oslo.i18n==6.6.0
15:34:19  oslo.log==7.2.1
15:34:19  oslo.serialization==5.8.0
15:34:19  oslo.utils==9.1.0
15:34:19  packaging==25.0
15:34:19  pbr==7.0.1
15:34:19  platformdirs==4.4.0
15:34:19  prettytable==3.16.0
15:34:19  psutil==7.1.0
15:34:19  pyasn1==0.6.1
15:34:19  pyasn1_modules==0.4.2
15:34:19  pycparser==2.23
15:34:19  pygerrit2==2.0.15
15:34:19  PyGithub==2.8.1
15:34:19  Pygments==2.19.2
15:34:19  PyJWT==2.10.1
15:34:19  PyNaCl==1.6.0
15:34:19  pyparsing==2.4.7
15:34:19  pyperclip==1.10.0
15:34:19  pyrsistent==0.20.0
15:34:19  python-cinderclient==9.8.0
15:34:19  python-dateutil==2.9.0.post0
15:34:19  python-heatclient==4.3.0
15:34:19  python-jenkins==1.8.3
15:34:19  python-keystoneclient==5.7.0
15:34:19  python-magnumclient==4.9.0
15:34:19  python-openstackclient==8.2.0
15:34:19  python-swiftclient==4.8.0
15:34:19  PyYAML==6.0.2
15:34:19  referencing==0.36.2
15:34:19  requests==2.32.5
15:34:19  requests-oauthlib==2.0.0
15:34:19  requestsexceptions==1.4.0
15:34:19  rfc3986==2.0.0
15:34:19  rich==14.1.0
15:34:19  rich-argparse==1.7.1
15:34:19  rpds-py==0.27.1
15:34:19  rsa==4.9.1
15:34:19  ruamel.yaml==0.18.15
15:34:19  ruamel.yaml.clib==0.2.14
15:34:19  s3transfer==0.14.0
15:34:19  simplejson==3.20.1
15:34:19  six==1.17.0
15:34:19  smmap==5.0.2
15:34:19  soupsieve==2.8
15:34:19  stevedore==5.5.0
15:34:19  tabulate==0.9.0
15:34:19  toml==0.10.2
15:34:19  tomlkit==0.13.3
15:34:19  tqdm==4.67.1
15:34:19  typing_extensions==4.15.0
15:34:19  tzdata==2025.2
15:34:19  urllib3==1.26.20
15:34:19  virtualenv==20.34.0
15:34:19  wcwidth==0.2.14
15:34:19  websocket-client==1.8.0
15:34:19  wrapt==1.17.3
15:34:19  xdg==6.0.0
15:34:19  xmltodict==1.0.2
15:34:19  yq==3.4.3
15:34:19  [EnvInject] - Injecting environment variables from a build step.
15:34:19  [EnvInject] - Injecting as environment variables the properties content 
15:34:19  OS_CLOUD=vex
15:34:19  
15:34:19  [EnvInject] - Variables injected successfully.
15:34:19  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
15:34:19  Run condition [Boolean condition] enabling perform for step [Execute shell]
15:34:19  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins9920847294651566021.sh
15:34:19  ---> Orphaned k8s clusters
15:34:19  Setup pyenv:
15:34:19    system
15:34:19    3.8.13
15:34:19    3.9.13
15:34:19    3.10.13
15:34:19  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
15:34:20  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-b7PP from file:/tmp/.os_lf_venv
15:34:20  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
15:34:20  lf-activate-venv(): INFO: Attempting to install with network-safe options...
15:34:22  lf-activate-venv(): INFO: Base packages installed successfully
15:34:22  lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 
15:34:30  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
15:34:30  lftools 0.37.14 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible.
15:34:30  lf-activate-venv(): INFO: Adding /tmp/venv-b7PP/bin to PATH
15:34:33  -----> Delete orphaned cluster
15:34:33  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
15:34:33  Run condition [Boolean condition] enabling perform for step [Execute shell]
15:34:33  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins11764023412926351927.sh
15:34:33  ---> Orphaned stacks
15:34:33  Setup pyenv:
15:34:33    system
15:34:33    3.8.13
15:34:33    3.9.13
15:34:33    3.10.13
15:34:33  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
15:34:33  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-b7PP from file:/tmp/.os_lf_venv
15:34:33  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
15:34:33  lf-activate-venv(): INFO: Attempting to install with network-safe options...
15:34:35  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
15:34:35  lftools 0.37.14 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible.
15:34:35  lf-activate-venv(): INFO: Base packages installed successfully
15:34:35  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 
15:34:58  lf-activate-venv(): INFO: Adding /tmp/venv-b7PP/bin to PATH
15:34:58  + mapfile -t OS_COE_CLUSTERS_ID
15:34:58  ++ awk '{print $1}'
15:34:58  ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name
15:34:58  ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)'
15:35:00  + echo '-----> Active clusters -> stacks'
15:35:00  -----> Active clusters -> stacks
15:35:00  + OS_COE_STACKS=()
15:35:00  + [[ 0 -gt 0 ]]
15:35:00  + mapfile -t OS_STACKS
15:35:00  ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED
15:35:00  ++ awk '{print $1}'
15:35:02  + echo '-----> Active stacks'
15:35:02  -----> Active stacks
15:35:02  + for stack in "${OS_STACKS[@]}"
15:35:02  + echo releng-openflowplugin-csit-1node-sanity-only-scandium-493
15:35:02  releng-openflowplugin-csit-1node-sanity-only-scandium-493
15:35:02  + echo '-----> Delete orphaned stacks'
15:35:02  -----> Delete orphaned stacks
15:35:02  + for STACK_NAME in "${OS_STACKS[@]}"
15:35:02  + [[ 0 -gt 0 ]]
15:35:02  + stack_in_jenkins releng-openflowplugin-csit-1node-sanity-only-scandium-493 https://jenkins.opendaylight.org/releng https://jenkins.opendaylight.org/sandbox
15:35:02  + STACK_NAME=releng-openflowplugin-csit-1node-sanity-only-scandium-493
15:35:02  + builds=()
15:35:02  + for jenkins in "${@:2}"
15:35:02  + PARAMS='tree=computer[executors[currentExecutable[url]],'
15:35:02  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]'
15:35:02  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
15:35:02  + JENKINS_URL='https://jenkins.opendaylight.org/releng/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
15:35:02  ++ curl -s -w '\n\n%{http_code}' --globoff -H Content-Type:application/json 'https://jenkins.opendaylight.org/releng/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
15:35:02  + resp='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73956/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]}
15:35:02  
15:35:02  200'
15:35:02  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73956/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]}
15:35:02  
15:35:02  200'
15:35:02  ++ head -n1
15:35:02  + json_data='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73956/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]}'
15:35:02  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73956/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]}
15:35:02  
15:35:02  200'
15:35:02  ++ awk 'END {print $NF}'
15:35:02  + status=200
15:35:02  + '[' 200 '!=' 200 ']'
15:35:02  + [[ https://jenkins.opendaylight.org/releng == *\j\e\n\k\i\n\s\.*\.\o\r\g ]]
15:35:02  + [[ https://jenkins.opendaylight.org/releng == *\j\e\n\k\i\n\s\.*\.\i\o ]]
15:35:02  ++ echo https://jenkins.opendaylight.org/releng
15:35:02  ++ awk -F/ '{print $NF}'
15:35:02  ++ sed 's/\/*$//'
15:35:02  + silo=releng
15:35:02  + export silo
15:35:02  + builds=(${builds[@]} $(echo "$json_data" |             jq -r '.computer[].executors[].currentExecutable.url'             | grep -v null | awk -F'/' '{print ENVIRON["silo"] "-" $6 "-" $7}'))
15:35:02  ++ grep -v null
15:35:02  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73956/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]}'
15:35:02  ++ jq -r '.computer[].executors[].currentExecutable.url'
15:35:02  ++ awk -F/ '{print ENVIRON["silo"] "-" $6 "-" $7}'
15:35:02  + for jenkins in "${@:2}"
15:35:02  + PARAMS='tree=computer[executors[currentExecutable[url]],'
15:35:02  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]'
15:35:02  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
15:35:02  + JENKINS_URL='https://jenkins.opendaylight.org/sandbox/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
15:35:02  ++ curl -s -w '\n\n%{http_code}' --globoff -H Content-Type:application/json 'https://jenkins.opendaylight.org/sandbox/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
15:35:02  + resp='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}
15:35:02  
15:35:02  200'
15:35:02  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}
15:35:02  
15:35:02  200'
15:35:02  ++ head -n1
15:35:02  + json_data='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}'
15:35:02  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}
15:35:02  
15:35:02  200'
15:35:02  ++ awk 'END {print $NF}'
15:35:02  + status=200
15:35:02  + '[' 200 '!=' 200 ']'
15:35:02  + [[ https://jenkins.opendaylight.org/sandbox == *\j\e\n\k\i\n\s\.*\.\o\r\g ]]
15:35:02  + [[ https://jenkins.opendaylight.org/sandbox == *\j\e\n\k\i\n\s\.*\.\i\o ]]
15:35:02  ++ echo https://jenkins.opendaylight.org/sandbox
15:35:02  ++ sed 's/\/*$//'
15:35:02  ++ awk -F/ '{print $NF}'
15:35:02  + silo=sandbox
15:35:02  + export silo
15:35:02  + builds=(${builds[@]} $(echo "$json_data" |             jq -r '.computer[].executors[].currentExecutable.url'             | grep -v null | awk -F'/' '{print ENVIRON["silo"] "-" $6 "-" $7}'))
15:35:02  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}'
15:35:02  ++ grep -v null
15:35:02  ++ jq -r '.computer[].executors[].currentExecutable.url'
15:35:02  ++ awk -F/ '{print ENVIRON["silo"] "-" $6 "-" $7}'
15:35:02  + [[ releng-builder-openstack-cron-73956 releng-openflowplugin-csit-1node-sanity-only-scandium-493 releng-integration-sanity-test-scandium-498 =~ releng-openflowplugin-csit-1node-sanity-only-scandium-493 ]]
15:35:02  + return 0
15:35:02  + continue
15:35:02  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
15:35:02  Run condition [Boolean condition] enabling perform for step [Execute shell]
15:35:02  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins2294097160417037681.sh
15:35:02  ---> Orphaned servers
15:35:02  Setup pyenv:
15:35:02    system
15:35:02    3.8.13
15:35:02    3.9.13
15:35:02    3.10.13
15:35:02  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
15:35:03  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-b7PP from file:/tmp/.os_lf_venv
15:35:03  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
15:35:03  lf-activate-venv(): INFO: Attempting to install with network-safe options...
15:35:05  lf-activate-venv(): INFO: Base packages installed successfully
15:35:05  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
15:35:25  lf-activate-venv(): INFO: Adding /tmp/venv-b7PP/bin to PATH
15:35:31  -----> Active servers
15:35:31  prd-centos8-builder-2c-2g-914
15:35:31  prd-ubuntu2204-docker-4c-4g-905
15:35:31  prd-centos8-robot-2c-8g-773
15:35:31  prd-queue-intque-2c-1g-772
15:35:31  prd-centos8-robot-2c-8g-144
15:35:31  prd-centos8-robot-2c-8g-141
15:35:31  prd-centos8-robot-2c-8g-136
15:35:31  prd-ubuntu2204-docker-8c-8g-128
15:35:31  -----> Delete orphaned servers
15:35:31  Deleting orphaned server: prd-centos8-robot-2c-8g-144
15:35:34  AttributeError: 'Server' object has no attribute 'created'. Did you mean: 'create'?
15:35:34  Deleting orphaned server: prd-centos8-robot-2c-8g-141
15:35:36  AttributeError: 'Server' object has no attribute 'created'. Did you mean: 'create'?
15:35:37  Deleting orphaned server: prd-centos8-robot-2c-8g-136
15:35:39  AttributeError: 'Server' object has no attribute 'created'. Did you mean: 'create'?
15:35:39  Deleting orphaned server: prd-ubuntu2204-docker-8c-8g-128
15:35:41  AttributeError: 'Server' object has no attribute 'created'. Did you mean: 'create'?
15:35:41  Build step 'Conditional step (single)' marked build as failure
15:35:41  $ ssh-agent -k
15:35:41  unset SSH_AUTH_SOCK;
15:35:41  unset SSH_AGENT_PID;
15:35:41  echo Agent pid 5466 killed;
15:35:41  [ssh-agent] Stopped.
15:35:41  [PostBuildScript] - [INFO] Executing post build scripts.
15:35:41  [builder-openstack-cron] $ /bin/bash /tmp/jenkins12952289377864258932.sh
15:35:41  ---> sysstat.sh
15:35:42  [builder-openstack-cron] $ /bin/bash /tmp/jenkins2483324805556277510.sh
15:35:42  ---> package-listing.sh
15:35:42  ++ facter osfamily
15:35:42  ++ tr '[:upper:]' '[:lower:]'
15:35:42  + OS_FAMILY=redhat
15:35:42  + workspace=/w/workspace/builder-openstack-cron
15:35:42  + START_PACKAGES=/tmp/packages_start.txt
15:35:42  + END_PACKAGES=/tmp/packages_end.txt
15:35:42  + DIFF_PACKAGES=/tmp/packages_diff.txt
15:35:42  + PACKAGES=/tmp/packages_start.txt
15:35:42  + '[' /w/workspace/builder-openstack-cron ']'
15:35:42  + PACKAGES=/tmp/packages_end.txt
15:35:42  + case "${OS_FAMILY}" in
15:35:42  + rpm -qa
15:35:42  + sort
15:35:42  + '[' -f /tmp/packages_start.txt ']'
15:35:42  + '[' -f /tmp/packages_end.txt ']'
15:35:42  + diff /tmp/packages_start.txt /tmp/packages_end.txt
15:35:42  + '[' /w/workspace/builder-openstack-cron ']'
15:35:42  + mkdir -p /w/workspace/builder-openstack-cron/archives/
15:35:42  + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/builder-openstack-cron/archives/
15:35:43  [builder-openstack-cron] $ /bin/bash /tmp/jenkins12578695611567022499.sh
15:35:43  ---> capture-instance-metadata.sh
15:35:43  Setup pyenv:
15:35:43    system
15:35:43    3.8.13
15:35:43    3.9.13
15:35:43    3.10.13
15:35:43  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
15:35:43  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-b7PP from file:/tmp/.os_lf_venv
15:35:43  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
15:35:43  lf-activate-venv(): INFO: Attempting to install with network-safe options...
15:35:45  lf-activate-venv(): INFO: Base packages installed successfully
15:35:45  lf-activate-venv(): INFO: Installing additional packages: lftools 
15:35:59  lf-activate-venv(): INFO: Adding /tmp/venv-b7PP/bin to PATH
15:35:59  INFO: Running in OpenStack, capturing instance metadata
15:36:00  [builder-openstack-cron] $ /bin/bash /tmp/jenkins2222649732594114926.sh
15:36:00  provisioning config files...
15:36:00  Could not find credentials [logs] for builder-openstack-cron #73956
15:36:00  copy managed file [jenkins-log-archives-settings] to file:/w/workspace/builder-openstack-cron@tmp/config17314482155993130780tmp
15:36:00  Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index]
15:36:00  Run condition [Regular expression match] enabling perform for step [Provide Configuration files]
15:36:00  provisioning config files...
15:36:00  copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials
15:36:00  [EnvInject] - Injecting environment variables from a build step.
15:36:00  [EnvInject] - Injecting as environment variables the properties content 
15:36:00  SERVER_ID=logs
15:36:00  
15:36:00  [EnvInject] - Variables injected successfully.
15:36:00  [builder-openstack-cron] $ /bin/bash /tmp/jenkins12707856354539888842.sh
15:36:00  ---> create-netrc.sh
15:36:00  WARN: Log server credential not found.
15:36:00  [builder-openstack-cron] $ /bin/bash /tmp/jenkins14726397220434804684.sh
15:36:00  ---> python-tools-install.sh
15:36:00  Setup pyenv:
15:36:01    system
15:36:01    3.8.13
15:36:01    3.9.13
15:36:01    3.10.13
15:36:01  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
15:36:01  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-b7PP from file:/tmp/.os_lf_venv
15:36:01  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
15:36:01  lf-activate-venv(): INFO: Attempting to install with network-safe options...
15:36:03  lf-activate-venv(): INFO: Base packages installed successfully
15:36:03  lf-activate-venv(): INFO: Installing additional packages: lftools 
15:36:14  lf-activate-venv(): INFO: Adding /tmp/venv-b7PP/bin to PATH
15:36:14  [builder-openstack-cron] $ /bin/bash /tmp/jenkins2953690893670073484.sh
15:36:14  ---> sudo-logs.sh
15:36:14  Archiving 'sudo' log..
15:36:14  [builder-openstack-cron] $ /bin/bash /tmp/jenkins8165626425582316800.sh
15:36:14  ---> job-cost.sh
15:36:14  Setup pyenv:
15:36:14    system
15:36:14    3.8.13
15:36:14    3.9.13
15:36:14    3.10.13
15:36:14  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
15:36:15  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-b7PP from file:/tmp/.os_lf_venv
15:36:15  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
15:36:15  lf-activate-venv(): INFO: Attempting to install with network-safe options...
15:36:17  lf-activate-venv(): INFO: Base packages installed successfully
15:36:17  lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
15:36:25  lf-activate-venv(): INFO: Adding /tmp/venv-b7PP/bin to PATH
15:36:25  INFO: No Stack...
15:36:25  INFO: Retrieving Pricing Info for: v3-standard-2
15:36:25  INFO: Archiving Costs
15:36:25  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins4091631513911039805.sh
15:36:26  ---> logs-deploy.sh
15:36:26  Setup pyenv:
15:36:26    system
15:36:26    3.8.13
15:36:26    3.9.13
15:36:26    3.10.13
15:36:26  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
15:36:26  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-b7PP from file:/tmp/.os_lf_venv
15:36:26  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
15:36:26  lf-activate-venv(): INFO: Attempting to install with network-safe options...
15:36:29  lf-activate-venv(): INFO: Base packages installed successfully
15:36:29  lf-activate-venv(): INFO: Installing additional packages: lftools 
15:36:40  lf-activate-venv(): INFO: Adding /tmp/venv-b7PP/bin to PATH
15:36:40  WARNING: Nexus logging server not set
15:36:40  INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/builder-openstack-cron/73956/
15:36:40  INFO: archiving logs to S3
15:36:41  ---> uname -a:
15:36:41  Linux prd-centos8-builder-2c-2g-914.novalocal 4.18.0-553.5.1.el8.x86_64 #1 SMP Tue May 21 05:46:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
15:36:41  
15:36:41  
15:36:41  ---> lscpu:
15:36:41  Architecture:        x86_64
15:36:41  CPU op-mode(s):      32-bit, 64-bit
15:36:41  Byte Order:          Little Endian
15:36:41  CPU(s):              2
15:36:41  On-line CPU(s) list: 0,1
15:36:41  Thread(s) per core:  1
15:36:41  Core(s) per socket:  1
15:36:41  Socket(s):           2
15:36:41  NUMA node(s):        1
15:36:41  Vendor ID:           AuthenticAMD
15:36:41  CPU family:          23
15:36:41  Model:               49
15:36:41  Model name:          AMD EPYC-Rome Processor
15:36:41  Stepping:            0
15:36:41  CPU MHz:             2799.998
15:36:41  BogoMIPS:            5599.99
15:36:41  Virtualization:      AMD-V
15:36:41  Hypervisor vendor:   KVM
15:36:41  Virtualization type: full
15:36:41  L1d cache:           32K
15:36:41  L1i cache:           32K
15:36:41  L2 cache:            512K
15:36:41  L3 cache:            16384K
15:36:41  NUMA node0 CPU(s):   0,1
15:36:41  Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
15:36:41  
15:36:41  
15:36:41  ---> nproc:
15:36:41  2
15:36:41  
15:36:41  
15:36:41  ---> df -h:
15:36:41  Filesystem      Size  Used Avail Use% Mounted on
15:36:41  devtmpfs        3.8G     0  3.8G   0% /dev
15:36:41  tmpfs           3.8G     0  3.8G   0% /dev/shm
15:36:41  tmpfs           3.8G   17M  3.8G   1% /run
15:36:41  tmpfs           3.8G     0  3.8G   0% /sys/fs/cgroup
15:36:41  /dev/vda1        40G  8.4G   32G  21% /
15:36:41  tmpfs           770M     0  770M   0% /run/user/1001
15:36:41  
15:36:41  
15:36:41  ---> free -m:
15:36:41                total        used        free      shared  buff/cache   available
15:36:41  Mem:           7697         731        4700          19        2266        6669
15:36:41  Swap:          1023           0        1023
15:36:41  
15:36:41  
15:36:41  ---> ip addr:
15:36:41  1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
15:36:41      link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
15:36:41      inet 127.0.0.1/8 scope host lo
15:36:41         valid_lft forever preferred_lft forever
15:36:41      inet6 ::1/128 scope host 
15:36:41         valid_lft forever preferred_lft forever
15:36:41  2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1458 qdisc mq state UP group default qlen 1000
15:36:41      link/ether fa:16:3e:75:6d:40 brd ff:ff:ff:ff:ff:ff
15:36:41      altname enp0s3
15:36:41      altname ens3
15:36:41      inet 10.30.171.61/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0
15:36:41         valid_lft 86145sec preferred_lft 86145sec
15:36:41      inet6 fe80::f816:3eff:fe75:6d40/64 scope link 
15:36:41         valid_lft forever preferred_lft forever
15:36:41  3: docker0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1458 qdisc noqueue state DOWN group default 
15:36:41      link/ether 02:42:b7:e9:12:ea brd ff:ff:ff:ff:ff:ff
15:36:41      inet 10.250.0.254/24 brd 10.250.0.255 scope global docker0
15:36:41         valid_lft forever preferred_lft forever
15:36:41  
15:36:41  
15:36:41  ---> sar -b -r -n DEV:
15:36:41  Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-builder-5e6ee0fb-b6d9-4116-90d4-35c890e2b0f7.nov) 	09/24/2025 	_x86_64_	(2 CPU)
15:36:41  
15:36:41  15:32:22     LINUX RESTART	(2 CPU)
15:36:41  
15:36:41  03:33:01 PM       tps      rtps      wtps   bread/s   bwrtn/s
15:36:41  03:34:01 PM     95.57      7.45     88.12   1153.82   6260.07
15:36:41  03:35:01 PM    102.40      0.50    101.90     64.39  11222.21
15:36:41  03:36:01 PM     30.01      0.93     29.07    105.96   1755.20
15:36:41  Average:        75.99      2.96     73.03    441.45   6412.22
15:36:41  
15:36:41  03:33:01 PM kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
15:36:41  03:34:01 PM   5081892   6928852   2800540     35.53      2688   2029492   1073040     12.01    201332   2273812    148820
15:36:41  03:35:01 PM   4904592   6913340   2977840     37.78      2688   2183876   1057812     11.84    226304   2393100     42952
15:36:41  03:36:01 PM   4910240   6921784   2972192     37.71      2688   2186960   1042896     11.68    404772   2211952     10908
15:36:41  Average:      4965575   6921325   2916857     37.00      2688   2133443   1057916     11.85    277469   2292955     67560
15:36:41  
15:36:41  03:33:01 PM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
15:36:41  03:34:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
15:36:41  03:34:01 PM      eth0    156.07    115.44   1427.11     37.40      0.00      0.00      0.00      0.00
15:36:41  03:34:01 PM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
15:36:41  03:35:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
15:36:41  03:35:01 PM      eth0     67.16     50.16    735.83      8.86      0.00      0.00      0.00      0.00
15:36:41  03:35:01 PM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
15:36:41  03:36:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
15:36:41  03:36:01 PM      eth0     26.91     24.91     30.88      9.16      0.00      0.00      0.00      0.00
15:36:41  03:36:01 PM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
15:36:41  Average:           lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
15:36:41  Average:         eth0     83.38     63.51    731.31     18.48      0.00      0.00      0.00      0.00
15:36:41  Average:      docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
15:36:41  
15:36:41  
15:36:41  ---> sar -P ALL:
15:36:41  Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-builder-5e6ee0fb-b6d9-4116-90d4-35c890e2b0f7.nov) 	09/24/2025 	_x86_64_	(2 CPU)
15:36:41  
15:36:41  15:32:22     LINUX RESTART	(2 CPU)
15:36:41  
15:36:41  03:33:01 PM     CPU     %user     %nice   %system   %iowait    %steal     %idle
15:36:41  03:34:01 PM     all     32.39      0.00      5.06      3.75      0.13     58.68
15:36:41  03:34:01 PM       0     19.34      0.00      4.81      4.68      0.13     71.03
15:36:41  03:34:01 PM       1     45.45      0.00      5.30      2.81      0.12     46.32
15:36:41  03:35:01 PM     all     32.47      0.00      4.42      2.59      0.15     60.37
15:36:41  03:35:01 PM       0     16.86      0.00      3.00      2.00      0.17     77.96
15:36:41  03:35:01 PM       1     48.09      0.00      5.84      3.17      0.13     42.76
15:36:41  03:36:01 PM     all     27.81      0.00      3.39      1.20      0.08     67.51
15:36:41  03:36:01 PM       0     13.45      0.00      2.34      1.37      0.07     82.77
15:36:41  03:36:01 PM       1     42.16      0.00      4.44      1.04      0.10     52.26
15:36:41  Average:        all     30.89      0.00      4.29      2.51      0.12     62.19
15:36:41  Average:          0     16.55      0.00      3.38      2.68      0.12     77.26
15:36:41  Average:          1     45.23      0.00      5.20      2.34      0.12     47.12
15:36:41  
15:36:41  
15:36:41