02:32:41  Started by timer
02:32:41  Running as SYSTEM
02:32:41  [EnvInject] - Loading node environment variables.
02:32:41  Building remotely on prd-centos8-builder-2c-2g-674 (centos8-builder-2c-2g) in workspace /w/workspace/builder-openstack-cron
02:32:41  [ssh-agent] Looking for ssh-agent implementation...
02:32:41  [ssh-agent]   Exec ssh-agent (binary ssh-agent on a remote machine)
02:32:41  $ ssh-agent
02:32:41  SSH_AUTH_SOCK=/tmp/ssh-XxiRVeGMTStI/agent.5448
02:32:41  SSH_AGENT_PID=5449
02:32:41  [ssh-agent] Started.
02:32:41  Running ssh-add (command line suppressed)
02:32:41  Identity added: /w/workspace/builder-openstack-cron@tmp/private_key_90277384743779894.key (/w/workspace/builder-openstack-cron@tmp/private_key_90277384743779894.key)
02:32:41  [ssh-agent] Using credentials jenkins (jenkins-ssh)
02:32:41  The recommended git tool is: NONE
02:32:44  using credential jenkins-ssh
02:32:44  Wiping out workspace first.
02:32:44  Cloning the remote Git repository
02:32:44  Cloning repository git://devvexx.opendaylight.org/mirror/releng/builder
02:32:44   > git init /w/workspace/builder-openstack-cron # timeout=10
02:32:44  Fetching upstream changes from git://devvexx.opendaylight.org/mirror/releng/builder
02:32:44   > git --version # timeout=10
02:32:44   > git --version # 'git version 2.43.0'
02:32:44  using GIT_SSH to set credentials jenkins-ssh
02:32:44  [INFO] Currently running in a labeled security context
02:32:44  [INFO] Currently SELinux is 'enforcing' on the host
02:32:44   > /usr/bin/chcon --type=ssh_home_t /w/workspace/builder-openstack-cron@tmp/jenkins-gitclient-ssh5630205526846500127.key
02:32:44  Verifying host key using known hosts file
02:32:44  You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
02:32:44   > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/releng/builder +refs/heads/*:refs/remotes/origin/* # timeout=10
02:32:47   > git config remote.origin.url git://devvexx.opendaylight.org/mirror/releng/builder # timeout=10
02:32:47   > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
02:32:47  Avoid second fetch
02:32:47   > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
02:32:47  Checking out Revision 202d5eaf4e7a3a35bcb397374eb2ede98b8a5d3b (refs/remotes/origin/master)
02:32:47   > git config core.sparsecheckout # timeout=10
02:32:47   > git checkout -f 202d5eaf4e7a3a35bcb397374eb2ede98b8a5d3b # timeout=10
02:32:48  Commit message: "Merge "Chore: Add SPDX header to jenkins.ini.example""
02:32:48   > git rev-list --no-walk 202d5eaf4e7a3a35bcb397374eb2ede98b8a5d3b # timeout=10
02:32:48   > git remote # timeout=10
02:32:48   > git submodule init # timeout=10
02:32:48   > git submodule sync # timeout=10
02:32:48   > git config --get remote.origin.url # timeout=10
02:32:48   > git submodule init # timeout=10
02:32:48   > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10
02:32:48   > git config --get submodule.global-jjb.url # timeout=10
02:32:48   > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10
02:32:48   > git config --get submodule.packer/common-packer.url # timeout=10
02:32:48   > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10
02:32:48   > git submodule update --init --recursive global-jjb # timeout=10
02:32:49   > git submodule update --init --recursive packer/common-packer # timeout=10
02:32:53  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
02:32:53  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
02:32:53  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
02:32:53  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
02:32:53  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
02:32:53  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
02:32:53  Run condition [Boolean condition] enabling prebuild for step [BuilderChain]
02:32:53  No emails were triggered.
02:32:53  provisioning config files...
02:32:53  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
02:32:53  copy managed file [npmrc] to file:/home/jenkins/.npmrc
02:32:53  copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
02:32:53  [builder-openstack-cron] $ /bin/bash /tmp/jenkins5210228658363588115.sh
02:32:53  ---> python-tools-install.sh
02:32:53  Setup pyenv:
02:32:53    system
02:32:53  * 3.8.13 (set by /opt/pyenv/version)
02:32:53  * 3.9.13 (set by /opt/pyenv/version)
02:32:54  * 3.10.13 (set by /opt/pyenv/version)
02:32:54  * 3.11.7 (set by /opt/pyenv/version)
02:32:58  lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-K3QA
02:32:58  lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
02:32:58  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
02:32:58  lf-activate-venv(): INFO: Attempting to install with network-safe options...
02:33:03  lf-activate-venv(): INFO: Base packages installed successfully
02:33:03  lf-activate-venv(): INFO: Installing additional packages: lftools 
02:33:31  lf-activate-venv(): INFO: Adding /tmp/venv-K3QA/bin to PATH
02:33:31  Generating Requirements File
02:33:52  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
02:33:52  httplib2 0.31.0 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible.
02:33:52  Python 3.11.7
02:33:52  pip 25.2 from /tmp/venv-K3QA/lib/python3.11/site-packages/pip (python 3.11)
02:33:52  appdirs==1.4.4
02:33:52  argcomplete==3.6.2
02:33:52  aspy.yaml==1.3.0
02:33:52  attrs==25.3.0
02:33:52  autopage==0.5.2
02:33:52  beautifulsoup4==4.13.5
02:33:52  boto3==1.40.37
02:33:52  botocore==1.40.37
02:33:52  bs4==0.0.2
02:33:52  cachetools==5.5.2
02:33:52  certifi==2025.8.3
02:33:52  cffi==2.0.0
02:33:52  cfgv==3.4.0
02:33:52  chardet==5.2.0
02:33:52  charset-normalizer==3.4.3
02:33:52  click==8.3.0
02:33:52  cliff==4.11.0
02:33:52  cmd2==2.7.0
02:33:52  cryptography==3.3.2
02:33:52  debtcollector==3.0.0
02:33:52  decorator==5.2.1
02:33:52  defusedxml==0.7.1
02:33:52  Deprecated==1.2.18
02:33:52  distlib==0.4.0
02:33:52  dnspython==2.8.0
02:33:52  docker==7.1.0
02:33:52  dogpile.cache==1.4.1
02:33:52  durationpy==0.10
02:33:52  email-validator==2.3.0
02:33:52  filelock==3.19.1
02:33:52  future==1.0.0
02:33:52  gitdb==4.0.12
02:33:52  GitPython==3.1.45
02:33:52  google-auth==2.40.3
02:33:52  httplib2==0.31.0
02:33:52  identify==2.6.14
02:33:52  idna==3.10
02:33:52  importlib-resources==1.5.0
02:33:52  iso8601==2.1.0
02:33:52  Jinja2==3.1.6
02:33:52  jmespath==1.0.1
02:33:52  jsonpatch==1.33
02:33:52  jsonpointer==3.0.0
02:33:52  jsonschema==4.25.1
02:33:52  jsonschema-specifications==2025.9.1
02:33:52  keystoneauth1==5.12.0
02:33:52  kubernetes==33.1.0
02:33:52  lftools==0.37.13
02:33:52  lxml==6.0.2
02:33:52  markdown-it-py==4.0.0
02:33:52  MarkupSafe==3.0.2
02:33:52  mdurl==0.1.2
02:33:52  msgpack==1.1.1
02:33:52  multi_key_dict==2.0.3
02:33:52  munch==4.0.0
02:33:52  netaddr==1.3.0
02:33:52  niet==1.4.2
02:33:52  nodeenv==1.9.1
02:33:52  oauth2client==4.1.3
02:33:52  oauthlib==3.3.1
02:33:52  openstacksdk==4.7.1
02:33:52  os-service-types==1.8.0
02:33:52  osc-lib==4.2.0
02:33:52  oslo.config==10.0.0
02:33:52  oslo.context==6.1.0
02:33:52  oslo.i18n==6.6.0
02:33:52  oslo.log==7.2.1
02:33:52  oslo.serialization==5.8.0
02:33:52  oslo.utils==9.1.0
02:33:52  packaging==25.0
02:33:52  pbr==7.0.1
02:33:52  platformdirs==4.4.0
02:33:52  prettytable==3.16.0
02:33:52  psutil==7.1.0
02:33:52  pyasn1==0.6.1
02:33:52  pyasn1_modules==0.4.2
02:33:52  pycparser==2.23
02:33:52  pygerrit2==2.0.15
02:33:52  PyGithub==2.8.1
02:33:52  Pygments==2.19.2
02:33:52  PyJWT==2.10.1
02:33:52  PyNaCl==1.6.0
02:33:52  pyparsing==2.4.7
02:33:52  pyperclip==1.10.0
02:33:52  pyrsistent==0.20.0
02:33:52  python-cinderclient==9.8.0
02:33:52  python-dateutil==2.9.0.post0
02:33:52  python-heatclient==4.3.0
02:33:52  python-jenkins==1.8.3
02:33:52  python-keystoneclient==5.7.0
02:33:52  python-magnumclient==4.9.0
02:33:52  python-openstackclient==8.2.0
02:33:52  python-swiftclient==4.8.0
02:33:52  PyYAML==6.0.2
02:33:52  referencing==0.36.2
02:33:52  requests==2.32.5
02:33:52  requests-oauthlib==2.0.0
02:33:52  requestsexceptions==1.4.0
02:33:52  rfc3986==2.0.0
02:33:52  rich==14.1.0
02:33:52  rich-argparse==1.7.1
02:33:52  rpds-py==0.27.1
02:33:52  rsa==4.9.1
02:33:52  ruamel.yaml==0.18.15
02:33:52  ruamel.yaml.clib==0.2.14
02:33:52  s3transfer==0.14.0
02:33:52  simplejson==3.20.1
02:33:52  six==1.17.0
02:33:52  smmap==5.0.2
02:33:52  soupsieve==2.8
02:33:52  stevedore==5.5.0
02:33:52  tabulate==0.9.0
02:33:52  toml==0.10.2
02:33:52  tomlkit==0.13.3
02:33:52  tqdm==4.67.1
02:33:52  typing_extensions==4.15.0
02:33:52  tzdata==2025.2
02:33:52  urllib3==1.26.20
02:33:52  virtualenv==20.34.0
02:33:52  wcwidth==0.2.14
02:33:52  websocket-client==1.8.0
02:33:52  wrapt==1.17.3
02:33:52  xdg==6.0.0
02:33:52  xmltodict==1.0.2
02:33:52  yq==3.4.3
02:33:52  [EnvInject] - Injecting environment variables from a build step.
02:33:52  [EnvInject] - Injecting as environment variables the properties content 
02:33:52  OS_CLOUD=vex
02:33:52  
02:33:52  [EnvInject] - Variables injected successfully.
02:33:52  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
02:33:52  Run condition [Boolean condition] enabling perform for step [Execute shell]
02:33:52  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins7092365282778376714.sh
02:33:52  ---> Orphaned k8s clusters
02:33:52  Setup pyenv:
02:33:53    system
02:33:53    3.8.13
02:33:53    3.9.13
02:33:53    3.10.13
02:33:53  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
02:33:53  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-K3QA from file:/tmp/.os_lf_venv
02:33:53  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
02:33:53  lf-activate-venv(): INFO: Attempting to install with network-safe options...
02:33:55  lf-activate-venv(): INFO: Base packages installed successfully
02:33:55  lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 
02:34:02  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
02:34:02  lftools 0.37.13 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible.
02:34:03  lf-activate-venv(): INFO: Adding /tmp/venv-K3QA/bin to PATH
02:34:05  -----> Delete orphaned cluster
02:34:05  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
02:34:05  Run condition [Boolean condition] enabling perform for step [Execute shell]
02:34:05  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins1138067837565800773.sh
02:34:05  ---> Orphaned stacks
02:34:05  Setup pyenv:
02:34:06    system
02:34:06    3.8.13
02:34:06    3.9.13
02:34:06    3.10.13
02:34:06  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
02:34:06  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-K3QA from file:/tmp/.os_lf_venv
02:34:06  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
02:34:06  lf-activate-venv(): INFO: Attempting to install with network-safe options...
02:34:08  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
02:34:08  lftools 0.37.13 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible.
02:34:08  lf-activate-venv(): INFO: Base packages installed successfully
02:34:08  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 
02:34:27  lf-activate-venv(): INFO: Adding /tmp/venv-K3QA/bin to PATH
02:34:27  + mapfile -t OS_COE_CLUSTERS_ID
02:34:27  ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)'
02:34:27  ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name
02:34:27  ++ awk '{print $1}'
02:34:30  + echo '-----> Active clusters -> stacks'
02:34:30  -----> Active clusters -> stacks
02:34:30  + OS_COE_STACKS=()
02:34:30  + [[ 0 -gt 0 ]]
02:34:30  + mapfile -t OS_STACKS
02:34:30  ++ awk '{print $1}'
02:34:30  ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED
02:34:31  + echo '-----> Active stacks'
02:34:31  -----> Active stacks
02:34:31  + for stack in "${OS_STACKS[@]}"
02:34:31  + echo releng-bgpcep-csit-1node-bgp-ingest-all-titanium-427
02:34:31  releng-bgpcep-csit-1node-bgp-ingest-all-titanium-427
02:34:31  + echo '-----> Delete orphaned stacks'
02:34:31  -----> Delete orphaned stacks
02:34:31  + for STACK_NAME in "${OS_STACKS[@]}"
02:34:31  + [[ 0 -gt 0 ]]
02:34:31  + stack_in_jenkins releng-bgpcep-csit-1node-bgp-ingest-all-titanium-427 https://jenkins.opendaylight.org/releng https://jenkins.opendaylight.org/sandbox
02:34:31  + STACK_NAME=releng-bgpcep-csit-1node-bgp-ingest-all-titanium-427
02:34:31  + builds=()
02:34:31  + for jenkins in "${@:2}"
02:34:31  + PARAMS='tree=computer[executors[currentExecutable[url]],'
02:34:31  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]'
02:34:31  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
02:34:31  + JENKINS_URL='https://jenkins.opendaylight.org/releng/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
02:34:31  ++ curl -s -w '\n\n%{http_code}' --globoff -H Content-Type:application/json 'https://jenkins.opendaylight.org/releng/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
02:34:31  + resp='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73943/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/bgpcep-csit-1node-bgp-ingest-all-titanium/427/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-distribution-test-titanium/438/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]}
02:34:31  
02:34:31  200'
02:34:31  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73943/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/bgpcep-csit-1node-bgp-ingest-all-titanium/427/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-distribution-test-titanium/438/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]}
02:34:31  
02:34:31  200'
02:34:31  ++ head -n1
02:34:31  + json_data='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73943/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/bgpcep-csit-1node-bgp-ingest-all-titanium/427/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-distribution-test-titanium/438/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]}'
02:34:31  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73943/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/bgpcep-csit-1node-bgp-ingest-all-titanium/427/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-distribution-test-titanium/438/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]}
02:34:31  
02:34:31  200'
02:34:31  ++ awk 'END {print $NF}'
02:34:31  + status=200
02:34:31  + '[' 200 '!=' 200 ']'
02:34:31  + [[ https://jenkins.opendaylight.org/releng == *\j\e\n\k\i\n\s\.*\.\o\r\g ]]
02:34:31  + [[ https://jenkins.opendaylight.org/releng == *\j\e\n\k\i\n\s\.*\.\i\o ]]
02:34:31  ++ awk -F/ '{print $NF}'
02:34:31  ++ echo https://jenkins.opendaylight.org/releng
02:34:31  ++ sed 's/\/*$//'
02:34:31  + silo=releng
02:34:31  + export silo
02:34:31  + builds=(${builds[@]} $(echo "$json_data" |             jq -r '.computer[].executors[].currentExecutable.url'             | grep -v null | awk -F'/' '{print ENVIRON["silo"] "-" $6 "-" $7}'))
02:34:31  ++ awk -F/ '{print ENVIRON["silo"] "-" $6 "-" $7}'
02:34:31  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73943/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/bgpcep-csit-1node-bgp-ingest-all-titanium/427/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-distribution-test-titanium/438/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]}'
02:34:31  ++ jq -r '.computer[].executors[].currentExecutable.url'
02:34:31  ++ grep -v null
02:34:31  + for jenkins in "${@:2}"
02:34:31  + PARAMS='tree=computer[executors[currentExecutable[url]],'
02:34:31  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]'
02:34:31  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
02:34:31  + JENKINS_URL='https://jenkins.opendaylight.org/sandbox/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
02:34:31  ++ curl -s -w '\n\n%{http_code}' --globoff -H Content-Type:application/json 'https://jenkins.opendaylight.org/sandbox/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
02:34:31  + resp='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}
02:34:31  
02:34:31  200'
02:34:31  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}
02:34:31  
02:34:31  200'
02:34:31  ++ head -n1
02:34:31  + json_data='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}'
02:34:31  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}
02:34:31  
02:34:31  200'
02:34:31  ++ awk 'END {print $NF}'
02:34:31  + status=200
02:34:31  + '[' 200 '!=' 200 ']'
02:34:31  + [[ https://jenkins.opendaylight.org/sandbox == *\j\e\n\k\i\n\s\.*\.\o\r\g ]]
02:34:31  + [[ https://jenkins.opendaylight.org/sandbox == *\j\e\n\k\i\n\s\.*\.\i\o ]]
02:34:31  ++ echo https://jenkins.opendaylight.org/sandbox
02:34:31  ++ sed 's/\/*$//'
02:34:31  ++ awk -F/ '{print $NF}'
02:34:31  + silo=sandbox
02:34:31  + export silo
02:34:31  + builds=(${builds[@]} $(echo "$json_data" |             jq -r '.computer[].executors[].currentExecutable.url'             | grep -v null | awk -F'/' '{print ENVIRON["silo"] "-" $6 "-" $7}'))
02:34:31  ++ awk -F/ '{print ENVIRON["silo"] "-" $6 "-" $7}'
02:34:31  ++ jq -r '.computer[].executors[].currentExecutable.url'
02:34:31  ++ grep -v null
02:34:31  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}'
02:34:31  + [[ releng-builder-openstack-cron-73943 releng-bgpcep-csit-1node-bgp-ingest-all-titanium-427 releng-integration-distribution-test-titanium-438 =~ releng-bgpcep-csit-1node-bgp-ingest-all-titanium-427 ]]
02:34:31  + return 0
02:34:31  + continue
02:34:31  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
02:34:31  Run condition [Boolean condition] enabling perform for step [Execute shell]
02:34:31  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins364327113502243161.sh
02:34:31  ---> Orphaned servers
02:34:31  Setup pyenv:
02:34:32    system
02:34:32    3.8.13
02:34:32    3.9.13
02:34:32    3.10.13
02:34:32  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
02:34:32  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-K3QA from file:/tmp/.os_lf_venv
02:34:32  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
02:34:32  lf-activate-venv(): INFO: Attempting to install with network-safe options...
02:34:34  lf-activate-venv(): INFO: Base packages installed successfully
02:34:34  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
02:34:49  lf-activate-venv(): INFO: Adding /tmp/venv-K3QA/bin to PATH
02:34:55  -----> Active servers
02:34:55  prd-centos8-builder-2c-2g-674
02:34:55  prd-ubuntu2204-builder-2c-2g-657
02:34:55  prd-centos8-robot-2c-8g-640
02:34:55  prd-queue-disttest-2c-1g-639
02:34:55  prd-centos8-robot-2c-8g-144
02:34:55  prd-centos8-robot-2c-8g-141
02:34:55  prd-centos8-robot-2c-8g-136
02:34:55  prd-ubuntu2204-docker-8c-8g-128
02:34:55  -----> Delete orphaned servers
02:34:55  Deleting orphaned server: prd-centos8-robot-2c-8g-144
02:34:57  AttributeError: 'Server' object has no attribute 'created'. Did you mean: 'create'?
02:34:58  Deleting orphaned server: prd-centos8-robot-2c-8g-141
02:35:00  AttributeError: 'Server' object has no attribute 'created'. Did you mean: 'create'?
02:35:00  Deleting orphaned server: prd-centos8-robot-2c-8g-136
02:35:02  AttributeError: 'Server' object has no attribute 'created'. Did you mean: 'create'?
02:35:02  Deleting orphaned server: prd-ubuntu2204-docker-8c-8g-128
02:35:04  AttributeError: 'Server' object has no attribute 'created'. Did you mean: 'create'?
02:35:05  Build step 'Conditional step (single)' marked build as failure
02:35:05  $ ssh-agent -k
02:35:05  unset SSH_AUTH_SOCK;
02:35:05  unset SSH_AGENT_PID;
02:35:05  echo Agent pid 5449 killed;
02:35:05  [ssh-agent] Stopped.
02:35:05  [PostBuildScript] - [INFO] Executing post build scripts.
02:35:05  [builder-openstack-cron] $ /bin/bash /tmp/jenkins13049402876975270925.sh
02:35:05  ---> sysstat.sh
02:35:05  [builder-openstack-cron] $ /bin/bash /tmp/jenkins14330123238044797433.sh
02:35:05  ---> package-listing.sh
02:35:05  ++ facter osfamily
02:35:05  ++ tr '[:upper:]' '[:lower:]'
02:35:05  + OS_FAMILY=redhat
02:35:05  + workspace=/w/workspace/builder-openstack-cron
02:35:05  + START_PACKAGES=/tmp/packages_start.txt
02:35:05  + END_PACKAGES=/tmp/packages_end.txt
02:35:05  + DIFF_PACKAGES=/tmp/packages_diff.txt
02:35:05  + PACKAGES=/tmp/packages_start.txt
02:35:05  + '[' /w/workspace/builder-openstack-cron ']'
02:35:05  + PACKAGES=/tmp/packages_end.txt
02:35:05  + case "${OS_FAMILY}" in
02:35:05  + rpm -qa
02:35:05  + sort
02:35:06  + '[' -f /tmp/packages_start.txt ']'
02:35:06  + '[' -f /tmp/packages_end.txt ']'
02:35:06  + diff /tmp/packages_start.txt /tmp/packages_end.txt
02:35:06  + '[' /w/workspace/builder-openstack-cron ']'
02:35:06  + mkdir -p /w/workspace/builder-openstack-cron/archives/
02:35:06  + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/builder-openstack-cron/archives/
02:35:06  [builder-openstack-cron] $ /bin/bash /tmp/jenkins15448276428864227722.sh
02:35:06  ---> capture-instance-metadata.sh
02:35:06  Setup pyenv:
02:35:06    system
02:35:06    3.8.13
02:35:06    3.9.13
02:35:06    3.10.13
02:35:06  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
02:35:07  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-K3QA from file:/tmp/.os_lf_venv
02:35:07  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
02:35:07  lf-activate-venv(): INFO: Attempting to install with network-safe options...
02:35:09  lf-activate-venv(): INFO: Base packages installed successfully
02:35:09  lf-activate-venv(): INFO: Installing additional packages: lftools 
02:35:20  lf-activate-venv(): INFO: Adding /tmp/venv-K3QA/bin to PATH
02:35:20  INFO: Running in OpenStack, capturing instance metadata
02:35:20  [builder-openstack-cron] $ /bin/bash /tmp/jenkins3052732102941892190.sh
02:35:20  provisioning config files...
02:35:20  Could not find credentials [logs] for builder-openstack-cron #73943
02:35:20  copy managed file [jenkins-log-archives-settings] to file:/w/workspace/builder-openstack-cron@tmp/config1612998219273093542tmp
02:35:20  Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index]
02:35:20  Run condition [Regular expression match] enabling perform for step [Provide Configuration files]
02:35:20  provisioning config files...
02:35:21  copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials
02:35:21  [EnvInject] - Injecting environment variables from a build step.
02:35:21  [EnvInject] - Injecting as environment variables the properties content 
02:35:21  SERVER_ID=logs
02:35:21  
02:35:21  [EnvInject] - Variables injected successfully.
02:35:21  [builder-openstack-cron] $ /bin/bash /tmp/jenkins14663000616444115465.sh
02:35:21  ---> create-netrc.sh
02:35:21  WARN: Log server credential not found.
02:35:21  [builder-openstack-cron] $ /bin/bash /tmp/jenkins10932968176582635018.sh
02:35:21  ---> python-tools-install.sh
02:35:21  Setup pyenv:
02:35:21    system
02:35:21    3.8.13
02:35:21    3.9.13
02:35:21    3.10.13
02:35:21  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
02:35:21  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-K3QA from file:/tmp/.os_lf_venv
02:35:21  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
02:35:21  lf-activate-venv(): INFO: Attempting to install with network-safe options...
02:35:23  lf-activate-venv(): INFO: Base packages installed successfully
02:35:23  lf-activate-venv(): INFO: Installing additional packages: lftools 
02:35:34  lf-activate-venv(): INFO: Adding /tmp/venv-K3QA/bin to PATH
02:35:34  [builder-openstack-cron] $ /bin/bash /tmp/jenkins369936519066079011.sh
02:35:34  ---> sudo-logs.sh
02:35:34  Archiving 'sudo' log..
02:35:35  [builder-openstack-cron] $ /bin/bash /tmp/jenkins9815067777008724905.sh
02:35:35  ---> job-cost.sh
02:35:35  Setup pyenv:
02:35:35    system
02:35:35    3.8.13
02:35:35    3.9.13
02:35:35    3.10.13
02:35:35  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
02:35:35  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-K3QA from file:/tmp/.os_lf_venv
02:35:35  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
02:35:35  lf-activate-venv(): INFO: Attempting to install with network-safe options...
02:35:37  lf-activate-venv(): INFO: Base packages installed successfully
02:35:37  lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
02:35:44  lf-activate-venv(): INFO: Adding /tmp/venv-K3QA/bin to PATH
02:35:44  INFO: No Stack...
02:35:45  INFO: Retrieving Pricing Info for: v3-standard-2
02:35:45  INFO: Archiving Costs
02:35:45  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins5962783587807227607.sh
02:35:45  ---> logs-deploy.sh
02:35:45  Setup pyenv:
02:35:45    system
02:35:45    3.8.13
02:35:45    3.9.13
02:35:45    3.10.13
02:35:45  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
02:35:46  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-K3QA from file:/tmp/.os_lf_venv
02:35:46  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
02:35:46  lf-activate-venv(): INFO: Attempting to install with network-safe options...
02:35:47  lf-activate-venv(): INFO: Base packages installed successfully
02:35:47  lf-activate-venv(): INFO: Installing additional packages: lftools 
02:35:57  lf-activate-venv(): INFO: Adding /tmp/venv-K3QA/bin to PATH
02:35:57  WARNING: Nexus logging server not set
02:35:57  INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/builder-openstack-cron/73943/
02:35:57  INFO: archiving logs to S3
02:35:58  ---> uname -a:
02:35:58  Linux prd-centos8-builder-2c-2g-674.novalocal 4.18.0-553.5.1.el8.x86_64 #1 SMP Tue May 21 05:46:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
02:35:58  
02:35:58  
02:35:58  ---> lscpu:
02:35:58  Architecture:        x86_64
02:35:58  CPU op-mode(s):      32-bit, 64-bit
02:35:58  Byte Order:          Little Endian
02:35:58  CPU(s):              2
02:35:58  On-line CPU(s) list: 0,1
02:35:58  Thread(s) per core:  1
02:35:58  Core(s) per socket:  1
02:35:58  Socket(s):           2
02:35:58  NUMA node(s):        1
02:35:58  Vendor ID:           AuthenticAMD
02:35:58  CPU family:          23
02:35:58  Model:               49
02:35:58  Model name:          AMD EPYC-Rome Processor
02:35:58  Stepping:            0
02:35:58  CPU MHz:             2800.000
02:35:58  BogoMIPS:            5600.00
02:35:58  Virtualization:      AMD-V
02:35:58  Hypervisor vendor:   KVM
02:35:58  Virtualization type: full
02:35:58  L1d cache:           32K
02:35:58  L1i cache:           32K
02:35:58  L2 cache:            512K
02:35:58  L3 cache:            16384K
02:35:58  NUMA node0 CPU(s):   0,1
02:35:58  Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
02:35:58  
02:35:58  
02:35:58  ---> nproc:
02:35:58  2
02:35:58  
02:35:58  
02:35:58  ---> df -h:
02:35:58  Filesystem      Size  Used Avail Use% Mounted on
02:35:58  devtmpfs        3.8G     0  3.8G   0% /dev
02:35:58  tmpfs           3.8G     0  3.8G   0% /dev/shm
02:35:58  tmpfs           3.8G   17M  3.8G   1% /run
02:35:58  tmpfs           3.8G     0  3.8G   0% /sys/fs/cgroup
02:35:58  /dev/vda1        40G  8.4G   32G  21% /
02:35:58  tmpfs           770M     0  770M   0% /run/user/1001
02:35:58  
02:35:58  
02:35:58  ---> free -m:
02:35:58                total        used        free      shared  buff/cache   available
02:35:58  Mem:           7697         614        4820          19        2263        6786
02:35:58  Swap:          1023           0        1023
02:35:58  
02:35:58  
02:35:58  ---> ip addr:
02:35:58  1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
02:35:58      link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
02:35:58      inet 127.0.0.1/8 scope host lo
02:35:58         valid_lft forever preferred_lft forever
02:35:58      inet6 ::1/128 scope host 
02:35:58         valid_lft forever preferred_lft forever
02:35:58  2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1458 qdisc mq state UP group default qlen 1000
02:35:58      link/ether fa:16:3e:83:be:9d brd ff:ff:ff:ff:ff:ff
02:35:58      altname enp0s3
02:35:58      altname ens3
02:35:58      inet 10.30.170.243/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0
02:35:58         valid_lft 86168sec preferred_lft 86168sec
02:35:58      inet6 fe80::f816:3eff:fe83:be9d/64 scope link 
02:35:58         valid_lft forever preferred_lft forever
02:35:58  3: docker0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1458 qdisc noqueue state DOWN group default 
02:35:58      link/ether 02:42:74:9e:a3:4e brd ff:ff:ff:ff:ff:ff
02:35:58      inet 10.250.0.254/24 brd 10.250.0.255 scope global docker0
02:35:58         valid_lft forever preferred_lft forever
02:35:58  
02:35:58  
02:35:58  ---> sar -b -r -n DEV:
02:35:58  Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-builder-5e6ee0fb-b6d9-4116-90d4-35c890e2b0f7.nov) 	09/24/2025 	_x86_64_	(2 CPU)
02:35:58  
02:35:58  02:31:57     LINUX RESTART	(2 CPU)
02:35:58  
02:35:58  02:33:01 AM       tps      rtps      wtps   bread/s   bwrtn/s
02:35:58  02:34:01 AM    109.65      0.68    108.96     25.19   9622.48
02:35:58  02:35:01 AM     63.97      1.07     62.91    133.44   7683.19
02:35:58  Average:        86.81      0.87     85.94     79.31   8652.91
02:35:58  
02:35:58  02:33:01 AM kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
02:35:58  02:34:01 AM   5002328   6968184   2880104     36.54      2688   2142488    971340     10.88    203060   2328292    153100
02:35:58  02:35:01 AM   4960636   6968156   2921796     37.07      2688   2182564    985948     11.04    248716   2316320     11752
02:35:58  Average:      4981482   6968170   2900950     36.80      2688   2162526    978644     10.96    225888   2322306     82426
02:35:58  
02:35:58  02:33:01 AM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
02:35:58  02:34:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:35:58  02:34:01 AM      eth0     79.31     65.59    900.26      9.61      0.00      0.00      0.00      0.00
02:35:58  02:34:01 AM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:35:58  02:35:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:35:58  02:35:01 AM      eth0     63.99     53.07    602.46      9.65      0.00      0.00      0.00      0.00
02:35:58  02:35:01 AM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:35:58  Average:           lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:35:58  Average:         eth0     71.65     59.34    751.37      9.63      0.00      0.00      0.00      0.00
02:35:58  Average:      docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:35:58  
02:35:58  
02:35:58  ---> sar -P ALL:
02:35:58  Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-builder-5e6ee0fb-b6d9-4116-90d4-35c890e2b0f7.nov) 	09/24/2025 	_x86_64_	(2 CPU)
02:35:58  
02:35:58  02:31:57     LINUX RESTART	(2 CPU)
02:35:58  
02:35:58  02:33:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:35:58  02:34:01 AM     all     36.68      0.00      5.36      0.96      0.13     56.87
02:35:58  02:34:01 AM       0     49.10      0.00      6.90      1.29      0.13     42.58
02:35:58  02:34:01 AM       1     24.32      0.00      3.83      0.63      0.12     71.10
02:35:58  02:35:01 AM     all     31.46      0.00      4.11      0.71      0.10     63.63
02:35:58  02:35:01 AM       0     50.18      0.00      4.91      0.67      0.10     44.15
02:35:58  02:35:01 AM       1     12.74      0.00      3.30      0.75      0.10     83.11
02:35:58  Average:        all     34.07      0.00      4.73      0.83      0.11     60.25
02:35:58  Average:          0     49.64      0.00      5.90      0.98      0.12     43.37
02:35:58  Average:          1     18.54      0.00      3.57      0.69      0.11     77.10
02:35:58  
02:35:58  
02:35:58