08:32:46  Started by timer
08:32:46  Running as SYSTEM
08:32:46  [EnvInject] - Loading node environment variables.
08:32:46  Building remotely on prd-centos8-builder-2c-2g-84 (centos8-builder-2c-2g) in workspace /w/workspace/builder-openstack-cron
08:32:46  [ssh-agent] Looking for ssh-agent implementation...
08:32:46  [ssh-agent]   Exec ssh-agent (binary ssh-agent on a remote machine)
08:32:46  $ ssh-agent
08:32:46  SSH_AUTH_SOCK=/tmp/ssh-F3kwcGpdkL1q/agent.5444
08:32:46  SSH_AGENT_PID=5445
08:32:46  [ssh-agent] Started.
08:32:46  Running ssh-add (command line suppressed)
08:32:46  Identity added: /w/workspace/builder-openstack-cron@tmp/private_key_3821512427874600040.key (/w/workspace/builder-openstack-cron@tmp/private_key_3821512427874600040.key)
08:32:46  [ssh-agent] Using credentials jenkins (jenkins-ssh)
08:32:46  The recommended git tool is: NONE
08:32:49  using credential jenkins-ssh
08:32:49  Wiping out workspace first.
08:32:49  Cloning the remote Git repository
08:32:49  Cloning repository git://devvexx.opendaylight.org/mirror/releng/builder
08:32:49   > git init /w/workspace/builder-openstack-cron # timeout=10
08:32:49  Fetching upstream changes from git://devvexx.opendaylight.org/mirror/releng/builder
08:32:49   > git --version # timeout=10
08:32:49   > git --version # 'git version 2.43.0'
08:32:49  using GIT_SSH to set credentials jenkins-ssh
08:32:49  [INFO] Currently running in a labeled security context
08:32:49  [INFO] Currently SELinux is 'enforcing' on the host
08:32:49   > /usr/bin/chcon --type=ssh_home_t /w/workspace/builder-openstack-cron@tmp/jenkins-gitclient-ssh4329897744969055768.key
08:32:49  Verifying host key using known hosts file
08:32:49  You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
08:32:49   > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/releng/builder +refs/heads/*:refs/remotes/origin/* # timeout=10
08:32:52   > git config remote.origin.url git://devvexx.opendaylight.org/mirror/releng/builder # timeout=10
08:32:52   > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
08:32:52  Avoid second fetch
08:32:52   > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
08:32:52  Checking out Revision 18ab6e3e025372456469a34a3413c78bacf8d3cd (refs/remotes/origin/master)
08:32:52   > git config core.sparsecheckout # timeout=10
08:32:52   > git checkout -f 18ab6e3e025372456469a34a3413c78bacf8d3cd # timeout=10
08:32:53  Commit message: "Add jobs for aaa-0.21.x"
08:32:53   > git rev-list --no-walk 18ab6e3e025372456469a34a3413c78bacf8d3cd # timeout=10
08:32:53   > git remote # timeout=10
08:32:53   > git submodule init # timeout=10
08:32:53   > git submodule sync # timeout=10
08:32:53   > git config --get remote.origin.url # timeout=10
08:32:53   > git submodule init # timeout=10
08:32:53   > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10
08:32:53   > git config --get submodule.global-jjb.url # timeout=10
08:32:53   > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10
08:32:53   > git config --get submodule.packer/common-packer.url # timeout=10
08:32:53   > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10
08:32:53   > git submodule update --init --recursive global-jjb # timeout=10
08:32:54   > git submodule update --init --recursive packer/common-packer # timeout=10
08:32:58  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
08:32:58  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
08:32:58  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
08:32:58  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
08:32:58  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
08:32:58  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
08:32:58  Run condition [Boolean condition] enabling prebuild for step [BuilderChain]
08:32:58  No emails were triggered.
08:32:58  provisioning config files...
08:32:58  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
08:32:58  copy managed file [npmrc] to file:/home/jenkins/.npmrc
08:32:58  copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
08:32:59  [builder-openstack-cron] $ /bin/bash /tmp/jenkins5721021416154213144.sh
08:32:59  ---> python-tools-install.sh
08:32:59  Setup pyenv:
08:32:59    system
08:32:59  * 3.8.13 (set by /opt/pyenv/version)
08:32:59  * 3.9.13 (set by /opt/pyenv/version)
08:32:59  * 3.10.13 (set by /opt/pyenv/version)
08:32:59  * 3.11.7 (set by /opt/pyenv/version)
08:33:04  lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-C0nE
08:33:04  lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
08:33:04  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
08:33:04  lf-activate-venv(): INFO: Attempting to install with network-safe options...
08:33:08  lf-activate-venv(): INFO: Base packages installed successfully
08:33:08  lf-activate-venv(): INFO: Installing additional packages: lftools 
08:33:32  lf-activate-venv(): INFO: Adding /tmp/venv-C0nE/bin to PATH
08:33:32  Generating Requirements File
08:33:52  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
08:33:52  httplib2 0.31.0 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible.
08:33:53  Python 3.11.7
08:33:53  pip 25.2 from /tmp/venv-C0nE/lib/python3.11/site-packages/pip (python 3.11)
08:33:53  appdirs==1.4.4
08:33:53  argcomplete==3.6.2
08:33:53  aspy.yaml==1.3.0
08:33:53  attrs==25.3.0
08:33:53  autopage==0.5.2
08:33:53  beautifulsoup4==4.14.2
08:33:53  boto3==1.40.43
08:33:53  botocore==1.40.43
08:33:53  bs4==0.0.2
08:33:53  cachetools==6.2.0
08:33:53  certifi==2025.8.3
08:33:53  cffi==2.0.0
08:33:53  cfgv==3.4.0
08:33:53  chardet==5.2.0
08:33:53  charset-normalizer==3.4.3
08:33:53  click==8.3.0
08:33:53  cliff==4.11.0
08:33:53  cmd2==2.7.0
08:33:53  cryptography==3.3.2
08:33:53  debtcollector==3.0.0
08:33:53  decorator==5.2.1
08:33:53  defusedxml==0.7.1
08:33:53  Deprecated==1.2.18
08:33:53  distlib==0.4.0
08:33:53  dnspython==2.8.0
08:33:53  docker==7.1.0
08:33:53  dogpile.cache==1.4.1
08:33:53  durationpy==0.10
08:33:53  email-validator==2.3.0
08:33:53  filelock==3.19.1
08:33:53  future==1.0.0
08:33:53  gitdb==4.0.12
08:33:53  GitPython==3.1.45
08:33:53  google-auth==2.41.1
08:33:53  httplib2==0.31.0
08:33:53  identify==2.6.14
08:33:53  idna==3.10
08:33:53  importlib-resources==1.5.0
08:33:53  iso8601==2.1.0
08:33:53  Jinja2==3.1.6
08:33:53  jmespath==1.0.1
08:33:53  jsonpatch==1.33
08:33:53  jsonpointer==3.0.0
08:33:53  jsonschema==4.25.1
08:33:53  jsonschema-specifications==2025.9.1
08:33:53  keystoneauth1==5.12.0
08:33:53  kubernetes==34.1.0
08:33:53  lftools==0.37.14
08:33:53  lxml==6.0.2
08:33:53  markdown-it-py==4.0.0
08:33:53  MarkupSafe==3.0.3
08:33:53  mdurl==0.1.2
08:33:53  msgpack==1.1.1
08:33:53  multi_key_dict==2.0.3
08:33:53  munch==4.0.0
08:33:53  netaddr==1.3.0
08:33:53  niet==1.4.2
08:33:53  nodeenv==1.9.1
08:33:53  oauth2client==4.1.3
08:33:53  oauthlib==3.3.1
08:33:53  openstacksdk==4.7.1
08:33:53  os-service-types==1.8.0
08:33:53  osc-lib==4.2.0
08:33:53  oslo.config==10.0.0
08:33:53  oslo.context==6.1.0
08:33:53  oslo.i18n==6.6.0
08:33:53  oslo.log==7.2.1
08:33:53  oslo.serialization==5.8.0
08:33:53  oslo.utils==9.1.0
08:33:53  packaging==25.0
08:33:53  pbr==7.0.1
08:33:53  platformdirs==4.4.0
08:33:53  prettytable==3.16.0
08:33:53  psutil==7.1.0
08:33:53  pyasn1==0.6.1
08:33:53  pyasn1_modules==0.4.2
08:33:53  pycparser==2.23
08:33:53  pygerrit2==2.0.15
08:33:53  PyGithub==2.8.1
08:33:53  Pygments==2.19.2
08:33:53  PyJWT==2.10.1
08:33:53  PyNaCl==1.6.0
08:33:53  pyparsing==2.4.7
08:33:53  pyperclip==1.11.0
08:33:53  pyrsistent==0.20.0
08:33:53  python-cinderclient==9.8.0
08:33:53  python-dateutil==2.9.0.post0
08:33:53  python-heatclient==4.3.0
08:33:53  python-jenkins==1.8.3
08:33:53  python-keystoneclient==5.7.0
08:33:53  python-magnumclient==4.9.0
08:33:53  python-openstackclient==8.2.0
08:33:53  python-swiftclient==4.8.0
08:33:53  PyYAML==6.0.3
08:33:53  referencing==0.36.2
08:33:53  requests==2.32.5
08:33:53  requests-oauthlib==2.0.0
08:33:53  requestsexceptions==1.4.0
08:33:53  rfc3986==2.0.0
08:33:53  rich==14.1.0
08:33:53  rich-argparse==1.7.1
08:33:53  rpds-py==0.27.1
08:33:53  rsa==4.9.1
08:33:53  ruamel.yaml==0.18.15
08:33:53  ruamel.yaml.clib==0.2.14
08:33:53  s3transfer==0.14.0
08:33:53  simplejson==3.20.2
08:33:53  six==1.17.0
08:33:53  smmap==5.0.2
08:33:53  soupsieve==2.8
08:33:53  stevedore==5.5.0
08:33:53  tabulate==0.9.0
08:33:53  toml==0.10.2
08:33:53  tomlkit==0.13.3
08:33:53  tqdm==4.67.1
08:33:53  typing_extensions==4.15.0
08:33:53  tzdata==2025.2
08:33:53  urllib3==1.26.20
08:33:53  virtualenv==20.34.0
08:33:53  wcwidth==0.2.14
08:33:53  websocket-client==1.8.0
08:33:53  wrapt==1.17.3
08:33:53  xdg==6.0.0
08:33:53  xmltodict==1.0.2
08:33:53  yq==3.4.3
08:33:53  [EnvInject] - Injecting environment variables from a build step.
08:33:53  [EnvInject] - Injecting as environment variables the properties content 
08:33:53  OS_CLOUD=vex
08:33:53  
08:33:53  [EnvInject] - Variables injected successfully.
08:33:53  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
08:33:53  Run condition [Boolean condition] enabling perform for step [Execute shell]
08:33:53  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins10878547402408349265.sh
08:33:53  ---> Orphaned k8s clusters
08:33:53  Setup pyenv:
08:33:53    system
08:33:53    3.8.13
08:33:53    3.9.13
08:33:53    3.10.13
08:33:53  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
08:33:54  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-C0nE from file:/tmp/.os_lf_venv
08:33:54  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
08:33:54  lf-activate-venv(): INFO: Attempting to install with network-safe options...
08:33:56  lf-activate-venv(): INFO: Base packages installed successfully
08:33:56  lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 
08:34:03  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
08:34:03  lftools 0.37.14 requires urllib3<2.1.0, but you have urllib3 2.3.0 which is incompatible.
08:34:03  lf-activate-venv(): INFO: Adding /tmp/venv-C0nE/bin to PATH
08:34:06  -----> Delete orphaned cluster
08:34:06  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
08:34:06  Run condition [Boolean condition] enabling perform for step [Execute shell]
08:34:06  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins7688169970902779753.sh
08:34:07  ---> Orphaned stacks
08:34:07  Setup pyenv:
08:34:07    system
08:34:07    3.8.13
08:34:07    3.9.13
08:34:07    3.10.13
08:34:07  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
08:34:07  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-C0nE from file:/tmp/.os_lf_venv
08:34:07  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
08:34:07  lf-activate-venv(): INFO: Attempting to install with network-safe options...
08:34:09  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
08:34:09  lftools 0.37.14 requires urllib3<2.1.0, but you have urllib3 2.3.0 which is incompatible.
08:34:09  lf-activate-venv(): INFO: Base packages installed successfully
08:34:09  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 
08:34:29  lf-activate-venv(): INFO: Adding /tmp/venv-C0nE/bin to PATH
08:34:29  + mapfile -t OS_COE_CLUSTERS_ID
08:34:29  ++ awk '{print $1}'
08:34:29  ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name
08:34:29  ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)'
08:34:31  + echo '-----> Active clusters -> stacks'
08:34:31  -----> Active clusters -> stacks
08:34:31  + OS_COE_STACKS=()
08:34:31  + [[ 0 -gt 0 ]]
08:34:31  + mapfile -t OS_STACKS
08:34:31  ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED
08:34:31  ++ awk '{print $1}'
08:34:32  + echo '-----> Active stacks'
08:34:32  -----> Active stacks
08:34:32  + for stack in "${OS_STACKS[@]}"
08:34:32  + echo releng-controller-csit-3node-clustering-tell-all-titanium-55
08:34:32  releng-controller-csit-3node-clustering-tell-all-titanium-55
08:34:32  + echo '-----> Delete orphaned stacks'
08:34:32  -----> Delete orphaned stacks
08:34:32  + for STACK_NAME in "${OS_STACKS[@]}"
08:34:32  + [[ 0 -gt 0 ]]
08:34:32  + stack_in_jenkins releng-controller-csit-3node-clustering-tell-all-titanium-55 https://jenkins.opendaylight.org/releng https://jenkins.opendaylight.org/sandbox
08:34:32  + STACK_NAME=releng-controller-csit-3node-clustering-tell-all-titanium-55
08:34:32  + builds=()
08:34:32  + for jenkins in "${@:2}"
08:34:32  + PARAMS='tree=computer[executors[currentExecutable[url]],'
08:34:32  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]'
08:34:32  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
08:34:32  + JENKINS_URL='https://jenkins.opendaylight.org/releng/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
08:34:32  ++ curl -s -w '\n\n%{http_code}' --globoff -H Content-Type:application/json 'https://jenkins.opendaylight.org/releng/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
08:34:32  + resp='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/74141/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/controller-csit-3node-clustering-tell-all-titanium/55/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-distribution-mri-test-titanium/55/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/aaa-maven-merge-0.21.x/3/"}}],"oneOffExecutors":[]}]}
08:34:32  
08:34:32  200'
08:34:32  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/74141/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/controller-csit-3node-clustering-tell-all-titanium/55/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-distribution-mri-test-titanium/55/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/aaa-maven-merge-0.21.x/3/"}}],"oneOffExecutors":[]}]}
08:34:32  
08:34:32  200'
08:34:32  ++ head -n1
08:34:32  + json_data='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/74141/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/controller-csit-3node-clustering-tell-all-titanium/55/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-distribution-mri-test-titanium/55/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/aaa-maven-merge-0.21.x/3/"}}],"oneOffExecutors":[]}]}'
08:34:32  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/74141/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/controller-csit-3node-clustering-tell-all-titanium/55/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-distribution-mri-test-titanium/55/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/aaa-maven-merge-0.21.x/3/"}}],"oneOffExecutors":[]}]}
08:34:32  
08:34:32  200'
08:34:32  ++ awk 'END {print $NF}'
08:34:32  + status=200
08:34:32  + '[' 200 '!=' 200 ']'
08:34:32  + [[ https://jenkins.opendaylight.org/releng == *\j\e\n\k\i\n\s\.*\.\o\r\g ]]
08:34:32  + [[ https://jenkins.opendaylight.org/releng == *\j\e\n\k\i\n\s\.*\.\i\o ]]
08:34:32  ++ awk -F/ '{print $NF}'
08:34:32  ++ echo https://jenkins.opendaylight.org/releng
08:34:32  ++ sed 's/\/*$//'
08:34:32  + silo=releng
08:34:32  + export silo
08:34:32  + builds=(${builds[@]} $(echo "$json_data" |             jq -r '.computer[].executors[].currentExecutable.url'             | grep -v null | awk -F'/' '{print ENVIRON["silo"] "-" $6 "-" $7}'))
08:34:32  ++ awk -F/ '{print ENVIRON["silo"] "-" $6 "-" $7}'
08:34:32  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/74141/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/controller-csit-3node-clustering-tell-all-titanium/55/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-distribution-mri-test-titanium/55/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/aaa-maven-merge-0.21.x/3/"}}],"oneOffExecutors":[]}]}'
08:34:32  ++ jq -r '.computer[].executors[].currentExecutable.url'
08:34:32  ++ grep -v null
08:34:32  + for jenkins in "${@:2}"
08:34:32  + PARAMS='tree=computer[executors[currentExecutable[url]],'
08:34:32  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]'
08:34:32  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
08:34:32  + JENKINS_URL='https://jenkins.opendaylight.org/sandbox/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
08:34:32  ++ curl -s -w '\n\n%{http_code}' --globoff -H Content-Type:application/json 'https://jenkins.opendaylight.org/sandbox/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
08:34:32  + resp='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}
08:34:32  
08:34:32  200'
08:34:32  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}
08:34:32  
08:34:32  200'
08:34:32  ++ head -n1
08:34:32  + json_data='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}'
08:34:32  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}
08:34:32  
08:34:32  200'
08:34:32  ++ awk 'END {print $NF}'
08:34:32  + status=200
08:34:32  + '[' 200 '!=' 200 ']'
08:34:32  + [[ https://jenkins.opendaylight.org/sandbox == *\j\e\n\k\i\n\s\.*\.\o\r\g ]]
08:34:32  + [[ https://jenkins.opendaylight.org/sandbox == *\j\e\n\k\i\n\s\.*\.\i\o ]]
08:34:32  ++ echo https://jenkins.opendaylight.org/sandbox
08:34:32  ++ awk -F/ '{print $NF}'
08:34:32  ++ sed 's/\/*$//'
08:34:32  + silo=sandbox
08:34:32  + export silo
08:34:32  + builds=(${builds[@]} $(echo "$json_data" |             jq -r '.computer[].executors[].currentExecutable.url'             | grep -v null | awk -F'/' '{print ENVIRON["silo"] "-" $6 "-" $7}'))
08:34:32  ++ grep -v null
08:34:32  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}'
08:34:32  ++ jq -r '.computer[].executors[].currentExecutable.url'
08:34:32  ++ awk -F/ '{print ENVIRON["silo"] "-" $6 "-" $7}'
08:34:32  + [[ releng-builder-openstack-cron-74141 releng-controller-csit-3node-clustering-tell-all-titanium-55 releng-integration-distribution-mri-test-titanium-55 releng-aaa-maven-merge-0.21.x-3 =~ releng-controller-csit-3node-clustering-tell-all-titanium-55 ]]
08:34:32  + return 0
08:34:32  + continue
08:34:32  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
08:34:32  Run condition [Boolean condition] enabling perform for step [Execute shell]
08:34:32  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins10667893287576005192.sh
08:34:32  ---> Orphaned servers
08:34:32  Setup pyenv:
08:34:33    system
08:34:33    3.8.13
08:34:33    3.9.13
08:34:33    3.10.13
08:34:33  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
08:34:33  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-C0nE from file:/tmp/.os_lf_venv
08:34:33  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
08:34:33  lf-activate-venv(): INFO: Attempting to install with network-safe options...
08:34:35  lf-activate-venv(): INFO: Base packages installed successfully
08:34:35  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
08:34:49  lf-activate-venv(): INFO: Adding /tmp/venv-C0nE/bin to PATH
08:34:56  -----> Active servers
08:34:56  prd-centos8-builder-2c-2g-84
08:34:56  prd-ubuntu2204-docker-4c-4g-83
08:34:56  prd-ubuntu2204-docker-4c-4g-80
08:34:56  prd-centos8-robot-2c-8g-46
08:34:56  prd-queue-intque-2c-1g-15
08:34:56  -----> Delete orphaned servers
08:34:56  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
08:34:56  Run condition [Boolean condition] enabling perform for step [Execute shell]
08:34:56  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins14113777033043272161.sh
08:34:57  ---> Orphaned ports
08:34:57  Setup pyenv:
08:34:57    system
08:34:57    3.8.13
08:34:57    3.9.13
08:34:57    3.10.13
08:34:57  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
08:34:57  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-C0nE from file:/tmp/.os_lf_venv
08:34:57  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
08:34:57  lf-activate-venv(): INFO: Attempting to install with network-safe options...
08:34:59  lf-activate-venv(): INFO: Base packages installed successfully
08:34:59  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] python-openstackclient 
08:35:12  lf-activate-venv(): INFO: Adding /tmp/venv-C0nE/bin to PATH
08:35:14  No orphaned ports to process.
08:35:14  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
08:35:14  Run condition [Boolean condition] enabling perform for step [Execute shell]
08:35:14  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins17294348765395038149.sh
08:35:14  ---> Orphaned volumes
08:35:14  + source /home/jenkins/lf-env.sh
08:35:14  + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
08:35:14  ++ mktemp -d /tmp/venv-XXXX
08:35:14  + lf_venv=/tmp/venv-oy2m
08:35:14  + local venv_file=/tmp/.os_lf_venv
08:35:14  + local python=python3
08:35:14  + local options
08:35:14  + local set_path=true
08:35:14  + local install_args=
08:35:14  ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
08:35:14  + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
08:35:14  + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
08:35:14  ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
08:35:14  + true
08:35:14  + case $1 in
08:35:14  + python=python3
08:35:14  + shift 2
08:35:14  + true
08:35:14  + case $1 in
08:35:14  + shift
08:35:14  + break
08:35:14  + case $python in
08:35:14  + local pkg_list=
08:35:14  + [[ -d /opt/pyenv ]]
08:35:14  + echo 'Setup pyenv:'
08:35:14  Setup pyenv:
08:35:14  + export PYENV_ROOT=/opt/pyenv
08:35:14  + PYENV_ROOT=/opt/pyenv
08:35:14  + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
08:35:14  + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
08:35:14  + pyenv versions
08:35:14    system
08:35:14    3.8.13
08:35:14    3.9.13
08:35:14    3.10.13
08:35:14  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
08:35:14  + command -v pyenv
08:35:14  ++ pyenv init - --no-rehash
08:35:14  + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); 
08:35:14  for i in ${!paths[@]}; do 
08:35:14  if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; 
08:35:14  fi; done; 
08:35:14  echo "${paths[*]}"'\'')"
08:35:14  export PATH="/opt/pyenv/shims:${PATH}"
08:35:14  export PYENV_SHELL=bash
08:35:14  source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\''
08:35:14  pyenv() {
08:35:14    local command
08:35:14    command="${1:-}"
08:35:14    if [ "$#" -gt 0 ]; then
08:35:14      shift
08:35:14    fi
08:35:14  
08:35:14    case "$command" in
08:35:14    rehash|shell)
08:35:14      eval "$(pyenv "sh-$command" "$@")"
08:35:14      ;;
08:35:14    *)
08:35:14      command pyenv "$command" "$@"
08:35:14      ;;
08:35:14    esac
08:35:14  }'
08:35:14  +++ bash --norc -ec 'IFS=:; paths=($PATH); 
08:35:14  for i in ${!paths[@]}; do 
08:35:14  if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; 
08:35:14  fi; done; 
08:35:14  echo "${paths[*]}"'
08:35:14  ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
08:35:14  ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
08:35:14  ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
08:35:14  ++ export PYENV_SHELL=bash
08:35:14  ++ PYENV_SHELL=bash
08:35:14  ++ source /opt/pyenv/libexec/../completions/pyenv.bash
08:35:14  +++ complete -F _pyenv pyenv
08:35:14  ++ lf-pyver python3
08:35:14  ++ local py_version_xy=python3
08:35:14  ++ local py_version_xyz=
08:35:14  ++ sed 's/^[ *]* //'
08:35:14  ++ awk '{ print $1 }'
08:35:14  ++ pyenv versions
08:35:14  ++ local command
08:35:14  ++ command=versions
08:35:14  ++ '[' 1 -gt 0 ']'
08:35:14  ++ shift
08:35:14  ++ case "$command" in
08:35:14  ++ command pyenv versions
08:35:14  ++ pyenv versions
08:35:14  ++ grep -E '^[0-9.]*[0-9]$'
08:35:14  ++ [[ ! -s /tmp/.pyenv_versions ]]
08:35:14  +++ tail -n 1
08:35:14  +++ sort -V
08:35:14  +++ grep '^3' /tmp/.pyenv_versions
08:35:14  ++ py_version_xyz=3.11.7
08:35:14  ++ [[ -z 3.11.7 ]]
08:35:14  ++ echo 3.11.7
08:35:14  ++ return 0
08:35:14  + pyenv local 3.11.7
08:35:14  + local command
08:35:14  + command=local
08:35:14  + '[' 2 -gt 0 ']'
08:35:14  + shift
08:35:14  + case "$command" in
08:35:14  + command pyenv local 3.11.7
08:35:14  + pyenv local 3.11.7
08:35:14  + for arg in "$@"
08:35:14  + case $arg in
08:35:14  + pkg_list+='lftools[openstack] '
08:35:14  + for arg in "$@"
08:35:14  + case $arg in
08:35:14  + pkg_list+='kubernetes '
08:35:14  + for arg in "$@"
08:35:14  + case $arg in
08:35:14  + pkg_list+='niet '
08:35:14  + for arg in "$@"
08:35:14  + case $arg in
08:35:14  + pkg_list+='python-heatclient '
08:35:14  + for arg in "$@"
08:35:14  + case $arg in
08:35:14  + pkg_list+='python-openstackclient '
08:35:14  + for arg in "$@"
08:35:14  + case $arg in
08:35:14  + pkg_list+='python-magnumclient '
08:35:14  + for arg in "$@"
08:35:14  + case $arg in
08:35:14  + pkg_list+='yq '
08:35:14  + [[ -f /tmp/.os_lf_venv ]]
08:35:14  ++ cat /tmp/.os_lf_venv
08:35:14  + lf_venv=/tmp/venv-C0nE
08:35:14  + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-C0nE from' file:/tmp/.os_lf_venv
08:35:14  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-C0nE from file:/tmp/.os_lf_venv
08:35:14  + echo 'lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)'
08:35:14  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
08:35:14  + local 'pip_opts=--upgrade --quiet'
08:35:14  + pip_opts='--upgrade --quiet --trusted-host pypi.org'
08:35:14  + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org'
08:35:14  + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org'
08:35:14  + [[ -n '' ]]
08:35:14  + [[ -n '' ]]
08:35:14  + echo 'lf-activate-venv(): INFO: Attempting to install with network-safe options...'
08:35:14  lf-activate-venv(): INFO: Attempting to install with network-safe options...
08:35:14  + /tmp/venv-C0nE/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org pip 'setuptools<66' virtualenv
08:35:16  + echo 'lf-activate-venv(): INFO: Base packages installed successfully'
08:35:16  lf-activate-venv(): INFO: Base packages installed successfully
08:35:16  + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq  ]]
08:35:16  + echo 'lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq '
08:35:16  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
08:35:16  + /tmp/venv-C0nE/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
08:35:33  + type python3
08:35:33  + true
08:35:33  + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-C0nE/bin to PATH'
08:35:33  lf-activate-venv(): INFO: Adding /tmp/venv-C0nE/bin to PATH
08:35:33  + PATH=/tmp/venv-C0nE/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
08:35:33  + return 0
08:35:33  + mapfile -t os_volumes
08:35:33  ++ openstack --os-cloud vex volume list -f value -c ID --status Available
08:35:37  + '[' 0 -eq 0 ']'
08:35:37  + echo 'No orphaned volumes found.'
08:35:37  No orphaned volumes found.
08:35:37  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
08:35:37  Run condition [Boolean condition] enabling perform for step [Execute shell]
08:35:37  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins7608660556370731799.sh
08:35:37  ---> Protect in-use images
08:35:37  Setup pyenv:
08:35:37    system
08:35:37    3.8.13
08:35:37    3.9.13
08:35:37    3.10.13
08:35:37  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
08:35:37  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-C0nE from file:/tmp/.os_lf_venv
08:35:37  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
08:35:37  lf-activate-venv(): INFO: Attempting to install with network-safe options...
08:35:39  lf-activate-venv(): INFO: Base packages installed successfully
08:35:39  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient 
08:35:52  lf-activate-venv(): INFO: Adding /tmp/venv-C0nE/bin to PATH
08:35:52  INFO: There are images to protect defined in jenkins-config.
08:35:52  INFO: There are additional images to protect in the jjb dir.
08:35:52  INFO: Protecting the following images:
08:35:52  ZZCI - CentOS 7 - builder - x86_64 - 20240701-060130.538
08:35:52  ZZCI - CentOS 7 - devstack-rocky - x86_64 - 20221101-000109.537"  # Unused
08:35:52  ZZCI - CentOS 7 - devstack-stein - x86_64 - 20221101-010107.368"  # Unused
08:35:52  ZZCI - CentOS 7 - devstack - x86_64 - 20240601-230133.464"  # Unused
08:35:52  ZZCI - CentOS 7 - docker - x86_64 - 20240601-220142.195
08:35:52  ZZCI - CentOS 7 - helm - x86_64 - 20230301-000133.034
08:35:52  ZZCI - CentOS 7 - robot - x86_64 - 20240601-220241.858
08:35:52  ZZCI - CentOS Stream 8 - builder - x86_64 - 20240601-160217.263
08:35:52  ZZCI - CentOS Stream 8 - robot - x86_64 - 20240601-010231.803
08:35:52  ZZCI - Ubuntu 18.04 - docker - x86_64 - 20250201-040221.796
08:35:52  ZZCI - Ubuntu 18.04 - helm - x86_64 - 20230301-140059.950
08:35:52  ZZCI - Ubuntu 20.04 - docker - x86_64 - 20250201-160239.450
08:35:52  ZZCI - Ubuntu 22.04 - builder - x86_64 - 20250201-010426.857
08:35:52  ZZCI - Ubuntu 22.04 - devstack - x86_64 - 20231031-095146.118"  # Unused
08:35:52  ZZCI - Ubuntu 22.04 - docker - x86_64 - 20250201-170115.786
08:35:52  ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 - 20250201-060151.911
08:35:54  Protected setting for ZZCI - CentOS 7 - builder - x86_64 - 20240701-060130.538: True
08:35:55  No Image found for ZZCI - CentOS 7 - devstack-rocky - x86_64 - 20221101-000109.537"  # Unused
08:35:55  Build step 'Conditional step (single)' marked build as failure
08:35:56  $ ssh-agent -k
08:35:56  unset SSH_AUTH_SOCK;
08:35:56  unset SSH_AGENT_PID;
08:35:56  echo Agent pid 5445 killed;
08:35:56  [ssh-agent] Stopped.
08:35:56  [PostBuildScript] - [INFO] Executing post build scripts.
08:35:56  [builder-openstack-cron] $ /bin/bash /tmp/jenkins8990146539019278015.sh
08:35:56  ---> sysstat.sh
08:35:56  [builder-openstack-cron] $ /bin/bash /tmp/jenkins13995880804493466967.sh
08:35:56  ---> package-listing.sh
08:35:56  ++ facter osfamily
08:35:56  ++ tr '[:upper:]' '[:lower:]'
08:35:56  + OS_FAMILY=redhat
08:35:56  + workspace=/w/workspace/builder-openstack-cron
08:35:56  + START_PACKAGES=/tmp/packages_start.txt
08:35:56  + END_PACKAGES=/tmp/packages_end.txt
08:35:56  + DIFF_PACKAGES=/tmp/packages_diff.txt
08:35:56  + PACKAGES=/tmp/packages_start.txt
08:35:56  + '[' /w/workspace/builder-openstack-cron ']'
08:35:56  + PACKAGES=/tmp/packages_end.txt
08:35:56  + case "${OS_FAMILY}" in
08:35:56  + rpm -qa
08:35:56  + sort
08:35:57  + '[' -f /tmp/packages_start.txt ']'
08:35:57  + '[' -f /tmp/packages_end.txt ']'
08:35:57  + diff /tmp/packages_start.txt /tmp/packages_end.txt
08:35:57  + '[' /w/workspace/builder-openstack-cron ']'
08:35:57  + mkdir -p /w/workspace/builder-openstack-cron/archives/
08:35:57  + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/builder-openstack-cron/archives/
08:35:57  [builder-openstack-cron] $ /bin/bash /tmp/jenkins12769439533025257249.sh
08:35:57  ---> capture-instance-metadata.sh
08:35:57  Setup pyenv:
08:35:57    system
08:35:57    3.8.13
08:35:57    3.9.13
08:35:57    3.10.13
08:35:57  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
08:35:57  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-C0nE from file:/tmp/.os_lf_venv
08:35:57  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
08:35:57  lf-activate-venv(): INFO: Attempting to install with network-safe options...
08:35:59  lf-activate-venv(): INFO: Base packages installed successfully
08:35:59  lf-activate-venv(): INFO: Installing additional packages: lftools 
08:36:09  lf-activate-venv(): INFO: Adding /tmp/venv-C0nE/bin to PATH
08:36:09  INFO: Running in OpenStack, capturing instance metadata
08:36:09  [builder-openstack-cron] $ /bin/bash /tmp/jenkins15285802980815808359.sh
08:36:09  provisioning config files...
08:36:10  Could not find credentials [logs] for builder-openstack-cron #74141
08:36:10  copy managed file [jenkins-log-archives-settings] to file:/w/workspace/builder-openstack-cron@tmp/config16361772721183165781tmp
08:36:10  Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index]
08:36:10  Run condition [Regular expression match] enabling perform for step [Provide Configuration files]
08:36:10  provisioning config files...
08:36:10  copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials
08:36:10  [EnvInject] - Injecting environment variables from a build step.
08:36:10  [EnvInject] - Injecting as environment variables the properties content 
08:36:10  SERVER_ID=logs
08:36:10  
08:36:10  [EnvInject] - Variables injected successfully.
08:36:10  [builder-openstack-cron] $ /bin/bash /tmp/jenkins3465616074421009357.sh
08:36:10  ---> create-netrc.sh
08:36:10  WARN: Log server credential not found.
08:36:10  [builder-openstack-cron] $ /bin/bash /tmp/jenkins14446633967179994814.sh
08:36:10  ---> python-tools-install.sh
08:36:10  Setup pyenv:
08:36:10    system
08:36:10    3.8.13
08:36:10    3.9.13
08:36:10    3.10.13
08:36:10  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
08:36:10  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-C0nE from file:/tmp/.os_lf_venv
08:36:10  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
08:36:10  lf-activate-venv(): INFO: Attempting to install with network-safe options...
08:36:12  lf-activate-venv(): INFO: Base packages installed successfully
08:36:12  lf-activate-venv(): INFO: Installing additional packages: lftools 
08:36:22  lf-activate-venv(): INFO: Adding /tmp/venv-C0nE/bin to PATH
08:36:22  [builder-openstack-cron] $ /bin/bash /tmp/jenkins3747052828792725598.sh
08:36:22  ---> sudo-logs.sh
08:36:22  Archiving 'sudo' log..
08:36:22  [builder-openstack-cron] $ /bin/bash /tmp/jenkins9256887638177524133.sh
08:36:22  ---> job-cost.sh
08:36:22  Setup pyenv:
08:36:23    system
08:36:23    3.8.13
08:36:23    3.9.13
08:36:23    3.10.13
08:36:23  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
08:36:23  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-C0nE from file:/tmp/.os_lf_venv
08:36:23  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
08:36:23  lf-activate-venv(): INFO: Attempting to install with network-safe options...
08:36:25  lf-activate-venv(): INFO: Base packages installed successfully
08:36:25  lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
08:36:33  lf-activate-venv(): INFO: Adding /tmp/venv-C0nE/bin to PATH
08:36:33  INFO: No Stack...
08:36:33  INFO: Retrieving Pricing Info for: v3-standard-2
08:36:33  INFO: Archiving Costs
08:36:33  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins9955641304899654180.sh
08:36:34  ---> logs-deploy.sh
08:36:34  Setup pyenv:
08:36:34    system
08:36:34    3.8.13
08:36:34    3.9.13
08:36:34    3.10.13
08:36:34  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
08:36:34  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-C0nE from file:/tmp/.os_lf_venv
08:36:34  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
08:36:34  lf-activate-venv(): INFO: Attempting to install with network-safe options...
08:36:36  lf-activate-venv(): INFO: Base packages installed successfully
08:36:36  lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 
08:36:48  lf-activate-venv(): INFO: Adding /tmp/venv-C0nE/bin to PATH
08:36:48  WARNING: Nexus logging server not set
08:36:48  INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/builder-openstack-cron/74141/
08:36:48  INFO: archiving logs to S3
08:36:49  ---> uname -a:
08:36:49  Linux prd-centos8-builder-2c-2g-84.novalocal 4.18.0-553.5.1.el8.x86_64 #1 SMP Tue May 21 05:46:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
08:36:49  
08:36:49  
08:36:49  ---> lscpu:
08:36:49  Architecture:        x86_64
08:36:49  CPU op-mode(s):      32-bit, 64-bit
08:36:49  Byte Order:          Little Endian
08:36:49  CPU(s):              2
08:36:49  On-line CPU(s) list: 0,1
08:36:49  Thread(s) per core:  1
08:36:49  Core(s) per socket:  1
08:36:49  Socket(s):           2
08:36:49  NUMA node(s):        1
08:36:49  Vendor ID:           AuthenticAMD
08:36:49  CPU family:          23
08:36:49  Model:               49
08:36:49  Model name:          AMD EPYC-Rome Processor
08:36:49  Stepping:            0
08:36:49  CPU MHz:             2799.998
08:36:49  BogoMIPS:            5599.99
08:36:49  Virtualization:      AMD-V
08:36:49  Hypervisor vendor:   KVM
08:36:49  Virtualization type: full
08:36:49  L1d cache:           32K
08:36:49  L1i cache:           32K
08:36:49  L2 cache:            512K
08:36:49  L3 cache:            16384K
08:36:49  NUMA node0 CPU(s):   0,1
08:36:49  Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
08:36:49  
08:36:49  
08:36:49  ---> nproc:
08:36:49  2
08:36:49  
08:36:49  
08:36:49  ---> df -h:
08:36:49  Filesystem      Size  Used Avail Use% Mounted on
08:36:49  devtmpfs        3.8G     0  3.8G   0% /dev
08:36:49  tmpfs           3.8G     0  3.8G   0% /dev/shm
08:36:49  tmpfs           3.8G   17M  3.8G   1% /run
08:36:49  tmpfs           3.8G     0  3.8G   0% /sys/fs/cgroup
08:36:49  /dev/vda1        40G  8.4G   32G  22% /
08:36:49  tmpfs           770M     0  770M   0% /run/user/1001
08:36:49  
08:36:49  
08:36:49  ---> free -m:
08:36:49                total        used        free      shared  buff/cache   available
08:36:49  Mem:           7697         654        4777          19        2265        6746
08:36:49  Swap:          1023           0        1023
08:36:49  
08:36:49  
08:36:49  ---> ip addr:
08:36:49  1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
08:36:49      link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
08:36:49      inet 127.0.0.1/8 scope host lo
08:36:49         valid_lft forever preferred_lft forever
08:36:49      inet6 ::1/128 scope host 
08:36:49         valid_lft forever preferred_lft forever
08:36:49  2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1458 qdisc mq state UP group default qlen 1000
08:36:49      link/ether fa:16:3e:3f:a7:d6 brd ff:ff:ff:ff:ff:ff
08:36:49      altname enp0s3
08:36:49      altname ens3
08:36:49      inet 10.30.170.28/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0
08:36:49         valid_lft 86120sec preferred_lft 86120sec
08:36:49      inet6 fe80::f816:3eff:fe3f:a7d6/64 scope link 
08:36:49         valid_lft forever preferred_lft forever
08:36:49  3: docker0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1458 qdisc noqueue state DOWN group default 
08:36:49      link/ether 02:42:c8:02:d9:c7 brd ff:ff:ff:ff:ff:ff
08:36:49      inet 10.250.0.254/24 brd 10.250.0.255 scope global docker0
08:36:49         valid_lft forever preferred_lft forever
08:36:49  
08:36:49  
08:36:49  ---> sar -b -r -n DEV:
08:36:49  Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-builder-5e6ee0fb-b6d9-4116-90d4-35c890e2b0f7.nov) 	10/02/2025 	_x86_64_	(2 CPU)
08:36:49  
08:36:49  08:32:05     LINUX RESTART	(2 CPU)
08:36:49  
08:36:49  08:33:01 AM       tps      rtps      wtps   bread/s   bwrtn/s
08:36:49  08:34:01 AM    105.68      1.82    103.87    109.56   8734.39
08:36:49  08:35:01 AM     74.78      0.70     74.08    103.43   8692.90
08:36:49  08:36:01 AM     33.37      0.13     33.24     12.80   1322.89
08:36:49  Average:        71.28      0.88     70.39     75.26   6250.06
08:36:49  
08:36:49  08:33:01 AM kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
08:36:49  08:34:01 AM   4971060   6939024   2911372     36.93      2688   2144412   1017520     11.39    203800   2362672    194836
08:36:49  08:35:01 AM   4943068   6951548   2939364     37.29      2688   2183828    985992     11.04    234308   2351812     26932
08:36:49  08:36:01 AM   4946948   6954972   2935484     37.24      2688   2183288    985900     11.04    423692   2157808      9004
08:36:49  Average:      4953692   6948515   2928740     37.16      2688   2170509    996471     11.16    287267   2290764     76924
08:36:49  
08:36:49  08:33:01 AM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
08:36:49  08:34:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
08:36:49  08:34:01 AM      eth0     89.24     78.69   1059.18     10.51      0.00      0.00      0.00      0.00
08:36:49  08:34:01 AM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
08:36:49  08:35:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
08:36:49  08:35:01 AM      eth0     63.91     52.63    601.96     10.24      0.00      0.00      0.00      0.00
08:36:49  08:35:01 AM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
08:36:49  08:36:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
08:36:49  08:36:01 AM      eth0     19.53     19.44     16.33      9.81      0.00      0.00      0.00      0.00
08:36:49  08:36:01 AM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
08:36:49  Average:           lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
08:36:49  Average:         eth0     57.56     50.26    559.16     10.19      0.00      0.00      0.00      0.00
08:36:49  Average:      docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
08:36:49  
08:36:49  
08:36:49  ---> sar -P ALL:
08:36:49  Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-builder-5e6ee0fb-b6d9-4116-90d4-35c890e2b0f7.nov) 	10/02/2025 	_x86_64_	(2 CPU)
08:36:49  
08:36:49  08:32:05     LINUX RESTART	(2 CPU)
08:36:49  
08:36:49  08:33:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
08:36:49  08:34:01 AM     all     38.54      0.00      5.52      1.58      0.10     54.26
08:36:49  08:34:01 AM       0     22.59      0.00      3.65      1.43      0.10     72.23
08:36:49  08:34:01 AM       1     54.51      0.00      7.39      1.72      0.10     36.28
08:36:49  08:35:01 AM     all     31.88      0.00      4.32      1.32      0.08     62.40
08:36:49  08:35:01 AM       0     21.85      0.00      4.12      0.92      0.08     73.03
08:36:49  08:35:01 AM       1     41.87      0.00      4.52      1.72      0.08     51.82
08:36:49  08:36:01 AM     all     35.41      0.00      3.64      0.19      0.10     60.65
08:36:49  08:36:01 AM       0     18.79      0.00      2.72      0.12      0.10     78.27
08:36:49  08:36:01 AM       1     51.99      0.00      4.55      0.27      0.10     43.09
08:36:49  Average:        all     35.28      0.00      4.49      1.03      0.09     59.10
08:36:49  Average:          0     21.08      0.00      3.50      0.82      0.09     74.51
08:36:49  Average:          1     49.46      0.00      5.49      1.23      0.09     43.73
08:36:49  
08:36:49  
08:36:49