23:32:11  Started by timer
23:32:11  Running as SYSTEM
23:32:11  [EnvInject] - Loading node environment variables.
23:32:11  Building remotely on prd-centos8-builder-2c-2g-1629 (centos8-builder-2c-2g) in workspace /w/workspace/builder-openstack-cron
23:32:11  [ssh-agent] Looking for ssh-agent implementation...
23:32:11  [ssh-agent]   Exec ssh-agent (binary ssh-agent on a remote machine)
23:32:11  $ ssh-agent
23:32:11  SSH_AUTH_SOCK=/tmp/ssh-yCUmEsh2kt1f/agent.5453
23:32:11  SSH_AGENT_PID=5454
23:32:11  [ssh-agent] Started.
23:32:11  Running ssh-add (command line suppressed)
23:32:11  Identity added: /w/workspace/builder-openstack-cron@tmp/private_key_4157078977497521273.key (/w/workspace/builder-openstack-cron@tmp/private_key_4157078977497521273.key)
23:32:11  [ssh-agent] Using credentials jenkins (jenkins-ssh)
23:32:11  The recommended git tool is: NONE
23:32:13  using credential jenkins-ssh
23:32:13  Wiping out workspace first.
23:32:13  Cloning the remote Git repository
23:32:13  Cloning repository git://devvexx.opendaylight.org/mirror/releng/builder
23:32:13   > git init /w/workspace/builder-openstack-cron # timeout=10
23:32:14  Fetching upstream changes from git://devvexx.opendaylight.org/mirror/releng/builder
23:32:14   > git --version # timeout=10
23:32:14   > git --version # 'git version 2.43.0'
23:32:14  using GIT_SSH to set credentials jenkins-ssh
23:32:14  [INFO] Currently running in a labeled security context
23:32:14  [INFO] Currently SELinux is 'enforcing' on the host
23:32:14   > /usr/bin/chcon --type=ssh_home_t /w/workspace/builder-openstack-cron@tmp/jenkins-gitclient-ssh9680702141182023360.key
23:32:14  Verifying host key using known hosts file
23:32:14  You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
23:32:14   > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/releng/builder +refs/heads/*:refs/remotes/origin/* # timeout=10
23:32:16   > git config remote.origin.url git://devvexx.opendaylight.org/mirror/releng/builder # timeout=10
23:32:16   > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
23:32:16  Avoid second fetch
23:32:16   > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
23:32:16  Checking out Revision 6cd405ccab649fcd7832ee14748bdee1c721ff40 (refs/remotes/origin/master)
23:32:16   > git config core.sparsecheckout # timeout=10
23:32:17   > git checkout -f 6cd405ccab649fcd7832ee14748bdee1c721ff40 # timeout=10
23:32:17  Commit message: "Chore: Update global-jjb to the latest v0.92.5"
23:32:17   > git rev-list --no-walk 6cd405ccab649fcd7832ee14748bdee1c721ff40 # timeout=10
23:32:17   > git remote # timeout=10
23:32:17   > git submodule init # timeout=10
23:32:17   > git submodule sync # timeout=10
23:32:17   > git config --get remote.origin.url # timeout=10
23:32:17   > git submodule init # timeout=10
23:32:17   > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10
23:32:17   > git config --get submodule.global-jjb.url # timeout=10
23:32:17   > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10
23:32:17   > git config --get submodule.packer/common-packer.url # timeout=10
23:32:17   > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10
23:32:17   > git submodule update --init --recursive global-jjb # timeout=10
23:32:18   > git submodule update --init --recursive packer/common-packer # timeout=10
23:32:22  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
23:32:22  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
23:32:22  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
23:32:22  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
23:32:22  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
23:32:22  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
23:32:22  Run condition [Boolean condition] enabling prebuild for step [BuilderChain]
23:32:22  No emails were triggered.
23:32:22  provisioning config files...
23:32:23  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
23:32:23  copy managed file [npmrc] to file:/home/jenkins/.npmrc
23:32:23  copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
23:32:23  [builder-openstack-cron] $ /bin/bash /tmp/jenkins3019550026314773488.sh
23:32:23  ---> python-tools-install.sh
23:32:23  Setup pyenv:
23:32:23    system
23:32:23  * 3.8.13 (set by /opt/pyenv/version)
23:32:23  * 3.9.13 (set by /opt/pyenv/version)
23:32:23  * 3.10.13 (set by /opt/pyenv/version)
23:32:23  * 3.11.7 (set by /opt/pyenv/version)
23:32:28  lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-EL4Q
23:32:28  lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
23:32:28  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
23:32:28  lf-activate-venv(): INFO: Attempting to install with network-safe options...
23:32:32  lf-activate-venv(): INFO: Base packages installed successfully
23:32:32  lf-activate-venv(): INFO: Installing additional packages: lftools 
23:33:00  lf-activate-venv(): INFO: Adding /tmp/venv-EL4Q/bin to PATH
23:33:00  Generating Requirements File
23:33:21  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
23:33:21  httplib2 0.31.0 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible.
23:33:21  Python 3.11.7
23:33:22  pip 25.2 from /tmp/venv-EL4Q/lib/python3.11/site-packages/pip (python 3.11)
23:33:22  appdirs==1.4.4
23:33:22  argcomplete==3.6.2
23:33:22  aspy.yaml==1.3.0
23:33:22  attrs==25.3.0
23:33:22  autopage==0.5.2
23:33:22  beautifulsoup4==4.13.5
23:33:22  boto3==1.40.40
23:33:22  botocore==1.40.40
23:33:22  bs4==0.0.2
23:33:22  cachetools==5.5.2
23:33:22  certifi==2025.8.3
23:33:22  cffi==2.0.0
23:33:22  cfgv==3.4.0
23:33:22  chardet==5.2.0
23:33:22  charset-normalizer==3.4.3
23:33:22  click==8.3.0
23:33:22  cliff==4.11.0
23:33:22  cmd2==2.7.0
23:33:22  cryptography==3.3.2
23:33:22  debtcollector==3.0.0
23:33:22  decorator==5.2.1
23:33:22  defusedxml==0.7.1
23:33:22  Deprecated==1.2.18
23:33:22  distlib==0.4.0
23:33:22  dnspython==2.8.0
23:33:22  docker==7.1.0
23:33:22  dogpile.cache==1.4.1
23:33:22  durationpy==0.10
23:33:22  email-validator==2.3.0
23:33:22  filelock==3.19.1
23:33:22  future==1.0.0
23:33:22  gitdb==4.0.12
23:33:22  GitPython==3.1.45
23:33:22  google-auth==2.40.3
23:33:22  httplib2==0.31.0
23:33:22  identify==2.6.14
23:33:22  idna==3.10
23:33:22  importlib-resources==1.5.0
23:33:22  iso8601==2.1.0
23:33:22  Jinja2==3.1.6
23:33:22  jmespath==1.0.1
23:33:22  jsonpatch==1.33
23:33:22  jsonpointer==3.0.0
23:33:22  jsonschema==4.25.1
23:33:22  jsonschema-specifications==2025.9.1
23:33:22  keystoneauth1==5.12.0
23:33:22  kubernetes==33.1.0
23:33:22  lftools==0.37.14
23:33:22  lxml==6.0.2
23:33:22  markdown-it-py==4.0.0
23:33:22  MarkupSafe==3.0.2
23:33:22  mdurl==0.1.2
23:33:22  msgpack==1.1.1
23:33:22  multi_key_dict==2.0.3
23:33:22  munch==4.0.0
23:33:22  netaddr==1.3.0
23:33:22  niet==1.4.2
23:33:22  nodeenv==1.9.1
23:33:22  oauth2client==4.1.3
23:33:22  oauthlib==3.3.1
23:33:22  openstacksdk==4.7.1
23:33:22  os-service-types==1.8.0
23:33:22  osc-lib==4.2.0
23:33:22  oslo.config==10.0.0
23:33:22  oslo.context==6.1.0
23:33:22  oslo.i18n==6.6.0
23:33:22  oslo.log==7.2.1
23:33:22  oslo.serialization==5.8.0
23:33:22  oslo.utils==9.1.0
23:33:22  packaging==25.0
23:33:22  pbr==7.0.1
23:33:22  platformdirs==4.4.0
23:33:22  prettytable==3.16.0
23:33:22  psutil==7.1.0
23:33:22  pyasn1==0.6.1
23:33:22  pyasn1_modules==0.4.2
23:33:22  pycparser==2.23
23:33:22  pygerrit2==2.0.15
23:33:22  PyGithub==2.8.1
23:33:22  Pygments==2.19.2
23:33:22  PyJWT==2.10.1
23:33:22  PyNaCl==1.6.0
23:33:22  pyparsing==2.4.7
23:33:22  pyperclip==1.11.0
23:33:22  pyrsistent==0.20.0
23:33:22  python-cinderclient==9.8.0
23:33:22  python-dateutil==2.9.0.post0
23:33:22  python-heatclient==4.3.0
23:33:22  python-jenkins==1.8.3
23:33:22  python-keystoneclient==5.7.0
23:33:22  python-magnumclient==4.9.0
23:33:22  python-openstackclient==8.2.0
23:33:22  python-swiftclient==4.8.0
23:33:22  PyYAML==6.0.3
23:33:22  referencing==0.36.2
23:33:22  requests==2.32.5
23:33:22  requests-oauthlib==2.0.0
23:33:22  requestsexceptions==1.4.0
23:33:22  rfc3986==2.0.0
23:33:22  rich==14.1.0
23:33:22  rich-argparse==1.7.1
23:33:22  rpds-py==0.27.1
23:33:22  rsa==4.9.1
23:33:22  ruamel.yaml==0.18.15
23:33:22  ruamel.yaml.clib==0.2.14
23:33:22  s3transfer==0.14.0
23:33:22  simplejson==3.20.2
23:33:22  six==1.17.0
23:33:22  smmap==5.0.2
23:33:22  soupsieve==2.8
23:33:22  stevedore==5.5.0
23:33:22  tabulate==0.9.0
23:33:22  toml==0.10.2
23:33:22  tomlkit==0.13.3
23:33:22  tqdm==4.67.1
23:33:22  typing_extensions==4.15.0
23:33:22  tzdata==2025.2
23:33:22  urllib3==1.26.20
23:33:22  virtualenv==20.34.0
23:33:22  wcwidth==0.2.14
23:33:22  websocket-client==1.8.0
23:33:22  wrapt==1.17.3
23:33:22  xdg==6.0.0
23:33:22  xmltodict==1.0.2
23:33:22  yq==3.4.3
23:33:22  [EnvInject] - Injecting environment variables from a build step.
23:33:22  [EnvInject] - Injecting as environment variables the properties content 
23:33:22  OS_CLOUD=vex
23:33:22  
23:33:22  [EnvInject] - Variables injected successfully.
23:33:22  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
23:33:22  Run condition [Boolean condition] enabling perform for step [Execute shell]
23:33:22  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins7501506025241081830.sh
23:33:22  ---> Orphaned k8s clusters
23:33:22  Setup pyenv:
23:33:22    system
23:33:22    3.8.13
23:33:22    3.9.13
23:33:22    3.10.13
23:33:22  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
23:33:23  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-EL4Q from file:/tmp/.os_lf_venv
23:33:23  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
23:33:23  lf-activate-venv(): INFO: Attempting to install with network-safe options...
23:33:25  lf-activate-venv(): INFO: Base packages installed successfully
23:33:25  lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 
23:33:32  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
23:33:32  lftools 0.37.14 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible.
23:33:33  lf-activate-venv(): INFO: Adding /tmp/venv-EL4Q/bin to PATH
23:33:35  -----> Delete orphaned cluster
23:33:35  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
23:33:35  Run condition [Boolean condition] enabling perform for step [Execute shell]
23:33:35  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins638323064254937082.sh
23:33:35  ---> Orphaned stacks
23:33:35  Setup pyenv:
23:33:35    system
23:33:35    3.8.13
23:33:35    3.9.13
23:33:35    3.10.13
23:33:35  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
23:33:36  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-EL4Q from file:/tmp/.os_lf_venv
23:33:36  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
23:33:36  lf-activate-venv(): INFO: Attempting to install with network-safe options...
23:33:38  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
23:33:38  lftools 0.37.14 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible.
23:33:38  lf-activate-venv(): INFO: Base packages installed successfully
23:33:38  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 
23:33:57  lf-activate-venv(): INFO: Adding /tmp/venv-EL4Q/bin to PATH
23:33:57  + mapfile -t OS_COE_CLUSTERS_ID
23:33:58  ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name
23:33:58  ++ awk '{print $1}'
23:33:58  ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)'
23:34:00  + echo '-----> Active clusters -> stacks'
23:34:00  -----> Active clusters -> stacks
23:34:00  + OS_COE_STACKS=()
23:34:00  + [[ 0 -gt 0 ]]
23:34:00  + mapfile -t OS_STACKS
23:34:00  ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED
23:34:00  ++ awk '{print $1}'
23:34:01  + echo '-----> Active stacks'
23:34:01  -----> Active stacks
23:34:01  + for stack in "${OS_STACKS[@]}"
23:34:01  + echo releng-openflowplugin-csit-1node-sanity-only-scandium-493
23:34:01  releng-openflowplugin-csit-1node-sanity-only-scandium-493
23:34:01  + echo '-----> Delete orphaned stacks'
23:34:01  -----> Delete orphaned stacks
23:34:01  + for STACK_NAME in "${OS_STACKS[@]}"
23:34:01  + [[ 0 -gt 0 ]]
23:34:01  + stack_in_jenkins releng-openflowplugin-csit-1node-sanity-only-scandium-493 https://jenkins.opendaylight.org/releng https://jenkins.opendaylight.org/sandbox
23:34:01  + STACK_NAME=releng-openflowplugin-csit-1node-sanity-only-scandium-493
23:34:01  + builds=()
23:34:01  + for jenkins in "${@:2}"
23:34:01  + PARAMS='tree=computer[executors[currentExecutable[url]],'
23:34:01  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]'
23:34:01  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
23:34:01  + JENKINS_URL='https://jenkins.opendaylight.org/releng/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
23:34:01  ++ curl -s -w '\n\n%{http_code}' --globoff -H Content-Type:application/json 'https://jenkins.opendaylight.org/releng/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
23:34:01  + resp='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/74012/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]}
23:34:01  
23:34:01  200'
23:34:01  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/74012/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]}
23:34:01  
23:34:01  200'
23:34:01  ++ head -n1
23:34:01  + json_data='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/74012/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]}'
23:34:01  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/74012/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]}
23:34:01  
23:34:01  200'
23:34:01  ++ awk 'END {print $NF}'
23:34:01  + status=200
23:34:01  + '[' 200 '!=' 200 ']'
23:34:01  + [[ https://jenkins.opendaylight.org/releng == *\j\e\n\k\i\n\s\.*\.\o\r\g ]]
23:34:01  + [[ https://jenkins.opendaylight.org/releng == *\j\e\n\k\i\n\s\.*\.\i\o ]]
23:34:01  ++ awk -F/ '{print $NF}'
23:34:01  ++ echo https://jenkins.opendaylight.org/releng
23:34:01  ++ sed 's/\/*$//'
23:34:01  + silo=releng
23:34:02  + export silo
23:34:02  + builds=(${builds[@]} $(echo "$json_data" |             jq -r '.computer[].executors[].currentExecutable.url'             | grep -v null | awk -F'/' '{print ENVIRON["silo"] "-" $6 "-" $7}'))
23:34:02  ++ awk -F/ '{print ENVIRON["silo"] "-" $6 "-" $7}'
23:34:02  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/74012/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]}]}'
23:34:02  ++ jq -r '.computer[].executors[].currentExecutable.url'
23:34:02  ++ grep -v null
23:34:02  + for jenkins in "${@:2}"
23:34:02  + PARAMS='tree=computer[executors[currentExecutable[url]],'
23:34:02  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]'
23:34:02  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
23:34:02  + JENKINS_URL='https://jenkins.opendaylight.org/sandbox/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
23:34:02  ++ curl -s -w '\n\n%{http_code}' --globoff -H Content-Type:application/json 'https://jenkins.opendaylight.org/sandbox/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
23:34:02  + resp='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}
23:34:02  
23:34:02  200'
23:34:02  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}
23:34:02  
23:34:02  200'
23:34:02  ++ head -n1
23:34:02  + json_data='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}'
23:34:02  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}
23:34:02  
23:34:02  200'
23:34:02  ++ awk 'END {print $NF}'
23:34:02  + status=200
23:34:02  + '[' 200 '!=' 200 ']'
23:34:02  + [[ https://jenkins.opendaylight.org/sandbox == *\j\e\n\k\i\n\s\.*\.\o\r\g ]]
23:34:02  + [[ https://jenkins.opendaylight.org/sandbox == *\j\e\n\k\i\n\s\.*\.\i\o ]]
23:34:02  ++ echo https://jenkins.opendaylight.org/sandbox
23:34:02  ++ awk -F/ '{print $NF}'
23:34:02  ++ sed 's/\/*$//'
23:34:02  + silo=sandbox
23:34:02  + export silo
23:34:02  + builds=(${builds[@]} $(echo "$json_data" |             jq -r '.computer[].executors[].currentExecutable.url'             | grep -v null | awk -F'/' '{print ENVIRON["silo"] "-" $6 "-" $7}'))
23:34:02  ++ grep -v null
23:34:02  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}'
23:34:02  ++ jq -r '.computer[].executors[].currentExecutable.url'
23:34:02  ++ awk -F/ '{print ENVIRON["silo"] "-" $6 "-" $7}'
23:34:02  + [[ releng-builder-openstack-cron-74012 releng-openflowplugin-csit-1node-sanity-only-scandium-493 releng-integration-sanity-test-scandium-498 =~ releng-openflowplugin-csit-1node-sanity-only-scandium-493 ]]
23:34:02  + return 0
23:34:02  + continue
23:34:02  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
23:34:02  Run condition [Boolean condition] enabling perform for step [Execute shell]
23:34:02  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins9670963456417843538.sh
23:34:02  ---> Orphaned servers
23:34:02  Setup pyenv:
23:34:02    system
23:34:02    3.8.13
23:34:02    3.9.13
23:34:02    3.10.13
23:34:02  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
23:34:02  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-EL4Q from file:/tmp/.os_lf_venv
23:34:02  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
23:34:02  lf-activate-venv(): INFO: Attempting to install with network-safe options...
23:34:04  lf-activate-venv(): INFO: Base packages installed successfully
23:34:04  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
23:34:19  lf-activate-venv(): INFO: Adding /tmp/venv-EL4Q/bin to PATH
23:34:25  -----> Active servers
23:34:25  prd-centos8-builder-2c-2g-1629
23:34:25  prd-ubuntu2204-docker-4c-4g-1627
23:34:25  prd-centos8-robot-2c-8g-1430
23:34:25  prd-centos8-robot-2c-8g-1429
23:34:25  prd-centos8-robot-2c-8g-773
23:34:25  prd-queue-intque-2c-1g-772
23:34:25  -----> Delete orphaned servers
23:34:26  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
23:34:26  Run condition [Boolean condition] enabling perform for step [Execute shell]
23:34:26  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins1581769317505001664.sh
23:34:26  ---> Orphaned ports
23:34:26  Setup pyenv:
23:34:26    system
23:34:26    3.8.13
23:34:26    3.9.13
23:34:26    3.10.13
23:34:26  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
23:34:26  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-EL4Q from file:/tmp/.os_lf_venv
23:34:26  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
23:34:26  lf-activate-venv(): INFO: Attempting to install with network-safe options...
23:34:28  lf-activate-venv(): INFO: Base packages installed successfully
23:34:28  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] python-openstackclient 
23:34:40  lf-activate-venv(): INFO: Adding /tmp/venv-EL4Q/bin to PATH
23:34:42  No orphaned ports to process.
23:34:42  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
23:34:42  Run condition [Boolean condition] enabling perform for step [Execute shell]
23:34:42  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins14556650475937075871.sh
23:34:42  ---> Orphaned volumes
23:34:42  + source /home/jenkins/lf-env.sh
23:34:42  + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
23:34:42  ++ mktemp -d /tmp/venv-XXXX
23:34:42  + lf_venv=/tmp/venv-8Phu
23:34:42  + local venv_file=/tmp/.os_lf_venv
23:34:42  + local python=python3
23:34:42  + local options
23:34:42  + local set_path=true
23:34:42  + local install_args=
23:34:42  ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
23:34:42  + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
23:34:42  + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
23:34:42  ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
23:34:42  + true
23:34:42  + case $1 in
23:34:42  + python=python3
23:34:42  + shift 2
23:34:42  + true
23:34:42  + case $1 in
23:34:42  + shift
23:34:42  + break
23:34:42  + case $python in
23:34:42  + local pkg_list=
23:34:42  + [[ -d /opt/pyenv ]]
23:34:42  + echo 'Setup pyenv:'
23:34:42  Setup pyenv:
23:34:42  + export PYENV_ROOT=/opt/pyenv
23:34:42  + PYENV_ROOT=/opt/pyenv
23:34:42  + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
23:34:42  + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
23:34:42  + pyenv versions
23:34:42    system
23:34:42    3.8.13
23:34:42    3.9.13
23:34:42    3.10.13
23:34:42  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
23:34:42  + command -v pyenv
23:34:42  ++ pyenv init - --no-rehash
23:34:42  + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); 
23:34:42  for i in ${!paths[@]}; do 
23:34:42  if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; 
23:34:42  fi; done; 
23:34:42  echo "${paths[*]}"'\'')"
23:34:42  export PATH="/opt/pyenv/shims:${PATH}"
23:34:42  export PYENV_SHELL=bash
23:34:42  source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\''
23:34:42  pyenv() {
23:34:42    local command
23:34:42    command="${1:-}"
23:34:42    if [ "$#" -gt 0 ]; then
23:34:42      shift
23:34:42    fi
23:34:42  
23:34:42    case "$command" in
23:34:42    rehash|shell)
23:34:42      eval "$(pyenv "sh-$command" "$@")"
23:34:42      ;;
23:34:42    *)
23:34:42      command pyenv "$command" "$@"
23:34:42      ;;
23:34:42    esac
23:34:42  }'
23:34:42  +++ bash --norc -ec 'IFS=:; paths=($PATH); 
23:34:42  for i in ${!paths[@]}; do 
23:34:42  if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; 
23:34:42  fi; done; 
23:34:42  echo "${paths[*]}"'
23:34:42  ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
23:34:42  ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
23:34:42  ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
23:34:42  ++ export PYENV_SHELL=bash
23:34:42  ++ PYENV_SHELL=bash
23:34:42  ++ source /opt/pyenv/libexec/../completions/pyenv.bash
23:34:42  +++ complete -F _pyenv pyenv
23:34:42  ++ lf-pyver python3
23:34:42  ++ local py_version_xy=python3
23:34:42  ++ local py_version_xyz=
23:34:42  ++ grep -E '^[0-9.]*[0-9]$'
23:34:42  ++ pyenv versions
23:34:42  ++ local command
23:34:42  ++ command=versions
23:34:42  ++ '[' 1 -gt 0 ']'
23:34:42  ++ shift
23:34:42  ++ case "$command" in
23:34:42  ++ command pyenv versions
23:34:42  ++ pyenv versions
23:34:42  ++ sed 's/^[ *]* //'
23:34:42  ++ awk '{ print $1 }'
23:34:42  ++ [[ ! -s /tmp/.pyenv_versions ]]
23:34:42  +++ tail -n 1
23:34:42  +++ grep '^3' /tmp/.pyenv_versions
23:34:42  +++ sort -V
23:34:42  ++ py_version_xyz=3.11.7
23:34:42  ++ [[ -z 3.11.7 ]]
23:34:42  ++ echo 3.11.7
23:34:42  ++ return 0
23:34:42  + pyenv local 3.11.7
23:34:42  + local command
23:34:42  + command=local
23:34:42  + '[' 2 -gt 0 ']'
23:34:42  + shift
23:34:42  + case "$command" in
23:34:42  + command pyenv local 3.11.7
23:34:42  + pyenv local 3.11.7
23:34:43  + for arg in "$@"
23:34:43  + case $arg in
23:34:43  + pkg_list+='lftools[openstack] '
23:34:43  + for arg in "$@"
23:34:43  + case $arg in
23:34:43  + pkg_list+='kubernetes '
23:34:43  + for arg in "$@"
23:34:43  + case $arg in
23:34:43  + pkg_list+='niet '
23:34:43  + for arg in "$@"
23:34:43  + case $arg in
23:34:43  + pkg_list+='python-heatclient '
23:34:43  + for arg in "$@"
23:34:43  + case $arg in
23:34:43  + pkg_list+='python-openstackclient '
23:34:43  + for arg in "$@"
23:34:43  + case $arg in
23:34:43  + pkg_list+='python-magnumclient '
23:34:43  + for arg in "$@"
23:34:43  + case $arg in
23:34:43  + pkg_list+='yq '
23:34:43  + [[ -f /tmp/.os_lf_venv ]]
23:34:43  ++ cat /tmp/.os_lf_venv
23:34:43  + lf_venv=/tmp/venv-EL4Q
23:34:43  + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-EL4Q from' file:/tmp/.os_lf_venv
23:34:43  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-EL4Q from file:/tmp/.os_lf_venv
23:34:43  + echo 'lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)'
23:34:43  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
23:34:43  + local 'pip_opts=--upgrade --quiet'
23:34:43  + pip_opts='--upgrade --quiet --trusted-host pypi.org'
23:34:43  + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org'
23:34:43  + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org'
23:34:43  + [[ -n '' ]]
23:34:43  + [[ -n '' ]]
23:34:43  + echo 'lf-activate-venv(): INFO: Attempting to install with network-safe options...'
23:34:43  lf-activate-venv(): INFO: Attempting to install with network-safe options...
23:34:43  + /tmp/venv-EL4Q/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org pip 'setuptools<66' virtualenv
23:34:44  + echo 'lf-activate-venv(): INFO: Base packages installed successfully'
23:34:44  lf-activate-venv(): INFO: Base packages installed successfully
23:34:44  + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq  ]]
23:34:44  + echo 'lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq '
23:34:44  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
23:34:44  + /tmp/venv-EL4Q/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
23:35:02  + type python3
23:35:02  + true
23:35:02  + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-EL4Q/bin to PATH'
23:35:02  lf-activate-venv(): INFO: Adding /tmp/venv-EL4Q/bin to PATH
23:35:02  + PATH=/tmp/venv-EL4Q/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
23:35:02  + return 0
23:35:02  + mapfile -t os_volumes
23:35:02  ++ openstack --os-cloud vex volume list -f value -c ID --status Available
23:35:05  + '[' 0 -eq 0 ']'
23:35:05  + echo 'No orphaned volumes found.'
23:35:05  No orphaned volumes found.
23:35:05  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
23:35:05  Run condition [Boolean condition] enabling perform for step [Execute shell]
23:35:05  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins11834897238102303286.sh
23:35:05  ---> Protect in-use images
23:35:05  Setup pyenv:
23:35:05    system
23:35:05    3.8.13
23:35:05    3.9.13
23:35:05    3.10.13
23:35:05  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
23:35:05  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-EL4Q from file:/tmp/.os_lf_venv
23:35:05  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
23:35:05  lf-activate-venv(): INFO: Attempting to install with network-safe options...
23:35:07  lf-activate-venv(): INFO: Base packages installed successfully
23:35:07  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient 
23:35:21  lf-activate-venv(): INFO: Adding /tmp/venv-EL4Q/bin to PATH
23:35:21  INFO: There are images to protect defined in jenkins-config.
23:35:21  INFO: There are additional images to protect in the jjb dir.
23:35:21  INFO: Protecting the following images:
23:35:21  ZZCI - CentOS 7 - builder - x86_64 - 20240701-060130.538
23:35:21  ZZCI - CentOS 7 - devstack-rocky - x86_64 - 20221101-000109.537"  # Unused
23:35:21  ZZCI - CentOS 7 - devstack-stein - x86_64 - 20221101-010107.368"  # Unused
23:35:21  ZZCI - CentOS 7 - devstack - x86_64 - 20240601-230133.464"  # Unused
23:35:21  ZZCI - CentOS 7 - docker - x86_64 - 20240601-220142.195
23:35:21  ZZCI - CentOS 7 - helm - x86_64 - 20230301-000133.034
23:35:21  ZZCI - CentOS 7 - robot - x86_64 - 20240601-220241.858
23:35:21  ZZCI - CentOS Stream 8 - builder - x86_64 - 20240601-160217.263
23:35:21  ZZCI - CentOS Stream 8 - robot - x86_64 - 20240601-010231.803
23:35:21  ZZCI - Ubuntu 18.04 - docker - x86_64 - 20250201-040221.796
23:35:21  ZZCI - Ubuntu 18.04 - helm - x86_64 - 20230301-140059.950
23:35:21  ZZCI - Ubuntu 20.04 - docker - x86_64 - 20250201-160239.450
23:35:21  ZZCI - Ubuntu 22.04 - builder - x86_64 - 20250201-010426.857
23:35:21  ZZCI - Ubuntu 22.04 - devstack - x86_64 - 20231031-095146.118"  # Unused
23:35:21  ZZCI - Ubuntu 22.04 - docker - x86_64 - 20250201-170115.786
23:35:21  ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 - 20250201-060151.911
23:35:23  Protected setting for ZZCI - CentOS 7 - builder - x86_64 - 20240701-060130.538: True
23:35:24  No Image found for ZZCI - CentOS 7 - devstack-rocky - x86_64 - 20221101-000109.537"  # Unused
23:35:24  Build step 'Conditional step (single)' marked build as failure
23:35:24  $ ssh-agent -k
23:35:24  unset SSH_AUTH_SOCK;
23:35:24  unset SSH_AGENT_PID;
23:35:24  echo Agent pid 5454 killed;
23:35:24  [ssh-agent] Stopped.
23:35:24  [PostBuildScript] - [INFO] Executing post build scripts.
23:35:24  [builder-openstack-cron] $ /bin/bash /tmp/jenkins13550336146472094695.sh
23:35:24  ---> sysstat.sh
23:35:25  [builder-openstack-cron] $ /bin/bash /tmp/jenkins4439803998733062696.sh
23:35:25  ---> package-listing.sh
23:35:25  ++ tr '[:upper:]' '[:lower:]'
23:35:25  ++ facter osfamily
23:35:25  + OS_FAMILY=redhat
23:35:25  + workspace=/w/workspace/builder-openstack-cron
23:35:25  + START_PACKAGES=/tmp/packages_start.txt
23:35:25  + END_PACKAGES=/tmp/packages_end.txt
23:35:25  + DIFF_PACKAGES=/tmp/packages_diff.txt
23:35:25  + PACKAGES=/tmp/packages_start.txt
23:35:25  + '[' /w/workspace/builder-openstack-cron ']'
23:35:25  + PACKAGES=/tmp/packages_end.txt
23:35:25  + case "${OS_FAMILY}" in
23:35:25  + sort
23:35:25  + rpm -qa
23:35:25  + '[' -f /tmp/packages_start.txt ']'
23:35:25  + '[' -f /tmp/packages_end.txt ']'
23:35:25  + diff /tmp/packages_start.txt /tmp/packages_end.txt
23:35:25  + '[' /w/workspace/builder-openstack-cron ']'
23:35:25  + mkdir -p /w/workspace/builder-openstack-cron/archives/
23:35:25  + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/builder-openstack-cron/archives/
23:35:25  [builder-openstack-cron] $ /bin/bash /tmp/jenkins15304334390818138705.sh
23:35:25  ---> capture-instance-metadata.sh
23:35:25  Setup pyenv:
23:35:26    system
23:35:26    3.8.13
23:35:26    3.9.13
23:35:26    3.10.13
23:35:26  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
23:35:26  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-EL4Q from file:/tmp/.os_lf_venv
23:35:26  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
23:35:26  lf-activate-venv(): INFO: Attempting to install with network-safe options...
23:35:28  lf-activate-venv(): INFO: Base packages installed successfully
23:35:28  lf-activate-venv(): INFO: Installing additional packages: lftools 
23:35:38  lf-activate-venv(): INFO: Adding /tmp/venv-EL4Q/bin to PATH
23:35:38  INFO: Running in OpenStack, capturing instance metadata
23:35:38  [builder-openstack-cron] $ /bin/bash /tmp/jenkins17071521062558658805.sh
23:35:38  provisioning config files...
23:35:38  Could not find credentials [logs] for builder-openstack-cron #74012
23:35:38  copy managed file [jenkins-log-archives-settings] to file:/w/workspace/builder-openstack-cron@tmp/config9216632045095242611tmp
23:35:38  Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index]
23:35:38  Run condition [Regular expression match] enabling perform for step [Provide Configuration files]
23:35:38  provisioning config files...
23:35:38  copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials
23:35:38  [EnvInject] - Injecting environment variables from a build step.
23:35:38  [EnvInject] - Injecting as environment variables the properties content 
23:35:38  SERVER_ID=logs
23:35:38  
23:35:38  [EnvInject] - Variables injected successfully.
23:35:38  [builder-openstack-cron] $ /bin/bash /tmp/jenkins10965174282623527018.sh
23:35:38  ---> create-netrc.sh
23:35:38  WARN: Log server credential not found.
23:35:38  [builder-openstack-cron] $ /bin/bash /tmp/jenkins5208806489599450512.sh
23:35:38  ---> python-tools-install.sh
23:35:38  Setup pyenv:
23:35:39    system
23:35:39    3.8.13
23:35:39    3.9.13
23:35:39    3.10.13
23:35:39  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
23:35:39  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-EL4Q from file:/tmp/.os_lf_venv
23:35:39  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
23:35:39  lf-activate-venv(): INFO: Attempting to install with network-safe options...
23:35:41  lf-activate-venv(): INFO: Base packages installed successfully
23:35:41  lf-activate-venv(): INFO: Installing additional packages: lftools 
23:35:50  lf-activate-venv(): INFO: Adding /tmp/venv-EL4Q/bin to PATH
23:35:50  [builder-openstack-cron] $ /bin/bash /tmp/jenkins5084186014791531090.sh
23:35:50  ---> sudo-logs.sh
23:35:50  Archiving 'sudo' log..
23:35:51  [builder-openstack-cron] $ /bin/bash /tmp/jenkins3197543172595317404.sh
23:35:51  ---> job-cost.sh
23:35:51  Setup pyenv:
23:35:51    system
23:35:51    3.8.13
23:35:51    3.9.13
23:35:51    3.10.13
23:35:51  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
23:35:51  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-EL4Q from file:/tmp/.os_lf_venv
23:35:51  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
23:35:51  lf-activate-venv(): INFO: Attempting to install with network-safe options...
23:35:53  lf-activate-venv(): INFO: Base packages installed successfully
23:35:53  lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
23:36:01  lf-activate-venv(): INFO: Adding /tmp/venv-EL4Q/bin to PATH
23:36:01  INFO: No Stack...
23:36:01  INFO: Retrieving Pricing Info for: v3-standard-2
23:36:02  INFO: Archiving Costs
23:36:02  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins1134072504881256622.sh
23:36:02  ---> logs-deploy.sh
23:36:02  Setup pyenv:
23:36:02    system
23:36:02    3.8.13
23:36:02    3.9.13
23:36:02    3.10.13
23:36:02  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
23:36:02  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-EL4Q from file:/tmp/.os_lf_venv
23:36:02  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
23:36:02  lf-activate-venv(): INFO: Attempting to install with network-safe options...
23:36:04  lf-activate-venv(): INFO: Base packages installed successfully
23:36:04  lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 
23:36:16  lf-activate-venv(): INFO: Adding /tmp/venv-EL4Q/bin to PATH
23:36:16  WARNING: Nexus logging server not set
23:36:16  INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/builder-openstack-cron/74012/
23:36:16  INFO: archiving logs to S3
23:36:17  ---> uname -a:
23:36:17  Linux prd-centos8-builder-2c-2g-1629.novalocal 4.18.0-553.5.1.el8.x86_64 #1 SMP Tue May 21 05:46:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
23:36:17  
23:36:17  
23:36:17  ---> lscpu:
23:36:17  Architecture:        x86_64
23:36:17  CPU op-mode(s):      32-bit, 64-bit
23:36:17  Byte Order:          Little Endian
23:36:17  CPU(s):              2
23:36:17  On-line CPU(s) list: 0,1
23:36:17  Thread(s) per core:  1
23:36:17  Core(s) per socket:  1
23:36:17  Socket(s):           2
23:36:17  NUMA node(s):        1
23:36:17  Vendor ID:           AuthenticAMD
23:36:17  CPU family:          23
23:36:17  Model:               49
23:36:17  Model name:          AMD EPYC-Rome Processor
23:36:17  Stepping:            0
23:36:17  CPU MHz:             2799.998
23:36:17  BogoMIPS:            5599.99
23:36:17  Virtualization:      AMD-V
23:36:17  Hypervisor vendor:   KVM
23:36:17  Virtualization type: full
23:36:17  L1d cache:           32K
23:36:17  L1i cache:           32K
23:36:17  L2 cache:            512K
23:36:17  L3 cache:            16384K
23:36:17  NUMA node0 CPU(s):   0,1
23:36:17  Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
23:36:17  
23:36:17  
23:36:17  ---> nproc:
23:36:17  2
23:36:17  
23:36:17  
23:36:17  ---> df -h:
23:36:17  Filesystem      Size  Used Avail Use% Mounted on
23:36:17  devtmpfs        3.8G     0  3.8G   0% /dev
23:36:17  tmpfs           3.8G     0  3.8G   0% /dev/shm
23:36:17  tmpfs           3.8G   17M  3.8G   1% /run
23:36:17  tmpfs           3.8G     0  3.8G   0% /sys/fs/cgroup
23:36:17  /dev/vda1        40G  8.4G   32G  22% /
23:36:17  tmpfs           770M     0  770M   0% /run/user/1001
23:36:17  
23:36:17  
23:36:17  ---> free -m:
23:36:17                total        used        free      shared  buff/cache   available
23:36:17  Mem:           7697         624        4804          19        2269        6776
23:36:17  Swap:          1023           0        1023
23:36:17  
23:36:17  
23:36:17  ---> ip addr:
23:36:17  1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
23:36:17      link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
23:36:17      inet 127.0.0.1/8 scope host lo
23:36:17         valid_lft forever preferred_lft forever
23:36:17      inet6 ::1/128 scope host 
23:36:17         valid_lft forever preferred_lft forever
23:36:17  2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1458 qdisc mq state UP group default qlen 1000
23:36:17      link/ether fa:16:3e:bd:17:fd brd ff:ff:ff:ff:ff:ff
23:36:17      altname enp0s3
23:36:17      altname ens3
23:36:17      inet 10.30.171.30/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0
23:36:17         valid_lft 86115sec preferred_lft 86115sec
23:36:17      inet6 fe80::f816:3eff:febd:17fd/64 scope link 
23:36:17         valid_lft forever preferred_lft forever
23:36:17  3: docker0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1458 qdisc noqueue state DOWN group default 
23:36:17      link/ether 02:42:aa:fe:91:32 brd ff:ff:ff:ff:ff:ff
23:36:17      inet 10.250.0.254/24 brd 10.250.0.255 scope global docker0
23:36:17         valid_lft forever preferred_lft forever
23:36:17  
23:36:17  
23:36:17  ---> sar -b -r -n DEV:
23:36:17  Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-builder-5e6ee0fb-b6d9-4116-90d4-35c890e2b0f7.nov) 	09/26/2025 	_x86_64_	(2 CPU)
23:36:17  
23:36:17  23:31:29     LINUX RESTART	(2 CPU)
23:36:17  
23:36:17  11:32:01 PM       tps      rtps      wtps   bread/s   bwrtn/s
23:36:17  11:33:01 PM    206.76     16.96    189.80   5470.31   7054.28
23:36:17  11:34:01 PM    117.51      0.50    117.01     64.38  12355.76
23:36:17  11:35:01 PM     36.16      0.30     35.86     42.39   1795.97
23:36:17  11:36:01 PM     27.54      0.50     27.04     63.70    767.00
23:36:17  Average:        96.99      4.57     92.43   1410.20   5493.21
23:36:17  
23:36:17  11:32:01 PM kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
23:36:17  11:33:01 PM   5182192   7022024   2700240     34.26      2688   2022448    955952     10.70    200360   2175392    167220
23:36:17  11:34:01 PM   4962604   6974136   2919828     37.04      2688   2186700    964576     10.80    229196   2334140     42944
23:36:17  11:35:01 PM   4840368   6892404   3042064     38.59      2688   2227560   1048248     11.74    272040   2414588     50516
23:36:17  11:36:01 PM   4905368   6937072   2977064     37.77      2688   2206260   1006684     11.27    427372   2192748     28776
23:36:17  Average:      4972633   6956409   2909799     36.91      2688   2160742    993865     11.13    282242   2279217     72364
23:36:17  
23:36:17  11:32:01 PM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
23:36:17  11:33:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
23:36:17  11:33:01 PM      eth0    253.10    164.03   1781.98     61.03      0.00      0.00      0.00      0.00
23:36:17  11:33:01 PM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
23:36:17  11:34:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
23:36:17  11:34:01 PM      eth0     63.11     49.77    844.77      9.31      0.00      0.00      0.00      0.00
23:36:17  11:34:01 PM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
23:36:17  11:35:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
23:36:17  11:35:01 PM      eth0     23.03     22.83     26.36      9.84      0.00      0.00      0.00      0.00
23:36:17  11:35:01 PM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
23:36:17  11:36:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
23:36:17  11:36:01 PM      eth0     21.32     20.21     19.03     10.25      0.00      0.00      0.00      0.00
23:36:17  11:36:01 PM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
23:36:17  Average:           lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
23:36:17  Average:         eth0     90.14     64.21    668.03     22.61      0.00      0.00      0.00      0.00
23:36:17  Average:      docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
23:36:17  
23:36:17  
23:36:17  ---> sar -P ALL:
23:36:17  Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-builder-5e6ee0fb-b6d9-4116-90d4-35c890e2b0f7.nov) 	09/26/2025 	_x86_64_	(2 CPU)
23:36:17  
23:36:17  23:31:29     LINUX RESTART	(2 CPU)
23:36:17  
23:36:17  11:32:01 PM     CPU     %user     %nice   %system   %iowait    %steal     %idle
23:36:17  11:33:01 PM     all     39.25      0.00      7.18      2.03      0.13     51.42
23:36:17  11:33:01 PM       0     39.15      0.00      5.71      1.00      0.13     54.00
23:36:17  11:33:01 PM       1     39.34      0.00      8.66      3.06      0.12     48.82
23:36:17  11:34:01 PM     all     34.91      0.00      5.15      1.54      0.11     58.30
23:36:17  11:34:01 PM       0     36.48      0.00      5.47      2.09      0.10     55.87
23:36:17  11:34:01 PM       1     33.35      0.00      4.83      0.98      0.12     60.72
23:36:17  11:35:01 PM     all     34.24      0.00      3.60      0.22      0.11     61.83
23:36:17  11:35:01 PM       0     28.77      0.00      3.51      0.20      0.10     67.42
23:36:17  11:35:01 PM       1     39.71      0.00      3.70      0.23      0.12     56.25
23:36:17  11:36:01 PM     all     37.85      0.00      4.60      0.13      0.11     57.30
23:36:17  11:36:01 PM       0     44.16      0.00      4.98      0.15      0.12     50.59
23:36:17  11:36:01 PM       1     31.55      0.00      4.23      0.12      0.10     64.00
23:36:17  Average:        all     36.56      0.00      5.13      0.98      0.11     57.21
23:36:17  Average:          0     37.14      0.00      4.92      0.86      0.11     56.97
23:36:17  Average:          1     35.98      0.00      5.35      1.10      0.11     57.46
23:36:17  
23:36:17  
23:36:17