23:32:09  Started by timer
23:32:09  Running as SYSTEM
23:32:09  [EnvInject] - Loading node environment variables.
23:32:09  Building remotely on prd-centos8-builder-2c-2g-947 (centos8-builder-2c-2g) in workspace /w/workspace/builder-openstack-cron
23:32:10  [ssh-agent] Looking for ssh-agent implementation...
23:32:10  [ssh-agent]   Exec ssh-agent (binary ssh-agent on a remote machine)
23:32:10  $ ssh-agent
23:32:10  SSH_AUTH_SOCK=/tmp/ssh-APQsGJ7XKbFX/agent.5442
23:32:10  SSH_AGENT_PID=5443
23:32:10  [ssh-agent] Started.
23:32:10  Running ssh-add (command line suppressed)
23:32:10  Identity added: /w/workspace/builder-openstack-cron@tmp/private_key_912055831227610343.key (/w/workspace/builder-openstack-cron@tmp/private_key_912055831227610343.key)
23:32:10  [ssh-agent] Using credentials jenkins (jenkins-ssh)
23:32:10  The recommended git tool is: NONE
23:32:12  using credential jenkins-ssh
23:32:12  Wiping out workspace first.
23:32:12  Cloning the remote Git repository
23:32:12  Cloning repository git://devvexx.opendaylight.org/mirror/releng/builder
23:32:12   > git init /w/workspace/builder-openstack-cron # timeout=10
23:32:12  Fetching upstream changes from git://devvexx.opendaylight.org/mirror/releng/builder
23:32:12   > git --version # timeout=10
23:32:12   > git --version # 'git version 2.43.0'
23:32:12  using GIT_SSH to set credentials jenkins-ssh
23:32:12  [INFO] Currently running in a labeled security context
23:32:12  [INFO] Currently SELinux is 'enforcing' on the host
23:32:12   > /usr/bin/chcon --type=ssh_home_t /w/workspace/builder-openstack-cron@tmp/jenkins-gitclient-ssh2095481000688972535.key
23:32:12  Verifying host key using known hosts file
23:32:12  You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
23:32:12   > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/releng/builder +refs/heads/*:refs/remotes/origin/* # timeout=10
23:32:15   > git config remote.origin.url git://devvexx.opendaylight.org/mirror/releng/builder # timeout=10
23:32:15   > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
23:32:15  Avoid second fetch
23:32:15   > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
23:32:15  Checking out Revision 6cd405ccab649fcd7832ee14748bdee1c721ff40 (refs/remotes/origin/master)
23:32:15   > git config core.sparsecheckout # timeout=10
23:32:15   > git checkout -f 6cd405ccab649fcd7832ee14748bdee1c721ff40 # timeout=10
23:32:16  Commit message: "Chore: Update global-jjb to the latest v0.92.5"
23:32:16   > git rev-list --no-walk 6cd405ccab649fcd7832ee14748bdee1c721ff40 # timeout=10
23:32:16   > git remote # timeout=10
23:32:16   > git submodule init # timeout=10
23:32:16   > git submodule sync # timeout=10
23:32:16   > git config --get remote.origin.url # timeout=10
23:32:16   > git submodule init # timeout=10
23:32:16   > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10
23:32:16   > git config --get submodule.global-jjb.url # timeout=10
23:32:16   > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10
23:32:16   > git config --get submodule.packer/common-packer.url # timeout=10
23:32:16   > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10
23:32:16   > git submodule update --init --recursive global-jjb # timeout=10
23:32:17   > git submodule update --init --recursive packer/common-packer # timeout=10
23:32:21  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
23:32:21  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
23:32:21  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
23:32:21  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
23:32:21  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
23:32:21  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
23:32:21  Run condition [Boolean condition] enabling prebuild for step [BuilderChain]
23:32:21  No emails were triggered.
23:32:21  provisioning config files...
23:32:21  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
23:32:21  copy managed file [npmrc] to file:/home/jenkins/.npmrc
23:32:21  copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
23:32:21  [builder-openstack-cron] $ /bin/bash /tmp/jenkins1492280156520063231.sh
23:32:21  ---> python-tools-install.sh
23:32:21  Setup pyenv:
23:32:22    system
23:32:22  * 3.8.13 (set by /opt/pyenv/version)
23:32:22  * 3.9.13 (set by /opt/pyenv/version)
23:32:22  * 3.10.13 (set by /opt/pyenv/version)
23:32:22  * 3.11.7 (set by /opt/pyenv/version)
23:32:26  lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-Cszz
23:32:26  lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
23:32:26  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
23:32:26  lf-activate-venv(): INFO: Attempting to install with network-safe options...
23:32:30  lf-activate-venv(): INFO: Base packages installed successfully
23:32:30  lf-activate-venv(): INFO: Installing additional packages: lftools 
23:32:58  lf-activate-venv(): INFO: Adding /tmp/venv-Cszz/bin to PATH
23:32:58  Generating Requirements File
23:33:19  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
23:33:19  httplib2 0.31.0 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible.
23:33:20  Python 3.11.7
23:33:20  pip 25.2 from /tmp/venv-Cszz/lib/python3.11/site-packages/pip (python 3.11)
23:33:20  appdirs==1.4.4
23:33:20  argcomplete==3.6.2
23:33:20  aspy.yaml==1.3.0
23:33:20  attrs==25.3.0
23:33:20  autopage==0.5.2
23:33:20  beautifulsoup4==4.13.5
23:33:20  boto3==1.40.38
23:33:20  botocore==1.40.38
23:33:20  bs4==0.0.2
23:33:20  cachetools==5.5.2
23:33:20  certifi==2025.8.3
23:33:20  cffi==2.0.0
23:33:20  cfgv==3.4.0
23:33:20  chardet==5.2.0
23:33:20  charset-normalizer==3.4.3
23:33:20  click==8.3.0
23:33:20  cliff==4.11.0
23:33:20  cmd2==2.7.0
23:33:20  cryptography==3.3.2
23:33:20  debtcollector==3.0.0
23:33:20  decorator==5.2.1
23:33:20  defusedxml==0.7.1
23:33:20  Deprecated==1.2.18
23:33:20  distlib==0.4.0
23:33:20  dnspython==2.8.0
23:33:20  docker==7.1.0
23:33:20  dogpile.cache==1.4.1
23:33:20  durationpy==0.10
23:33:20  email-validator==2.3.0
23:33:20  filelock==3.19.1
23:33:20  future==1.0.0
23:33:20  gitdb==4.0.12
23:33:20  GitPython==3.1.45
23:33:20  google-auth==2.40.3
23:33:20  httplib2==0.31.0
23:33:20  identify==2.6.14
23:33:20  idna==3.10
23:33:20  importlib-resources==1.5.0
23:33:20  iso8601==2.1.0
23:33:20  Jinja2==3.1.6
23:33:20  jmespath==1.0.1
23:33:20  jsonpatch==1.33
23:33:20  jsonpointer==3.0.0
23:33:20  jsonschema==4.25.1
23:33:20  jsonschema-specifications==2025.9.1
23:33:20  keystoneauth1==5.12.0
23:33:20  kubernetes==33.1.0
23:33:20  lftools==0.37.14
23:33:20  lxml==6.0.2
23:33:20  markdown-it-py==4.0.0
23:33:20  MarkupSafe==3.0.2
23:33:20  mdurl==0.1.2
23:33:20  msgpack==1.1.1
23:33:20  multi_key_dict==2.0.3
23:33:20  munch==4.0.0
23:33:20  netaddr==1.3.0
23:33:20  niet==1.4.2
23:33:20  nodeenv==1.9.1
23:33:20  oauth2client==4.1.3
23:33:20  oauthlib==3.3.1
23:33:20  openstacksdk==4.7.1
23:33:20  os-service-types==1.8.0
23:33:20  osc-lib==4.2.0
23:33:20  oslo.config==10.0.0
23:33:20  oslo.context==6.1.0
23:33:20  oslo.i18n==6.6.0
23:33:20  oslo.log==7.2.1
23:33:20  oslo.serialization==5.8.0
23:33:20  oslo.utils==9.1.0
23:33:20  packaging==25.0
23:33:20  pbr==7.0.1
23:33:20  platformdirs==4.4.0
23:33:20  prettytable==3.16.0
23:33:20  psutil==7.1.0
23:33:20  pyasn1==0.6.1
23:33:20  pyasn1_modules==0.4.2
23:33:20  pycparser==2.23
23:33:20  pygerrit2==2.0.15
23:33:20  PyGithub==2.8.1
23:33:20  Pygments==2.19.2
23:33:20  PyJWT==2.10.1
23:33:20  PyNaCl==1.6.0
23:33:20  pyparsing==2.4.7
23:33:20  pyperclip==1.10.0
23:33:20  pyrsistent==0.20.0
23:33:20  python-cinderclient==9.8.0
23:33:20  python-dateutil==2.9.0.post0
23:33:20  python-heatclient==4.3.0
23:33:20  python-jenkins==1.8.3
23:33:20  python-keystoneclient==5.7.0
23:33:20  python-magnumclient==4.9.0
23:33:20  python-openstackclient==8.2.0
23:33:20  python-swiftclient==4.8.0
23:33:20  PyYAML==6.0.2
23:33:20  referencing==0.36.2
23:33:20  requests==2.32.5
23:33:20  requests-oauthlib==2.0.0
23:33:20  requestsexceptions==1.4.0
23:33:20  rfc3986==2.0.0
23:33:20  rich==14.1.0
23:33:20  rich-argparse==1.7.1
23:33:20  rpds-py==0.27.1
23:33:20  rsa==4.9.1
23:33:20  ruamel.yaml==0.18.15
23:33:20  ruamel.yaml.clib==0.2.14
23:33:20  s3transfer==0.14.0
23:33:20  simplejson==3.20.1
23:33:20  six==1.17.0
23:33:20  smmap==5.0.2
23:33:20  soupsieve==2.8
23:33:20  stevedore==5.5.0
23:33:20  tabulate==0.9.0
23:33:20  toml==0.10.2
23:33:20  tomlkit==0.13.3
23:33:20  tqdm==4.67.1
23:33:20  typing_extensions==4.15.0
23:33:20  tzdata==2025.2
23:33:20  urllib3==1.26.20
23:33:20  virtualenv==20.34.0
23:33:20  wcwidth==0.2.14
23:33:20  websocket-client==1.8.0
23:33:20  wrapt==1.17.3
23:33:20  xdg==6.0.0
23:33:20  xmltodict==1.0.2
23:33:20  yq==3.4.3
23:33:20  [EnvInject] - Injecting environment variables from a build step.
23:33:20  [EnvInject] - Injecting as environment variables the properties content 
23:33:20  OS_CLOUD=vex
23:33:20  
23:33:20  [EnvInject] - Variables injected successfully.
23:33:20  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
23:33:20  Run condition [Boolean condition] enabling perform for step [Execute shell]
23:33:20  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins6736952645596904715.sh
23:33:20  ---> Orphaned k8s clusters
23:33:20  Setup pyenv:
23:33:20    system
23:33:20    3.8.13
23:33:20    3.9.13
23:33:20    3.10.13
23:33:20  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
23:33:21  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Cszz from file:/tmp/.os_lf_venv
23:33:21  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
23:33:21  lf-activate-venv(): INFO: Attempting to install with network-safe options...
23:33:23  lf-activate-venv(): INFO: Base packages installed successfully
23:33:23  lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 
23:33:30  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
23:33:30  lftools 0.37.14 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible.
23:33:31  lf-activate-venv(): INFO: Adding /tmp/venv-Cszz/bin to PATH
23:33:34  -----> Delete orphaned cluster
23:33:34  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
23:33:34  Run condition [Boolean condition] enabling perform for step [Execute shell]
23:33:34  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins11647224034012842031.sh
23:33:34  ---> Orphaned stacks
23:33:34  Setup pyenv:
23:33:34    system
23:33:34    3.8.13
23:33:34    3.9.13
23:33:34    3.10.13
23:33:34  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
23:33:34  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Cszz from file:/tmp/.os_lf_venv
23:33:34  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
23:33:34  lf-activate-venv(): INFO: Attempting to install with network-safe options...
23:33:36  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
23:33:36  lftools 0.37.14 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible.
23:33:36  lf-activate-venv(): INFO: Base packages installed successfully
23:33:36  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 
23:33:55  lf-activate-venv(): INFO: Adding /tmp/venv-Cszz/bin to PATH
23:33:55  + mapfile -t OS_COE_CLUSTERS_ID
23:33:55  ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)'
23:33:55  ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name
23:33:55  ++ awk '{print $1}'
23:33:58  + echo '-----> Active clusters -> stacks'
23:33:58  -----> Active clusters -> stacks
23:33:58  + OS_COE_STACKS=()
23:33:58  + [[ 0 -gt 0 ]]
23:33:58  + mapfile -t OS_STACKS
23:33:58  ++ awk '{print $1}'
23:33:58  ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED
23:33:59  + echo '-----> Active stacks'
23:33:59  -----> Active stacks
23:33:59  + for stack in "${OS_STACKS[@]}"
23:33:59  + echo releng-openflowplugin-csit-1node-sanity-only-scandium-493
23:33:59  releng-openflowplugin-csit-1node-sanity-only-scandium-493
23:33:59  + echo '-----> Delete orphaned stacks'
23:33:59  -----> Delete orphaned stacks
23:33:59  + for STACK_NAME in "${OS_STACKS[@]}"
23:33:59  + [[ 0 -gt 0 ]]
23:33:59  + stack_in_jenkins releng-openflowplugin-csit-1node-sanity-only-scandium-493 https://jenkins.opendaylight.org/releng https://jenkins.opendaylight.org/sandbox
23:33:59  + STACK_NAME=releng-openflowplugin-csit-1node-sanity-only-scandium-493
23:33:59  + builds=()
23:33:59  + for jenkins in "${@:2}"
23:33:59  + PARAMS='tree=computer[executors[currentExecutable[url]],'
23:33:59  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]'
23:33:59  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
23:33:59  + JENKINS_URL='https://jenkins.opendaylight.org/releng/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
23:33:59  ++ curl -s -w '\n\n%{http_code}' --globoff -H Content-Type:application/json 'https://jenkins.opendaylight.org/releng/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
23:33:59  + resp='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73964/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]}]}
23:33:59  
23:33:59  200'
23:33:59  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73964/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]}]}
23:33:59  
23:33:59  200'
23:33:59  ++ head -n1
23:33:59  + json_data='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73964/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]}]}'
23:33:59  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73964/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]}]}
23:33:59  
23:33:59  200'
23:33:59  ++ awk 'END {print $NF}'
23:33:59  + status=200
23:33:59  + '[' 200 '!=' 200 ']'
23:33:59  + [[ https://jenkins.opendaylight.org/releng == *\j\e\n\k\i\n\s\.*\.\o\r\g ]]
23:33:59  + [[ https://jenkins.opendaylight.org/releng == *\j\e\n\k\i\n\s\.*\.\i\o ]]
23:33:59  ++ echo https://jenkins.opendaylight.org/releng
23:33:59  ++ awk -F/ '{print $NF}'
23:33:59  ++ sed 's/\/*$//'
23:33:59  + silo=releng
23:33:59  + export silo
23:33:59  + builds=(${builds[@]} $(echo "$json_data" |             jq -r '.computer[].executors[].currentExecutable.url'             | grep -v null | awk -F'/' '{print ENVIRON["silo"] "-" $6 "-" $7}'))
23:33:59  ++ grep -v null
23:33:59  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73964/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/openflowplugin-csit-1node-sanity-only-scandium/493/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-scandium/498/"}},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null}],"oneOffExecutors":[]}]}'
23:33:59  ++ jq -r '.computer[].executors[].currentExecutable.url'
23:33:59  ++ awk -F/ '{print ENVIRON["silo"] "-" $6 "-" $7}'
23:33:59  + for jenkins in "${@:2}"
23:33:59  + PARAMS='tree=computer[executors[currentExecutable[url]],'
23:33:59  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]'
23:33:59  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
23:33:59  + JENKINS_URL='https://jenkins.opendaylight.org/sandbox/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
23:33:59  ++ curl -s -w '\n\n%{http_code}' --globoff -H Content-Type:application/json 'https://jenkins.opendaylight.org/sandbox/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
23:33:59  + resp='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}
23:33:59  
23:33:59  200'
23:33:59  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}
23:33:59  
23:33:59  200'
23:33:59  ++ head -n1
23:33:59  + json_data='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}'
23:33:59  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}
23:33:59  
23:33:59  200'
23:33:59  ++ awk 'END {print $NF}'
23:33:59  + status=200
23:33:59  + '[' 200 '!=' 200 ']'
23:33:59  + [[ https://jenkins.opendaylight.org/sandbox == *\j\e\n\k\i\n\s\.*\.\o\r\g ]]
23:33:59  + [[ https://jenkins.opendaylight.org/sandbox == *\j\e\n\k\i\n\s\.*\.\i\o ]]
23:33:59  ++ echo https://jenkins.opendaylight.org/sandbox
23:33:59  ++ sed 's/\/*$//'
23:33:59  ++ awk -F/ '{print $NF}'
23:33:59  + silo=sandbox
23:33:59  + export silo
23:33:59  + builds=(${builds[@]} $(echo "$json_data" |             jq -r '.computer[].executors[].currentExecutable.url'             | grep -v null | awk -F'/' '{print ENVIRON["silo"] "-" $6 "-" $7}'))
23:33:59  ++ grep -v null
23:33:59  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}'
23:33:59  ++ jq -r '.computer[].executors[].currentExecutable.url'
23:33:59  ++ awk -F/ '{print ENVIRON["silo"] "-" $6 "-" $7}'
23:33:59  + [[ releng-builder-openstack-cron-73964 releng-openflowplugin-csit-1node-sanity-only-scandium-493 releng-integration-sanity-test-scandium-498 =~ releng-openflowplugin-csit-1node-sanity-only-scandium-493 ]]
23:33:59  + return 0
23:33:59  + continue
23:33:59  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
23:33:59  Run condition [Boolean condition] enabling perform for step [Execute shell]
23:33:59  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins11858008316054118510.sh
23:33:59  ---> Orphaned servers
23:33:59  Setup pyenv:
23:33:59    system
23:33:59    3.8.13
23:33:59    3.9.13
23:33:59    3.10.13
23:33:59  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
23:34:00  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Cszz from file:/tmp/.os_lf_venv
23:34:00  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
23:34:00  lf-activate-venv(): INFO: Attempting to install with network-safe options...
23:34:02  lf-activate-venv(): INFO: Base packages installed successfully
23:34:02  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
23:34:16  lf-activate-venv(): INFO: Adding /tmp/venv-Cszz/bin to PATH
23:34:22  -----> Active servers
23:34:22  prd-centos8-builder-2c-2g-947
23:34:22  prd-centos8-robot-2c-8g-773
23:34:22  prd-queue-intque-2c-1g-772
23:34:22  prd-centos8-robot-2c-8g-144
23:34:22  prd-centos8-robot-2c-8g-141
23:34:22  prd-centos8-robot-2c-8g-136
23:34:22  prd-ubuntu2204-docker-8c-8g-128
23:34:22  -----> Delete orphaned servers
23:34:23  Deleting orphaned server: prd-centos8-robot-2c-8g-144
23:34:25  AttributeError: 'Server' object has no attribute 'created'. Did you mean: 'create'?
23:34:25  Deleting orphaned server: prd-centos8-robot-2c-8g-141
23:34:27  AttributeError: 'Server' object has no attribute 'created'. Did you mean: 'create'?
23:34:27  Deleting orphaned server: prd-centos8-robot-2c-8g-136
23:34:30  AttributeError: 'Server' object has no attribute 'created'. Did you mean: 'create'?
23:34:30  Deleting orphaned server: prd-ubuntu2204-docker-8c-8g-128
23:34:32  AttributeError: 'Server' object has no attribute 'created'. Did you mean: 'create'?
23:34:32  Build step 'Conditional step (single)' marked build as failure
23:34:32  $ ssh-agent -k
23:34:32  unset SSH_AUTH_SOCK;
23:34:32  unset SSH_AGENT_PID;
23:34:32  echo Agent pid 5443 killed;
23:34:32  [ssh-agent] Stopped.
23:34:32  [PostBuildScript] - [INFO] Executing post build scripts.
23:34:32  [builder-openstack-cron] $ /bin/bash /tmp/jenkins9946507262240034101.sh
23:34:32  ---> sysstat.sh
23:34:33  [builder-openstack-cron] $ /bin/bash /tmp/jenkins5271953036262563030.sh
23:34:33  ---> package-listing.sh
23:34:33  ++ facter osfamily
23:34:33  ++ tr '[:upper:]' '[:lower:]'
23:34:33  + OS_FAMILY=redhat
23:34:33  + workspace=/w/workspace/builder-openstack-cron
23:34:33  + START_PACKAGES=/tmp/packages_start.txt
23:34:33  + END_PACKAGES=/tmp/packages_end.txt
23:34:33  + DIFF_PACKAGES=/tmp/packages_diff.txt
23:34:33  + PACKAGES=/tmp/packages_start.txt
23:34:33  + '[' /w/workspace/builder-openstack-cron ']'
23:34:33  + PACKAGES=/tmp/packages_end.txt
23:34:33  + case "${OS_FAMILY}" in
23:34:33  + rpm -qa
23:34:33  + sort
23:34:33  + '[' -f /tmp/packages_start.txt ']'
23:34:33  + '[' -f /tmp/packages_end.txt ']'
23:34:33  + diff /tmp/packages_start.txt /tmp/packages_end.txt
23:34:33  + '[' /w/workspace/builder-openstack-cron ']'
23:34:33  + mkdir -p /w/workspace/builder-openstack-cron/archives/
23:34:33  + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/builder-openstack-cron/archives/
23:34:33  [builder-openstack-cron] $ /bin/bash /tmp/jenkins1863370481651877107.sh
23:34:33  ---> capture-instance-metadata.sh
23:34:33  Setup pyenv:
23:34:34    system
23:34:34    3.8.13
23:34:34    3.9.13
23:34:34    3.10.13
23:34:34  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
23:34:34  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Cszz from file:/tmp/.os_lf_venv
23:34:34  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
23:34:34  lf-activate-venv(): INFO: Attempting to install with network-safe options...
23:34:36  lf-activate-venv(): INFO: Base packages installed successfully
23:34:36  lf-activate-venv(): INFO: Installing additional packages: lftools 
23:34:45  lf-activate-venv(): INFO: Adding /tmp/venv-Cszz/bin to PATH
23:34:45  INFO: Running in OpenStack, capturing instance metadata
23:34:46  [builder-openstack-cron] $ /bin/bash /tmp/jenkins1599415114371471050.sh
23:34:46  provisioning config files...
23:34:46  Could not find credentials [logs] for builder-openstack-cron #73964
23:34:46  copy managed file [jenkins-log-archives-settings] to file:/w/workspace/builder-openstack-cron@tmp/config4934173403101904433tmp
23:34:46  Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index]
23:34:46  Run condition [Regular expression match] enabling perform for step [Provide Configuration files]
23:34:46  provisioning config files...
23:34:46  copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials
23:34:46  [EnvInject] - Injecting environment variables from a build step.
23:34:46  [EnvInject] - Injecting as environment variables the properties content 
23:34:46  SERVER_ID=logs
23:34:46  
23:34:46  [EnvInject] - Variables injected successfully.
23:34:46  [builder-openstack-cron] $ /bin/bash /tmp/jenkins9901244057042128585.sh
23:34:46  ---> create-netrc.sh
23:34:46  WARN: Log server credential not found.
23:34:46  [builder-openstack-cron] $ /bin/bash /tmp/jenkins3102809378230990333.sh
23:34:46  ---> python-tools-install.sh
23:34:46  Setup pyenv:
23:34:46    system
23:34:46    3.8.13
23:34:46    3.9.13
23:34:46    3.10.13
23:34:46  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
23:34:47  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Cszz from file:/tmp/.os_lf_venv
23:34:47  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
23:34:47  lf-activate-venv(): INFO: Attempting to install with network-safe options...
23:34:49  lf-activate-venv(): INFO: Base packages installed successfully
23:34:49  lf-activate-venv(): INFO: Installing additional packages: lftools 
23:35:02  lf-activate-venv(): INFO: Adding /tmp/venv-Cszz/bin to PATH
23:35:02  [builder-openstack-cron] $ /bin/bash /tmp/jenkins796557236393572735.sh
23:35:02  ---> sudo-logs.sh
23:35:02  Archiving 'sudo' log..
23:35:02  [builder-openstack-cron] $ /bin/bash /tmp/jenkins13755970669577594357.sh
23:35:02  ---> job-cost.sh
23:35:02  Setup pyenv:
23:35:03    system
23:35:03    3.8.13
23:35:03    3.9.13
23:35:03    3.10.13
23:35:03  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
23:35:03  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Cszz from file:/tmp/.os_lf_venv
23:35:03  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
23:35:03  lf-activate-venv(): INFO: Attempting to install with network-safe options...
23:35:05  lf-activate-venv(): INFO: Base packages installed successfully
23:35:05  lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
23:35:12  lf-activate-venv(): INFO: Adding /tmp/venv-Cszz/bin to PATH
23:35:12  INFO: No Stack...
23:35:12  INFO: Retrieving Pricing Info for: v3-standard-2
23:35:12  INFO: Archiving Costs
23:35:12  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins5457924838718010466.sh
23:35:12  ---> logs-deploy.sh
23:35:12  Setup pyenv:
23:35:12    system
23:35:12    3.8.13
23:35:12    3.9.13
23:35:12    3.10.13
23:35:12  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
23:35:13  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Cszz from file:/tmp/.os_lf_venv
23:35:13  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
23:35:13  lf-activate-venv(): INFO: Attempting to install with network-safe options...
23:35:15  lf-activate-venv(): INFO: Base packages installed successfully
23:35:15  lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 
23:35:24  lf-activate-venv(): INFO: Adding /tmp/venv-Cszz/bin to PATH
23:35:24  WARNING: Nexus logging server not set
23:35:24  INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/builder-openstack-cron/73964/
23:35:24  INFO: archiving logs to S3
23:35:25  ---> uname -a:
23:35:25  Linux prd-centos8-builder-2c-2g-947.novalocal 4.18.0-553.5.1.el8.x86_64 #1 SMP Tue May 21 05:46:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
23:35:25  
23:35:25  
23:35:25  ---> lscpu:
23:35:25  Architecture:        x86_64
23:35:25  CPU op-mode(s):      32-bit, 64-bit
23:35:25  Byte Order:          Little Endian
23:35:25  CPU(s):              2
23:35:25  On-line CPU(s) list: 0,1
23:35:25  Thread(s) per core:  1
23:35:25  Core(s) per socket:  1
23:35:25  Socket(s):           2
23:35:25  NUMA node(s):        1
23:35:25  Vendor ID:           AuthenticAMD
23:35:25  CPU family:          23
23:35:25  Model:               49
23:35:25  Model name:          AMD EPYC-Rome Processor
23:35:25  Stepping:            0
23:35:25  CPU MHz:             2799.998
23:35:25  BogoMIPS:            5599.99
23:35:25  Virtualization:      AMD-V
23:35:25  Hypervisor vendor:   KVM
23:35:25  Virtualization type: full
23:35:25  L1d cache:           32K
23:35:25  L1i cache:           32K
23:35:25  L2 cache:            512K
23:35:25  L3 cache:            16384K
23:35:25  NUMA node0 CPU(s):   0,1
23:35:25  Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
23:35:25  
23:35:25  
23:35:25  ---> nproc:
23:35:25  2
23:35:25  
23:35:25  
23:35:25  ---> df -h:
23:35:25  Filesystem      Size  Used Avail Use% Mounted on
23:35:25  devtmpfs        3.8G     0  3.8G   0% /dev
23:35:25  tmpfs           3.8G     0  3.8G   0% /dev/shm
23:35:25  tmpfs           3.8G   17M  3.8G   1% /run
23:35:25  tmpfs           3.8G     0  3.8G   0% /sys/fs/cgroup
23:35:25  /dev/vda1        40G  8.4G   32G  22% /
23:35:25  tmpfs           770M     0  770M   0% /run/user/1001
23:35:25  
23:35:25  
23:35:25  ---> free -m:
23:35:25                total        used        free      shared  buff/cache   available
23:35:25  Mem:           7697         622        4811          19        2263        6778
23:35:25  Swap:          1023           0        1023
23:35:25  
23:35:25  
23:35:25  ---> ip addr:
23:35:25  1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
23:35:25      link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
23:35:25      inet 127.0.0.1/8 scope host lo
23:35:25         valid_lft forever preferred_lft forever
23:35:25      inet6 ::1/128 scope host 
23:35:25         valid_lft forever preferred_lft forever
23:35:25  2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1458 qdisc mq state UP group default qlen 1000
23:35:25      link/ether fa:16:3e:b8:16:18 brd ff:ff:ff:ff:ff:ff
23:35:25      altname enp0s3
23:35:25      altname ens3
23:35:25      inet 10.30.171.51/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0
23:35:25         valid_lft 86167sec preferred_lft 86167sec
23:35:25      inet6 fe80::f816:3eff:feb8:1618/64 scope link 
23:35:25         valid_lft forever preferred_lft forever
23:35:25  3: docker0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1458 qdisc noqueue state DOWN group default 
23:35:25      link/ether 02:42:42:45:fd:8b brd ff:ff:ff:ff:ff:ff
23:35:25      inet 10.250.0.254/24 brd 10.250.0.255 scope global docker0
23:35:25         valid_lft forever preferred_lft forever
23:35:25  
23:35:25  
23:35:25  ---> sar -b -r -n DEV:
23:35:25  Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-builder-5e6ee0fb-b6d9-4116-90d4-35c890e2b0f7.nov) 	09/24/2025 	_x86_64_	(2 CPU)
23:35:25  
23:35:25  23:31:28     LINUX RESTART	(2 CPU)
23:35:25  
23:35:25  11:32:01 PM       tps      rtps      wtps   bread/s   bwrtn/s
23:35:25  11:33:01 PM    291.92     22.73    269.19   5734.22   8000.10
23:35:25  11:34:01 PM    113.38      0.70    112.68    103.17  12636.49
23:35:25  11:35:01 PM     30.22      0.73     29.49     67.18   1282.02
23:35:25  Average:       145.17      8.05    137.12   1968.19   7306.20
23:35:25  
23:35:25  11:32:01 PM kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
23:35:25  11:33:01 PM   5189508   7022616   2692924     34.16      2688   2016496    940896     10.54    201328   2170908    165276
23:35:25  11:34:01 PM   4982956   6991188   2899476     36.78      2688   2183548    956440     10.71    231424   2313980     29188
23:35:25  11:35:01 PM   4903876   6917488   2978556     37.79      2688   2188792   1027356     11.50    406448   2217584     15404
23:35:25  Average:      5025447   6977097   2856985     36.24      2688   2129612    974897     10.92    279733   2234157     69956
23:35:25  
23:35:25  11:32:01 PM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
23:35:25  11:33:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
23:35:25  11:33:01 PM      eth0    286.24    180.04   1802.17     62.50      0.00      0.00      0.00      0.00
23:35:25  11:33:01 PM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
23:35:25  11:34:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
23:35:25  11:34:01 PM      eth0     80.12     60.98    825.04     10.68      0.00      0.00      0.00      0.00
23:35:25  11:34:01 PM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
23:35:25  11:35:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
23:35:25  11:35:01 PM      eth0     25.04     23.18     30.23      9.46      0.00      0.00      0.00      0.00
23:35:25  11:35:01 PM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
23:35:25  Average:           lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
23:35:25  Average:         eth0    130.47     88.07    885.81     27.54      0.00      0.00      0.00      0.00
23:35:25  Average:      docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
23:35:25  
23:35:25  
23:35:25  ---> sar -P ALL:
23:35:25  Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-builder-5e6ee0fb-b6d9-4116-90d4-35c890e2b0f7.nov) 	09/24/2025 	_x86_64_	(2 CPU)
23:35:25  
23:35:25  23:31:28     LINUX RESTART	(2 CPU)
23:35:25  
23:35:25  11:32:01 PM     CPU     %user     %nice   %system   %iowait    %steal     %idle
23:35:25  11:33:01 PM     all     39.43      0.00      7.62      3.35      0.10     49.50
23:35:25  11:33:01 PM       0     31.15      0.00      5.55      0.92      0.08     62.29
23:35:25  11:33:01 PM       1     47.73      0.00      9.70      5.79      0.12     36.66
23:35:25  11:34:01 PM     all     33.04      0.00      5.05      2.69      0.10     59.12
23:35:25  11:34:01 PM       0     15.21      0.00      4.14      3.41      0.10     77.14
23:35:25  11:34:01 PM       1     50.89      0.00      5.95      1.97      0.10     41.08
23:35:25  11:35:01 PM     all     32.72      0.00      3.42      0.28      0.09     63.48
23:35:25  11:35:01 PM       0     16.15      0.00      2.94      0.38      0.08     80.44
23:35:25  11:35:01 PM       1     49.28      0.00      3.90      0.18      0.10     46.53
23:35:25  Average:        all     35.06      0.00      5.36      2.11      0.10     57.37
23:35:25  Average:          0     20.84      0.00      4.21      1.57      0.09     73.29
23:35:25  Average:          1     49.31      0.00      6.51      2.64      0.11     41.43
23:35:25  
23:35:25  
23:35:25