16:32:49  Started by timer
16:32:49  Running as SYSTEM
16:32:49  [EnvInject] - Loading node environment variables.
16:32:49  Building remotely on prd-centos8-builder-2c-2g-30385 (centos8-builder-2c-2g) in workspace /w/workspace/builder-openstack-cron
16:32:49  [ssh-agent] Looking for ssh-agent implementation...
16:32:50  [ssh-agent]   Exec ssh-agent (binary ssh-agent on a remote machine)
16:32:50  $ ssh-agent
16:32:50  SSH_AUTH_SOCK=/tmp/ssh-cn3ZwIc8Aso4/agent.5443
16:32:50  SSH_AGENT_PID=5445
16:32:50  [ssh-agent] Started.
16:32:50  Running ssh-add (command line suppressed)
16:32:50  Identity added: /w/workspace/builder-openstack-cron@tmp/private_key_5780098078413590149.key (/w/workspace/builder-openstack-cron@tmp/private_key_5780098078413590149.key)
16:32:50  [ssh-agent] Using credentials jenkins (jenkins-ssh)
16:32:50  The recommended git tool is: NONE
16:32:52  using credential jenkins-ssh
16:32:52  Wiping out workspace first.
16:32:52  Cloning the remote Git repository
16:32:52  Cloning repository git://devvexx.opendaylight.org/mirror/releng/builder
16:32:53   > git init /w/workspace/builder-openstack-cron # timeout=10
16:32:53  Fetching upstream changes from git://devvexx.opendaylight.org/mirror/releng/builder
16:32:53   > git --version # timeout=10
16:32:53   > git --version # 'git version 2.43.0'
16:32:53  using GIT_SSH to set credentials jenkins-ssh
16:32:53  [INFO] Currently running in a labeled security context
16:32:53  [INFO] Currently SELinux is 'enforcing' on the host
16:32:53   > /usr/bin/chcon --type=ssh_home_t /w/workspace/builder-openstack-cron@tmp/jenkins-gitclient-ssh10289498734666297512.key
16:32:53  Verifying host key using known hosts file
16:32:53  You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
16:32:53   > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/releng/builder +refs/heads/*:refs/remotes/origin/* # timeout=10
16:32:55   > git config remote.origin.url git://devvexx.opendaylight.org/mirror/releng/builder # timeout=10
16:32:55   > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
16:32:55  Avoid second fetch
16:32:55   > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
16:32:55  Checking out Revision fdd66ab9c49943e4d5dbff91f859ba7a9f434438 (refs/remotes/origin/master)
16:32:55   > git config core.sparsecheckout # timeout=10
16:32:55   > git checkout -f fdd66ab9c49943e4d5dbff91f859ba7a9f434438 # timeout=10
16:32:56  Commit message: "Fix distribution jobs"
16:32:56   > git rev-list --no-walk fdd66ab9c49943e4d5dbff91f859ba7a9f434438 # timeout=10
16:32:56   > git remote # timeout=10
16:32:56   > git submodule init # timeout=10
16:32:56   > git submodule sync # timeout=10
16:32:56   > git config --get remote.origin.url # timeout=10
16:32:56   > git submodule init # timeout=10
16:32:56   > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10
16:32:56   > git config --get submodule.global-jjb.url # timeout=10
16:32:56   > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10
16:32:56   > git config --get submodule.packer/common-packer.url # timeout=10
16:32:56   > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10
16:32:56   > git submodule update --init --recursive global-jjb # timeout=10
16:32:57   > git submodule update --init --recursive packer/common-packer # timeout=10
16:33:01  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
16:33:01  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
16:33:01  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
16:33:01  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
16:33:01  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
16:33:01  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
16:33:01  Run condition [Boolean condition] enabling prebuild for step [BuilderChain]
16:33:01  No emails were triggered.
16:33:01  provisioning config files...
16:33:01  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
16:33:01  copy managed file [npmrc] to file:/home/jenkins/.npmrc
16:33:01  copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
16:33:01  [builder-openstack-cron] $ /bin/bash /tmp/jenkins10781058261502342683.sh
16:33:01  ---> python-tools-install.sh
16:33:01  Setup pyenv:
16:33:01    system
16:33:01  * 3.8.13 (set by /opt/pyenv/version)
16:33:01  * 3.9.13 (set by /opt/pyenv/version)
16:33:01  * 3.10.13 (set by /opt/pyenv/version)
16:33:01  * 3.11.7 (set by /opt/pyenv/version)
16:33:06  lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-qJhh
16:33:06  lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
16:33:09  lf-activate-venv(): INFO: Installing: lftools 
16:33:39  lf-activate-venv(): INFO: Adding /tmp/venv-qJhh/bin to PATH
16:33:39  Generating Requirements File
16:34:02  Python 3.11.7
16:34:02  pip 24.2 from /tmp/venv-qJhh/lib/python3.11/site-packages/pip (python 3.11)
16:34:03  appdirs==1.4.4
16:34:03  argcomplete==3.5.0
16:34:03  aspy.yaml==1.3.0
16:34:03  attrs==24.2.0
16:34:03  autopage==0.5.2
16:34:03  beautifulsoup4==4.12.3
16:34:03  boto3==1.35.29
16:34:03  botocore==1.35.29
16:34:03  bs4==0.0.2
16:34:03  cachetools==5.5.0
16:34:03  certifi==2024.8.30
16:34:03  cffi==1.17.1
16:34:03  cfgv==3.4.0
16:34:03  chardet==5.2.0
16:34:03  charset-normalizer==3.3.2
16:34:03  click==8.1.7
16:34:03  cliff==4.7.0
16:34:03  cmd2==2.4.3
16:34:03  cryptography==3.3.2
16:34:03  debtcollector==3.0.0
16:34:03  decorator==5.1.1
16:34:03  defusedxml==0.7.1
16:34:03  Deprecated==1.2.14
16:34:03  distlib==0.3.8
16:34:03  dnspython==2.6.1
16:34:03  docker==4.2.2
16:34:03  dogpile.cache==1.3.3
16:34:03  durationpy==0.7
16:34:03  email_validator==2.2.0
16:34:03  filelock==3.16.1
16:34:03  future==1.0.0
16:34:03  gitdb==4.0.11
16:34:03  GitPython==3.1.43
16:34:03  google-auth==2.35.0
16:34:03  httplib2==0.22.0
16:34:03  identify==2.6.1
16:34:03  idna==3.10
16:34:03  importlib-resources==1.5.0
16:34:03  iso8601==2.1.0
16:34:03  Jinja2==3.1.4
16:34:03  jmespath==1.0.1
16:34:03  jsonpatch==1.33
16:34:03  jsonpointer==3.0.0
16:34:03  jsonschema==4.23.0
16:34:03  jsonschema-specifications==2023.12.1
16:34:03  keystoneauth1==5.8.0
16:34:03  kubernetes==31.0.0
16:34:03  lftools==0.37.10
16:34:03  lxml==5.3.0
16:34:03  MarkupSafe==2.1.5
16:34:03  msgpack==1.1.0
16:34:03  multi_key_dict==2.0.3
16:34:03  munch==4.0.0
16:34:03  netaddr==1.3.0
16:34:03  netifaces==0.11.0
16:34:03  niet==1.4.2
16:34:03  nodeenv==1.9.1
16:34:03  oauth2client==4.1.3
16:34:03  oauthlib==3.2.2
16:34:03  openstacksdk==4.0.0
16:34:03  os-client-config==2.1.0
16:34:03  os-service-types==1.7.0
16:34:03  osc-lib==3.1.0
16:34:03  oslo.config==9.6.0
16:34:03  oslo.context==5.6.0
16:34:03  oslo.i18n==6.4.0
16:34:03  oslo.log==6.1.2
16:34:03  oslo.serialization==5.5.0
16:34:03  oslo.utils==7.3.0
16:34:03  packaging==24.1
16:34:03  pbr==6.1.0
16:34:03  platformdirs==4.3.6
16:34:03  prettytable==3.11.0
16:34:03  pyasn1==0.6.1
16:34:03  pyasn1_modules==0.4.1
16:34:03  pycparser==2.22
16:34:03  pygerrit2==2.0.15
16:34:03  PyGithub==2.4.0
16:34:03  PyJWT==2.9.0
16:34:03  PyNaCl==1.5.0
16:34:03  pyparsing==2.4.7
16:34:03  pyperclip==1.9.0
16:34:03  pyrsistent==0.20.0
16:34:03  python-cinderclient==9.6.0
16:34:03  python-dateutil==2.9.0.post0
16:34:03  python-heatclient==4.0.0
16:34:03  python-jenkins==1.8.2
16:34:03  python-keystoneclient==5.5.0
16:34:03  python-magnumclient==4.7.0
16:34:03  python-openstackclient==7.1.2
16:34:03  python-swiftclient==4.6.0
16:34:03  PyYAML==6.0.2
16:34:03  referencing==0.35.1
16:34:03  requests==2.32.3
16:34:03  requests-oauthlib==2.0.0
16:34:03  requestsexceptions==1.4.0
16:34:03  rfc3986==2.0.0
16:34:03  rpds-py==0.20.0
16:34:03  rsa==4.9
16:34:03  ruamel.yaml==0.18.6
16:34:03  ruamel.yaml.clib==0.2.8
16:34:03  s3transfer==0.10.2
16:34:03  simplejson==3.19.3
16:34:03  six==1.16.0
16:34:03  smmap==5.0.1
16:34:03  soupsieve==2.6
16:34:03  stevedore==5.3.0
16:34:03  tabulate==0.9.0
16:34:03  toml==0.10.2
16:34:03  tomlkit==0.13.2
16:34:03  tqdm==4.66.5
16:34:03  typing_extensions==4.12.2
16:34:03  tzdata==2024.2
16:34:03  urllib3==1.26.20
16:34:03  virtualenv==20.26.6
16:34:03  wcwidth==0.2.13
16:34:03  websocket-client==1.8.0
16:34:03  wrapt==1.16.0
16:34:03  xdg==6.0.0
16:34:03  xmltodict==0.13.0
16:34:03  yq==3.4.3
16:34:03  [EnvInject] - Injecting environment variables from a build step.
16:34:03  [EnvInject] - Injecting as environment variables the properties content 
16:34:03  OS_CLOUD=vex
16:34:03  
16:34:03  [EnvInject] - Variables injected successfully.
16:34:03  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
16:34:03  Run condition [Boolean condition] enabling perform for step [Execute shell]
16:34:03  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins13738446262665894912.sh
16:34:03  ---> Orphaned k8s clusters
16:34:03  Setup pyenv:
16:34:03    system
16:34:03    3.8.13
16:34:03    3.9.13
16:34:03    3.10.13
16:34:03  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
16:34:03  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-qJhh from file:/tmp/.os_lf_venv
16:34:04  lf-activate-venv(): INFO: Installing: kubernetes python-heatclient python-openstackclient python-magnumclient 
16:34:09  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
16:34:09  lftools 0.37.10 requires urllib3<2.1.0, but you have urllib3 2.2.3 which is incompatible.
16:34:10  lf-activate-venv(): INFO: Adding /tmp/venv-qJhh/bin to PATH
16:34:12  -----> Delete orphaned cluster
16:34:12  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
16:34:12  Run condition [Boolean condition] enabling perform for step [Execute shell]
16:34:12  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins2868483641634788393.sh
16:34:12  ---> Orphaned stacks
16:34:12  Setup pyenv:
16:34:12    system
16:34:12    3.8.13
16:34:12    3.9.13
16:34:12    3.10.13
16:34:12  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
16:34:13  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-qJhh from file:/tmp/.os_lf_venv
16:34:14  lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
16:34:30  lf-activate-venv(): INFO: Adding /tmp/venv-qJhh/bin to PATH
16:34:30  + mapfile -t OS_COE_CLUSTERS_ID
16:34:30  ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name
16:34:30  ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)'
16:34:30  ++ awk '{print $1}'
16:34:32  + echo '-----> Active clusters -> stacks'
16:34:32  -----> Active clusters -> stacks
16:34:32  + OS_COE_STACKS=()
16:34:32  + [[ 0 -gt 0 ]]
16:34:32  + mapfile -t OS_STACKS
16:34:32  ++ awk '{print $1}'
16:34:32  ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED
16:34:33  + echo '-----> Active stacks'
16:34:33  -----> Active stacks
16:34:33  + for stack in "${OS_STACKS[@]}"
16:34:33  + echo releng-openflowplugin-csit-1node-perf-bulkomatic-only-potassium-400
16:34:33  releng-openflowplugin-csit-1node-perf-bulkomatic-only-potassium-400
16:34:33  + echo '-----> Delete orphaned stacks'
16:34:33  -----> Delete orphaned stacks
16:34:33  + for STACK_NAME in "${OS_STACKS[@]}"
16:34:33  + [[ 0 -gt 0 ]]
16:34:33  + stack_in_jenkins releng-openflowplugin-csit-1node-perf-bulkomatic-only-potassium-400 https://jenkins.opendaylight.org/releng https://jenkins.opendaylight.org/sandbox
16:34:33  + STACK_NAME=releng-openflowplugin-csit-1node-perf-bulkomatic-only-potassium-400
16:34:33  + builds=()
16:34:33  + for jenkins in "${@:2}"
16:34:33  + PARAMS='tree=computer[executors[currentExecutable[url]],'
16:34:33  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]'
16:34:33  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
16:34:33  + JENKINS_URL='https://jenkins.opendaylight.org/releng/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
16:34:33  ++ curl -s -w '\n\n%{http_code}' --globoff -H Content-Type:application/json 'https://jenkins.opendaylight.org/releng/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
16:34:34  + resp='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/65337/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/odlparent-maven-merge-master/3095/"}}],"oneOffExecutors":[]}]}
16:34:34  
16:34:34  200'
16:34:34  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/65337/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/odlparent-maven-merge-master/3095/"}}],"oneOffExecutors":[]}]}
16:34:34  
16:34:34  200'
16:34:34  ++ head -n1
16:34:34  + json_data='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/65337/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/odlparent-maven-merge-master/3095/"}}],"oneOffExecutors":[]}]}'
16:34:34  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/65337/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/odlparent-maven-merge-master/3095/"}}],"oneOffExecutors":[]}]}
16:34:34  
16:34:34  200'
16:34:34  ++ awk 'END {print $NF}'
16:34:34  + status=200
16:34:34  + '[' 200 '!=' 200 ']'
16:34:34  + [[ https://jenkins.opendaylight.org/releng == *\j\e\n\k\i\n\s\.*\.\o\r\g ]]
16:34:34  + [[ https://jenkins.opendaylight.org/releng == *\j\e\n\k\i\n\s\.*\.\i\o ]]
16:34:34  ++ sed 's/\/*$//'
16:34:34  ++ echo https://jenkins.opendaylight.org/releng
16:34:34  ++ awk -F/ '{print $NF}'
16:34:34  + silo=releng
16:34:34  + export silo
16:34:34  + builds=(${builds[@]} $(echo "$json_data" |             jq -r '.computer[].executors[].currentExecutable.url'             | grep -v null | awk -F'/' '{print ENVIRON["silo"] "-" $6 "-" $7}'))
16:34:34  ++ grep -v null
16:34:34  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/65337/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/odlparent-maven-merge-master/3095/"}}],"oneOffExecutors":[]}]}'
16:34:34  ++ jq -r '.computer[].executors[].currentExecutable.url'
16:34:34  ++ awk -F/ '{print ENVIRON["silo"] "-" $6 "-" $7}'
16:34:34  + for jenkins in "${@:2}"
16:34:34  + PARAMS='tree=computer[executors[currentExecutable[url]],'
16:34:34  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]'
16:34:34  + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
16:34:34  + JENKINS_URL='https://jenkins.opendaylight.org/sandbox/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
16:34:34  ++ curl -s -w '\n\n%{http_code}' --globoff -H Content-Type:application/json 'https://jenkins.opendaylight.org/sandbox/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds'
16:34:34  + resp='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}
16:34:34  
16:34:34  200'
16:34:34  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}
16:34:34  
16:34:34  200'
16:34:34  ++ head -n1
16:34:34  + json_data='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}'
16:34:34  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}
16:34:34  
16:34:34  200'
16:34:34  ++ awk 'END {print $NF}'
16:34:34  + status=200
16:34:34  + '[' 200 '!=' 200 ']'
16:34:34  + [[ https://jenkins.opendaylight.org/sandbox == *\j\e\n\k\i\n\s\.*\.\o\r\g ]]
16:34:34  + [[ https://jenkins.opendaylight.org/sandbox == *\j\e\n\k\i\n\s\.*\.\i\o ]]
16:34:34  ++ echo https://jenkins.opendaylight.org/sandbox
16:34:34  ++ sed 's/\/*$//'
16:34:34  ++ awk -F/ '{print $NF}'
16:34:34  + silo=sandbox
16:34:34  + export silo
16:34:34  + builds=(${builds[@]} $(echo "$json_data" |             jq -r '.computer[].executors[].currentExecutable.url'             | grep -v null | awk -F'/' '{print ENVIRON["silo"] "-" $6 "-" $7}'))
16:34:34  ++ jq -r '.computer[].executors[].currentExecutable.url'
16:34:34  ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}'
16:34:34  ++ awk -F/ '{print ENVIRON["silo"] "-" $6 "-" $7}'
16:34:34  ++ grep -v null
16:34:34  + [[ releng-builder-openstack-cron-65337 releng-odlparent-maven-merge-master-3095 =~ releng-openflowplugin-csit-1node-perf-bulkomatic-only-potassium-400 ]]
16:34:34  + return 1
16:34:34  + echo 'Deleting orphaned stack: releng-openflowplugin-csit-1node-perf-bulkomatic-only-potassium-400'
16:34:34  Deleting orphaned stack: releng-openflowplugin-csit-1node-perf-bulkomatic-only-potassium-400
16:34:34  + lftools openstack --os-cloud vex stack delete --force releng-openflowplugin-csit-1node-perf-bulkomatic-only-potassium-400
16:43:01  Build timed out (after 10 minutes). Marking the build as failed.
16:43:01  $ ssh-agent -k
16:43:01  unset SSH_AUTH_SOCK;
16:43:01  unset SSH_AGENT_PID;
16:43:01  echo Agent pid 5445 killed;
16:43:01  /tmp/jenkins2868483641634788393.sh: line 129:  7087 Terminated              lftools openstack --os-cloud "${os_cloud}" stack delete --force "${STACK_NAME}"
16:43:01  [ssh-agent] Stopped.
16:43:01  Build was aborted
16:43:01  [PostBuildScript] - [INFO] Executing post build scripts.
16:43:01  [builder-openstack-cron] $ /bin/bash /tmp/jenkins17391180691737181643.sh
16:43:01  ---> sysstat.sh
16:43:01  [builder-openstack-cron] $ /bin/bash /tmp/jenkins6122229500583068992.sh
16:43:01  ---> package-listing.sh
16:43:01  ++ facter osfamily
16:43:01  ++ tr '[:upper:]' '[:lower:]'
16:43:01  + OS_FAMILY=redhat
16:43:01  + workspace=/w/workspace/builder-openstack-cron
16:43:01  + START_PACKAGES=/tmp/packages_start.txt
16:43:01  + END_PACKAGES=/tmp/packages_end.txt
16:43:01  + DIFF_PACKAGES=/tmp/packages_diff.txt
16:43:01  + PACKAGES=/tmp/packages_start.txt
16:43:01  + '[' /w/workspace/builder-openstack-cron ']'
16:43:01  + PACKAGES=/tmp/packages_end.txt
16:43:01  + case "${OS_FAMILY}" in
16:43:01  + rpm -qa
16:43:01  + sort
16:43:02  + '[' -f /tmp/packages_start.txt ']'
16:43:02  + '[' -f /tmp/packages_end.txt ']'
16:43:02  + diff /tmp/packages_start.txt /tmp/packages_end.txt
16:43:02  + '[' /w/workspace/builder-openstack-cron ']'
16:43:02  + mkdir -p /w/workspace/builder-openstack-cron/archives/
16:43:02  + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/builder-openstack-cron/archives/
16:43:02  [builder-openstack-cron] $ /bin/bash /tmp/jenkins6561086718814616422.sh
16:43:02  ---> capture-instance-metadata.sh
16:43:02  Setup pyenv:
16:43:02    system
16:43:02    3.8.13
16:43:02    3.9.13
16:43:02    3.10.13
16:43:02  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
16:43:03  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-qJhh from file:/tmp/.os_lf_venv
16:43:03  lf-activate-venv(): INFO: Installing: lftools 
16:43:14  lf-activate-venv(): INFO: Adding /tmp/venv-qJhh/bin to PATH
16:43:14  INFO: Running in OpenStack, capturing instance metadata
16:43:15  [builder-openstack-cron] $ /bin/bash /tmp/jenkins10570840448316051165.sh
16:43:15  provisioning config files...
16:43:15  Could not find credentials [logs] for builder-openstack-cron #65337
16:43:15  copy managed file [jenkins-log-archives-settings] to file:/w/workspace/builder-openstack-cron@tmp/config7491508954704136149tmp
16:43:15  Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index]
16:43:15  Run condition [Regular expression match] enabling perform for step [Provide Configuration files]
16:43:15  provisioning config files...
16:43:15  copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials
16:43:15  [EnvInject] - Injecting environment variables from a build step.
16:43:15  [EnvInject] - Injecting as environment variables the properties content 
16:43:15  SERVER_ID=logs
16:43:15  
16:43:15  [EnvInject] - Variables injected successfully.
16:43:15  [builder-openstack-cron] $ /bin/bash /tmp/jenkins7840199422457000416.sh
16:43:15  ---> create-netrc.sh
16:43:15  WARN: Log server credential not found.
16:43:15  [builder-openstack-cron] $ /bin/bash /tmp/jenkins10432227821727522197.sh
16:43:15  ---> python-tools-install.sh
16:43:15  Setup pyenv:
16:43:16    system
16:43:16    3.8.13
16:43:16    3.9.13
16:43:16    3.10.13
16:43:16  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
16:43:16  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-qJhh from file:/tmp/.os_lf_venv
16:43:17  lf-activate-venv(): INFO: Installing: lftools 
16:43:25  lf-activate-venv(): INFO: Adding /tmp/venv-qJhh/bin to PATH
16:43:25  [builder-openstack-cron] $ /bin/bash /tmp/jenkins14660546447127226331.sh
16:43:25  ---> sudo-logs.sh
16:43:25  Archiving 'sudo' log..
16:43:25  [builder-openstack-cron] $ /bin/bash /tmp/jenkins8841965107194666265.sh
16:43:25  ---> job-cost.sh
16:43:25  Setup pyenv:
16:43:26    system
16:43:26    3.8.13
16:43:26    3.9.13
16:43:26    3.10.13
16:43:26  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
16:43:26  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-qJhh from file:/tmp/.os_lf_venv
16:43:27  lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
16:43:32  lf-activate-venv(): INFO: Adding /tmp/venv-qJhh/bin to PATH
16:43:32  INFO: No Stack...
16:43:33  INFO: Retrieving Pricing Info for: v3-standard-2
16:43:33  INFO: Archiving Costs
16:43:33  [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins403733143315138462.sh
16:43:33  ---> logs-deploy.sh
16:43:33  Setup pyenv:
16:43:33    system
16:43:33    3.8.13
16:43:33    3.9.13
16:43:33    3.10.13
16:43:33  * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version)
16:43:33  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-qJhh from file:/tmp/.os_lf_venv
16:43:34  lf-activate-venv(): INFO: Installing: lftools 
16:43:43  lf-activate-venv(): INFO: Adding /tmp/venv-qJhh/bin to PATH
16:43:43  WARNING: Nexus logging server not set
16:43:43  INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/builder-openstack-cron/65337/
16:43:43  INFO: archiving logs to S3
16:43:44  ---> uname -a:
16:43:44  Linux prd-centos8-builder-2c-2g-30385.novalocal 4.18.0-553.5.1.el8.x86_64 #1 SMP Tue May 21 05:46:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
16:43:44  
16:43:44  
16:43:44  ---> lscpu:
16:43:44  Architecture:        x86_64
16:43:44  CPU op-mode(s):      32-bit, 64-bit
16:43:44  Byte Order:          Little Endian
16:43:44  CPU(s):              2
16:43:44  On-line CPU(s) list: 0,1
16:43:44  Thread(s) per core:  1
16:43:44  Core(s) per socket:  1
16:43:44  Socket(s):           2
16:43:44  NUMA node(s):        1
16:43:44  Vendor ID:           AuthenticAMD
16:43:44  CPU family:          23
16:43:44  Model:               49
16:43:44  Model name:          AMD EPYC-Rome Processor
16:43:44  Stepping:            0
16:43:44  CPU MHz:             2800.000
16:43:44  BogoMIPS:            5600.00
16:43:44  Virtualization:      AMD-V
16:43:44  Hypervisor vendor:   KVM
16:43:44  Virtualization type: full
16:43:44  L1d cache:           32K
16:43:44  L1i cache:           32K
16:43:44  L2 cache:            512K
16:43:44  L3 cache:            16384K
16:43:44  NUMA node0 CPU(s):   0,1
16:43:44  Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
16:43:44  
16:43:44  
16:43:44  ---> nproc:
16:43:44  2
16:43:44  
16:43:44  
16:43:44  ---> df -h:
16:43:44  Filesystem      Size  Used Avail Use% Mounted on
16:43:44  devtmpfs        3.8G     0  3.8G   0% /dev
16:43:44  tmpfs           3.8G     0  3.8G   0% /dev/shm
16:43:44  tmpfs           3.8G   17M  3.8G   1% /run
16:43:44  tmpfs           3.8G     0  3.8G   0% /sys/fs/cgroup
16:43:44  /dev/vda1        40G  8.4G   32G  21% /
16:43:44  tmpfs           770M     0  770M   0% /run/user/1001
16:43:44  
16:43:44  
16:43:44  ---> free -m:
16:43:44                total        used        free      shared  buff/cache   available
16:43:44  Mem:           7697         623        4822          19        2251        6779
16:43:44  Swap:          1023           0        1023
16:43:44  
16:43:44  
16:43:44  ---> ip addr:
16:43:44  1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
16:43:44      link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
16:43:44      inet 127.0.0.1/8 scope host lo
16:43:44         valid_lft forever preferred_lft forever
16:43:44      inet6 ::1/128 scope host 
16:43:44         valid_lft forever preferred_lft forever
16:43:44  2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1458 qdisc mq state UP group default qlen 1000
16:43:44      link/ether fa:16:3e:e8:0a:fd brd ff:ff:ff:ff:ff:ff
16:43:44      altname enp0s3
16:43:44      altname ens3
16:43:44      inet 10.30.171.112/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0
16:43:44         valid_lft 85704sec preferred_lft 85704sec
16:43:44      inet6 fe80::f816:3eff:fee8:afd/64 scope link 
16:43:44         valid_lft forever preferred_lft forever
16:43:44  3: docker0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1458 qdisc noqueue state DOWN group default 
16:43:44      link/ether 02:42:f7:3b:80:5b brd ff:ff:ff:ff:ff:ff
16:43:44      inet 10.250.0.254/24 brd 10.250.0.255 scope global docker0
16:43:44         valid_lft forever preferred_lft forever
16:43:44  
16:43:44  
16:43:44  ---> sar -b -r -n DEV:
16:43:44  Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-builder-5e6ee0fb-b6d9-4116-90d4-35c890e2b0f7.nov) 	09/29/2024 	_x86_64_	(2 CPU)
16:43:44  
16:43:44  16:32:02     LINUX RESTART	(2 CPU)
16:43:44  
16:43:44  04:33:02 PM       tps      rtps      wtps   bread/s   bwrtn/s
16:43:44  04:34:01 PM     96.80     11.56     85.24   1893.37   6704.61
16:43:44  04:35:01 PM     73.28      0.87     72.41     87.97   8982.32
16:43:44  04:36:01 PM      8.23      0.03      8.20      0.53    751.47
16:43:44  04:37:01 PM      0.40      0.00      0.40      0.00      6.67
16:43:44  04:38:01 PM      0.23      0.00      0.23      0.00      3.07
16:43:44  04:39:01 PM      0.53      0.00      0.53      0.00      7.75
16:43:44  04:40:01 PM      0.30      0.00      0.30      0.00      3.15
16:43:44  04:41:01 PM      0.40      0.00      0.40      0.00      4.72
16:43:44  04:42:01 PM      0.30      0.00      0.30      0.00      3.02
16:43:44  04:43:01 PM      0.52      0.00      0.52      0.00      6.56
16:43:44  Average:        17.97      1.23     16.74    195.34   1638.92
16:43:44  
16:43:44  04:33:02 PM kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
16:43:44  04:34:01 PM   4977884   6957416   2904548     36.85      2688   2157548    997380     11.17    234684   2331004    235028
16:43:44  04:35:01 PM   4955524   6953224   2926908     37.13      2688   2175204    975880     10.93    251744   2327980     17104
16:43:44  04:36:01 PM   4954864   6952584   2927568     37.14      2688   2175224    975880     10.93    251760   2327852        12
16:43:44  04:37:01 PM   4953856   6951576   2928576     37.15      2688   2175224    975880     10.93    251760   2329188         4
16:43:44  04:38:01 PM   4954600   6952324   2927832     37.14      2688   2175228    975880     10.93    251760   2328248         4
16:43:44  04:39:01 PM   4954964   6952688   2927468     37.14      2688   2175228    975880     10.93    251760   2328192         4
16:43:44  04:40:01 PM   4954656   6952380   2927776     37.14      2688   2175228    999252     11.19    251760   2328432         4
16:43:44  04:41:01 PM   4954548   6952316   2927884     37.14      2688   2175232    999252     11.19    251760   2328460         4
16:43:44  04:42:01 PM   4954704   6952472   2927728     37.14      2688   2175232    999252     11.19    251760   2328576         4
16:43:44  04:43:01 PM   5036964   7034736   2845468     36.10      2688   2175236    944044     10.57    251992   2247052         8
16:43:44  Average:      4965256   6961172   2917176     37.01      2688   2173458    981858     10.99    250074   2320498     25218
16:43:44  
16:43:44  04:33:02 PM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
16:43:44  04:34:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:43:44  04:34:01 PM      eth0     88.09     70.73    960.21      8.35      0.00      0.00      0.00      0.00
16:43:44  04:34:01 PM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:43:44  04:35:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:43:44  04:35:01 PM      eth0     40.90     35.40    387.43      9.01      0.00      0.00      0.00      0.00
16:43:44  04:35:01 PM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:43:44  04:36:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:43:44  04:36:01 PM      eth0      0.55      0.45      0.34      0.15      0.00      0.00      0.00      0.00
16:43:44  04:36:01 PM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:43:44  04:37:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:43:44  04:37:01 PM      eth0      0.55      0.40      0.34      0.15      0.00      0.00      0.00      0.00
16:43:44  04:37:01 PM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:43:44  04:38:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:43:44  04:38:01 PM      eth0      0.67      0.50      0.47      0.21      0.00      0.00      0.00      0.00
16:43:44  04:38:01 PM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:43:44  04:39:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:43:44  04:39:01 PM      eth0      0.48      0.38      0.34      0.14      0.00      0.00      0.00      0.00
16:43:44  04:39:01 PM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:43:44  04:40:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:43:44  04:40:01 PM      eth0      0.57      0.40      0.34      0.15      0.00      0.00      0.00      0.00
16:43:44  04:40:01 PM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:43:44  04:41:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:43:44  04:41:01 PM      eth0      0.55      0.40      0.34      0.14      0.00      0.00      0.00      0.00
16:43:44  04:41:01 PM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:43:44  04:42:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:43:44  04:42:01 PM      eth0      0.67      0.38      0.35      0.14      0.00      0.00      0.00      0.00
16:43:44  04:42:01 PM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:43:44  04:43:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:43:44  04:43:01 PM      eth0      2.88      1.87      2.38      1.11      0.00      0.00      0.00      0.00
16:43:44  04:43:01 PM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:43:44  Average:           lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:43:44  Average:         eth0     13.47     10.99    133.87      1.94      0.00      0.00      0.00      0.00
16:43:44  Average:      docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:43:44  
16:43:44  
16:43:44  ---> sar -P ALL:
16:43:44  Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-builder-5e6ee0fb-b6d9-4116-90d4-35c890e2b0f7.nov) 	09/29/2024 	_x86_64_	(2 CPU)
16:43:44  
16:43:44  16:32:02     LINUX RESTART	(2 CPU)
16:43:44  
16:43:44  04:33:02 PM     CPU     %user     %nice   %system   %iowait    %steal     %idle
16:43:44  04:34:01 PM     all     36.22      0.00      5.79      2.67      0.10     55.22
16:43:44  04:34:01 PM       0     34.93      0.00      5.38      2.27      0.08     57.33
16:43:44  04:34:01 PM       1     37.50      0.00      6.20      3.07      0.12     53.12
16:43:44  04:35:01 PM     all     19.18      0.00      2.84      2.67      0.07     75.24
16:43:44  04:35:01 PM       0     21.32      0.00      2.69      1.54      0.08     74.36
16:43:44  04:35:01 PM       1     17.04      0.00      2.99      3.81      0.05     76.12
16:43:44  04:36:01 PM     all      0.35      0.00      0.13      0.23      0.03     99.25
16:43:44  04:36:01 PM       0      0.10      0.00      0.20      0.32      0.03     99.35
16:43:44  04:36:01 PM       1      0.60      0.00      0.07      0.15      0.03     99.15
16:43:44  04:37:01 PM     all      0.40      0.00      0.08      0.00      0.03     99.50
16:43:44  04:37:01 PM       0      0.62      0.00      0.05      0.00      0.03     99.30
16:43:44  04:37:01 PM       1      0.18      0.00      0.10      0.00      0.02     99.70
16:43:44  04:38:01 PM     all      0.43      0.00      0.08      0.01      0.04     99.44
16:43:44  04:38:01 PM       0      0.68      0.00      0.07      0.00      0.03     99.22
16:43:44  04:38:01 PM       1      0.18      0.00      0.08      0.02      0.05     99.67
16:43:44  04:39:01 PM     all      0.39      0.00      0.06      0.00      0.03     99.52
16:43:44  04:39:01 PM       0      0.52      0.00      0.07      0.00      0.03     99.38
16:43:44  04:39:01 PM       1      0.27      0.00      0.05      0.00      0.03     99.65
16:43:44  04:40:01 PM     all      0.40      0.00      0.05      0.00      0.03     99.52
16:43:44  04:40:01 PM       0      0.23      0.00      0.05      0.00      0.03     99.68
16:43:44  04:40:01 PM       1      0.57      0.00      0.05      0.00      0.02     99.37
16:43:44  04:41:01 PM     all      0.39      0.00      0.08      0.00      0.03     99.51
16:43:44  04:41:01 PM       0      0.18      0.00      0.07      0.00      0.02     99.73
16:43:44  04:41:01 PM       1      0.60      0.00      0.08      0.00      0.03     99.28
16:43:44  04:42:01 PM     all      0.38      0.00      0.06      0.00      0.03     99.53
16:43:44  04:42:01 PM       0      0.20      0.00      0.07      0.00      0.02     99.72
16:43:44  04:42:01 PM       1      0.55      0.00      0.05      0.00      0.05     99.35
16:43:44  04:43:01 PM     all      0.58      0.00      0.10      0.01      0.03     99.29
16:43:44  04:43:01 PM       0      0.30      0.00      0.10      0.02      0.02     99.57
16:43:44  04:43:01 PM       1      0.85      0.00      0.10      0.00      0.03     99.02
16:43:44  Average:        all      5.83      0.00      0.92      0.56      0.04     92.66
16:43:44  Average:          0      5.87      0.00      0.87      0.41      0.04     92.82
16:43:44  Average:          1      5.79      0.00      0.97      0.70      0.04     92.50
16:43:44  
16:43:44  
16:43:44