19:32:03 Started by timer 19:32:03 Running as SYSTEM 19:32:03 [EnvInject] - Loading node environment variables. 19:32:03 Building remotely on prd-centos8-builder-2c-2g-233 (centos8-builder-2c-2g) in workspace /w/workspace/builder-openstack-cron 19:32:03 [ssh-agent] Looking for ssh-agent implementation... 19:32:03 [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) 19:32:03 $ ssh-agent 19:32:03 SSH_AUTH_SOCK=/tmp/ssh-sEYtb5A2VAUe/agent.5456 19:32:03 SSH_AGENT_PID=5457 19:32:03 [ssh-agent] Started. 19:32:03 Running ssh-add (command line suppressed) 19:32:03 Identity added: /w/workspace/builder-openstack-cron@tmp/private_key_14407111925988595011.key (/w/workspace/builder-openstack-cron@tmp/private_key_14407111925988595011.key) 19:32:03 [ssh-agent] Using credentials jenkins (jenkins-ssh) 19:32:03 The recommended git tool is: NONE 19:32:06 using credential jenkins-ssh 19:32:06 Wiping out workspace first. 19:32:06 Cloning the remote Git repository 19:32:06 Cloning repository git://devvexx.opendaylight.org/mirror/releng/builder 19:32:06 > git init /w/workspace/builder-openstack-cron # timeout=10 19:32:06 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/releng/builder 19:32:06 > git --version # timeout=10 19:32:06 > git --version # 'git version 2.43.0' 19:32:06 using GIT_SSH to set credentials jenkins-ssh 19:32:06 [INFO] Currently running in a labeled security context 19:32:06 [INFO] Currently SELinux is 'enforcing' on the host 19:32:06 > /usr/bin/chcon --type=ssh_home_t /w/workspace/builder-openstack-cron@tmp/jenkins-gitclient-ssh5586235301981792152.key 19:32:06 Verifying host key using known hosts file 19:32:06 You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. 19:32:06 > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/releng/builder +refs/heads/*:refs/remotes/origin/* # timeout=10 19:32:09 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/releng/builder # timeout=10 19:32:09 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 19:32:09 Avoid second fetch 19:32:09 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 19:32:09 Checking out Revision a5d11b00150c642e82ebe62ca03f192a76c9c5e5 (refs/remotes/origin/master) 19:32:09 > git config core.sparsecheckout # timeout=10 19:32:09 > git checkout -f a5d11b00150c642e82ebe62ca03f192a76c9c5e5 # timeout=10 19:32:09 Commit message: "CI: Update gerrit-change-info to older revision" 19:32:09 > git rev-list --no-walk a5d11b00150c642e82ebe62ca03f192a76c9c5e5 # timeout=10 19:32:09 > git remote # timeout=10 19:32:09 > git submodule init # timeout=10 19:32:09 > git submodule sync # timeout=10 19:32:10 > git config --get remote.origin.url # timeout=10 19:32:10 > git submodule init # timeout=10 19:32:10 > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10 19:32:10 > git config --get submodule.global-jjb.url # timeout=10 19:32:10 > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10 19:32:10 > git config --get submodule.packer/common-packer.url # timeout=10 19:32:10 > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10 19:32:10 > git submodule update --init --recursive global-jjb # timeout=10 19:32:11 > git submodule update --init --recursive packer/common-packer # timeout=10 19:32:15 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 19:32:15 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 19:32:15 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 19:32:15 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 19:32:15 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 19:32:15 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 19:32:15 Run condition [Boolean condition] enabling prebuild for step [BuilderChain] 19:32:15 No emails were triggered. 19:32:15 provisioning config files... 19:32:15 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml 19:32:15 copy managed file [npmrc] to file:/home/jenkins/.npmrc 19:32:15 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 19:32:15 [builder-openstack-cron] $ /bin/bash /tmp/jenkins17518704143717315633.sh 19:32:15 ---> python-tools-install.sh 19:32:15 Setup pyenv: 19:32:15 system 19:32:15 * 3.8.13 (set by /opt/pyenv/version) 19:32:15 * 3.9.13 (set by /opt/pyenv/version) 19:32:15 * 3.10.13 (set by /opt/pyenv/version) 19:32:15 * 3.11.7 (set by /opt/pyenv/version) 19:32:20 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-8RuE 19:32:20 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 19:32:24 lf-activate-venv(): INFO: Installing: lftools 19:32:51 lf-activate-venv(): INFO: Adding /tmp/venv-8RuE/bin to PATH 19:32:51 Generating Requirements File 19:33:12 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 19:33:12 httplib2 0.31.0 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible. 19:33:12 Python 3.11.7 19:33:12 pip 25.2 from /tmp/venv-8RuE/lib/python3.11/site-packages/pip (python 3.11) 19:33:13 appdirs==1.4.4 19:33:13 argcomplete==3.6.2 19:33:13 aspy.yaml==1.3.0 19:33:13 attrs==25.3.0 19:33:13 autopage==0.5.2 19:33:13 beautifulsoup4==4.13.5 19:33:13 boto3==1.40.34 19:33:13 botocore==1.40.34 19:33:13 bs4==0.0.2 19:33:13 cachetools==5.5.2 19:33:13 certifi==2025.8.3 19:33:13 cffi==2.0.0 19:33:13 cfgv==3.4.0 19:33:13 chardet==5.2.0 19:33:13 charset-normalizer==3.4.3 19:33:13 click==8.3.0 19:33:13 cliff==4.11.0 19:33:13 cmd2==2.7.0 19:33:13 cryptography==3.3.2 19:33:13 debtcollector==3.0.0 19:33:13 decorator==5.2.1 19:33:13 defusedxml==0.7.1 19:33:13 Deprecated==1.2.18 19:33:13 distlib==0.4.0 19:33:13 dnspython==2.8.0 19:33:13 docker==7.1.0 19:33:13 dogpile.cache==1.4.1 19:33:13 durationpy==0.10 19:33:13 email-validator==2.3.0 19:33:13 filelock==3.19.1 19:33:13 future==1.0.0 19:33:13 gitdb==4.0.12 19:33:13 GitPython==3.1.45 19:33:13 google-auth==2.40.3 19:33:13 httplib2==0.31.0 19:33:13 identify==2.6.14 19:33:13 idna==3.10 19:33:13 importlib-resources==1.5.0 19:33:13 iso8601==2.1.0 19:33:13 Jinja2==3.1.6 19:33:13 jmespath==1.0.1 19:33:13 jsonpatch==1.33 19:33:13 jsonpointer==3.0.0 19:33:13 jsonschema==4.25.1 19:33:13 jsonschema-specifications==2025.9.1 19:33:13 keystoneauth1==5.12.0 19:33:13 kubernetes==33.1.0 19:33:13 lftools==0.37.13 19:33:13 lxml==6.0.1 19:33:13 markdown-it-py==4.0.0 19:33:13 MarkupSafe==3.0.2 19:33:13 mdurl==0.1.2 19:33:13 msgpack==1.1.1 19:33:13 multi_key_dict==2.0.3 19:33:13 munch==4.0.0 19:33:13 netaddr==1.3.0 19:33:13 niet==1.4.2 19:33:13 nodeenv==1.9.1 19:33:13 oauth2client==4.1.3 19:33:13 oauthlib==3.3.1 19:33:13 openstacksdk==4.7.1 19:33:13 os-service-types==1.8.0 19:33:13 osc-lib==4.2.0 19:33:13 oslo.config==10.0.0 19:33:13 oslo.context==6.1.0 19:33:13 oslo.i18n==6.6.0 19:33:13 oslo.log==7.2.1 19:33:13 oslo.serialization==5.8.0 19:33:13 oslo.utils==9.1.0 19:33:13 packaging==25.0 19:33:13 pbr==7.0.1 19:33:13 platformdirs==4.4.0 19:33:13 prettytable==3.16.0 19:33:13 psutil==7.1.0 19:33:13 pyasn1==0.6.1 19:33:13 pyasn1_modules==0.4.2 19:33:13 pycparser==2.23 19:33:13 pygerrit2==2.0.15 19:33:13 PyGithub==2.8.1 19:33:13 Pygments==2.19.2 19:33:13 PyJWT==2.10.1 19:33:13 PyNaCl==1.6.0 19:33:13 pyparsing==2.4.7 19:33:13 pyperclip==1.10.0 19:33:13 pyrsistent==0.20.0 19:33:13 python-cinderclient==9.8.0 19:33:13 python-dateutil==2.9.0.post0 19:33:13 python-heatclient==4.3.0 19:33:13 python-jenkins==1.8.3 19:33:13 python-keystoneclient==5.7.0 19:33:13 python-magnumclient==4.9.0 19:33:13 python-openstackclient==8.2.0 19:33:13 python-swiftclient==4.8.0 19:33:13 PyYAML==6.0.2 19:33:13 referencing==0.36.2 19:33:13 requests==2.32.5 19:33:13 requests-oauthlib==2.0.0 19:33:13 requestsexceptions==1.4.0 19:33:13 rfc3986==2.0.0 19:33:13 rich==14.1.0 19:33:13 rich-argparse==1.7.1 19:33:13 rpds-py==0.27.1 19:33:13 rsa==4.9.1 19:33:13 ruamel.yaml==0.18.15 19:33:13 ruamel.yaml.clib==0.2.12 19:33:13 s3transfer==0.14.0 19:33:13 simplejson==3.20.1 19:33:13 six==1.17.0 19:33:13 smmap==5.0.2 19:33:13 soupsieve==2.8 19:33:13 stevedore==5.5.0 19:33:13 tabulate==0.9.0 19:33:13 toml==0.10.2 19:33:13 tomlkit==0.13.3 19:33:13 tqdm==4.67.1 19:33:13 typing_extensions==4.15.0 19:33:13 tzdata==2025.2 19:33:13 urllib3==1.26.20 19:33:13 virtualenv==20.34.0 19:33:13 wcwidth==0.2.13 19:33:13 websocket-client==1.8.0 19:33:13 wrapt==1.17.3 19:33:13 xdg==6.0.0 19:33:13 xmltodict==1.0.2 19:33:13 yq==3.4.3 19:33:13 [EnvInject] - Injecting environment variables from a build step. 19:33:13 [EnvInject] - Injecting as environment variables the properties content 19:33:13 OS_CLOUD=vex 19:33:13 19:33:13 [EnvInject] - Variables injected successfully. 19:33:13 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 19:33:13 Run condition [Boolean condition] enabling perform for step [Execute shell] 19:33:13 [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins5006397672960260460.sh 19:33:13 ---> Orphaned k8s clusters 19:33:13 Setup pyenv: 19:33:13 system 19:33:13 3.8.13 19:33:13 3.9.13 19:33:13 3.10.13 19:33:13 * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version) 19:33:13 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-8RuE from file:/tmp/.os_lf_venv 19:33:15 lf-activate-venv(): INFO: Installing: kubernetes python-heatclient python-openstackclient python-magnumclient 19:33:22 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 19:33:22 lftools 0.37.13 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible. 19:33:22 lf-activate-venv(): INFO: Adding /tmp/venv-8RuE/bin to PATH 19:33:25 -----> Delete orphaned cluster 19:33:25 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 19:33:25 Run condition [Boolean condition] enabling perform for step [Execute shell] 19:33:25 [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins540951332558784982.sh 19:33:25 ---> Orphaned stacks 19:33:25 Setup pyenv: 19:33:25 system 19:33:25 3.8.13 19:33:25 3.9.13 19:33:25 3.10.13 19:33:25 * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version) 19:33:26 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-8RuE from file:/tmp/.os_lf_venv 19:33:27 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 19:33:27 lftools 0.37.13 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible. 19:33:27 lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 19:33:45 lf-activate-venv(): INFO: Adding /tmp/venv-8RuE/bin to PATH 19:33:45 + mapfile -t OS_COE_CLUSTERS_ID 19:33:45 ++ awk '{print $1}' 19:33:45 ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name 19:33:45 ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)' 19:33:47 + echo '-----> Active clusters -> stacks' 19:33:47 -----> Active clusters -> stacks 19:33:47 + OS_COE_STACKS=() 19:33:47 + [[ 0 -gt 0 ]] 19:33:47 + mapfile -t OS_STACKS 19:33:47 ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED 19:33:47 ++ awk '{print $1}' 19:33:49 + echo '-----> Active stacks' 19:33:49 -----> Active stacks 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-ovsdb-csit-3node-upstream-clustering-only-scandium-392 19:33:49 releng-ovsdb-csit-3node-upstream-clustering-only-scandium-392 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-ovsdb-csit-1node-upstream-southbound-all-scandium-393 19:33:49 releng-ovsdb-csit-1node-upstream-southbound-all-scandium-393 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-ovsdb-csit-3node-upstream-clustering-only-scandium-391 19:33:49 releng-ovsdb-csit-3node-upstream-clustering-only-scandium-391 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-ovsdb-csit-1node-upstream-southbound-all-scandium-392 19:33:49 releng-ovsdb-csit-1node-upstream-southbound-all-scandium-392 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-3node-clustering-bulkomatic-only-scandium-392 19:33:49 releng-openflowplugin-csit-3node-clustering-bulkomatic-only-scandium-392 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-1node-flow-services-all-scandium-391 19:33:49 releng-openflowplugin-csit-1node-flow-services-all-scandium-391 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-1node-scale-link-only-scandium-391 19:33:49 releng-openflowplugin-csit-1node-scale-link-only-scandium-391 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-1node-perf-stats-collection-only-scandium-391 19:33:49 releng-openflowplugin-csit-1node-perf-stats-collection-only-scandium-391 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-1node-perf-bulkomatic-only-scandium-391 19:33:49 releng-openflowplugin-csit-1node-perf-bulkomatic-only-scandium-391 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-1node-scale-switch-only-scandium-391 19:33:49 releng-openflowplugin-csit-1node-scale-switch-only-scandium-391 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-jsonrpc-csit-1node-basic-only-scandium-392 19:33:49 releng-jsonrpc-csit-1node-basic-only-scandium-392 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-daexim-csit-3node-clustering-basic-only-scandium-392 19:33:49 releng-daexim-csit-3node-clustering-basic-only-scandium-392 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-bgpcep-csit-1node-bgp-ingest-mixed-all-scandium-395 19:33:49 releng-bgpcep-csit-1node-bgp-ingest-mixed-all-scandium-395 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-bgpcep-csit-1node-bgp-ingest-all-scandium-391 19:33:49 releng-bgpcep-csit-1node-bgp-ingest-all-scandium-391 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-ovsdb-csit-3node-upstream-clustering-only-titanium-418 19:33:49 releng-ovsdb-csit-3node-upstream-clustering-only-titanium-418 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-ovsdb-csit-1node-upstream-southbound-all-titanium-418 19:33:49 releng-ovsdb-csit-1node-upstream-southbound-all-titanium-418 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-3node-clustering-perf-bulkomatic-only-titanium-418 19:33:49 releng-openflowplugin-csit-3node-clustering-perf-bulkomatic-only-titanium-418 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-3node-clustering-only-titanium-418 19:33:49 releng-openflowplugin-csit-3node-clustering-only-titanium-418 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-3node-clustering-bulkomatic-only-titanium-418 19:33:49 releng-openflowplugin-csit-3node-clustering-bulkomatic-only-titanium-418 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-1node-scale-only-titanium-418 19:33:49 releng-openflowplugin-csit-1node-scale-only-titanium-418 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-jsonrpc-csit-1node-basic-only-titanium-418 19:33:49 releng-jsonrpc-csit-1node-basic-only-titanium-418 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-1node-perf-stats-collection-only-titanium-419 19:33:49 releng-openflowplugin-csit-1node-perf-stats-collection-only-titanium-419 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-1node-flow-services-all-titanium-418 19:33:49 releng-openflowplugin-csit-1node-flow-services-all-titanium-418 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-1node-cbench-only-titanium-418 19:33:49 releng-openflowplugin-csit-1node-cbench-only-titanium-418 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-daexim-csit-3node-clustering-basic-only-titanium-418 19:33:49 releng-daexim-csit-3node-clustering-basic-only-titanium-418 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-daexim-csit-1node-basic-only-titanium-418 19:33:49 releng-daexim-csit-1node-basic-only-titanium-418 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-bgpcep-csit-1node-throughpcep-all-titanium-418 19:33:49 releng-bgpcep-csit-1node-throughpcep-all-titanium-418 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-bgpcep-csit-1node-bgp-ingest-all-titanium-418 19:33:49 releng-bgpcep-csit-1node-bgp-ingest-all-titanium-418 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-ovsdb-csit-3node-upstream-clustering-only-titanium-417 19:33:49 releng-ovsdb-csit-3node-upstream-clustering-only-titanium-417 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-ovsdb-csit-1node-upstream-southbound-all-titanium-417 19:33:49 releng-ovsdb-csit-1node-upstream-southbound-all-titanium-417 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-3node-clustering-perf-bulkomatic-only-titanium-417 19:33:49 releng-openflowplugin-csit-3node-clustering-perf-bulkomatic-only-titanium-417 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-3node-clustering-only-titanium-417 19:33:49 releng-openflowplugin-csit-3node-clustering-only-titanium-417 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-3node-clustering-bulkomatic-only-titanium-417 19:33:49 releng-openflowplugin-csit-3node-clustering-bulkomatic-only-titanium-417 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-1node-scale-switch-only-titanium-417 19:33:49 releng-openflowplugin-csit-1node-scale-switch-only-titanium-417 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-1node-perf-stats-collection-only-titanium-418 19:33:49 releng-openflowplugin-csit-1node-perf-stats-collection-only-titanium-418 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-1node-cbench-only-titanium-417 19:33:49 releng-openflowplugin-csit-1node-cbench-only-titanium-417 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-1node-perf-bulkomatic-only-titanium-417 19:33:49 releng-openflowplugin-csit-1node-perf-bulkomatic-only-titanium-417 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-1node-scale-link-only-titanium-417 19:33:49 releng-openflowplugin-csit-1node-scale-link-only-titanium-417 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-daexim-csit-3node-clustering-basic-only-titanium-417 19:33:49 releng-daexim-csit-3node-clustering-basic-only-titanium-417 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-daexim-csit-1node-basic-only-titanium-417 19:33:49 releng-daexim-csit-1node-basic-only-titanium-417 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-bgpcep-csit-1node-userfeatures-all-titanium-417 19:33:49 releng-bgpcep-csit-1node-userfeatures-all-titanium-417 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-bgpcep-csit-1node-bgp-ingest-mixed-all-titanium-417 19:33:49 releng-bgpcep-csit-1node-bgp-ingest-mixed-all-titanium-417 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-ovsdb-csit-3node-upstream-clustering-only-scandium-390 19:33:49 releng-ovsdb-csit-3node-upstream-clustering-only-scandium-390 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-ovsdb-csit-3node-upstream-clustering-only-scandium-389 19:33:49 releng-ovsdb-csit-3node-upstream-clustering-only-scandium-389 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-ovsdb-csit-1node-upstream-southbound-all-scandium-389 19:33:49 releng-ovsdb-csit-1node-upstream-southbound-all-scandium-389 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-ovsdb-csit-1node-upstream-southbound-all-scandium-388 19:33:49 releng-ovsdb-csit-1node-upstream-southbound-all-scandium-388 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-1node-perf-bulkomatic-only-scandium-390 19:33:49 releng-openflowplugin-csit-1node-perf-bulkomatic-only-scandium-390 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-daexim-csit-1node-basic-only-scandium-391 19:33:49 releng-daexim-csit-1node-basic-only-scandium-391 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-bgpcep-csit-1node-userfeatures-all-scandium-391 19:33:49 releng-bgpcep-csit-1node-userfeatures-all-scandium-391 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-3node-clustering-bulkomatic-only-scandium-391 19:33:49 releng-openflowplugin-csit-3node-clustering-bulkomatic-only-scandium-391 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-1node-flow-services-all-scandium-390 19:33:49 releng-openflowplugin-csit-1node-flow-services-all-scandium-390 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-1node-cbench-only-scandium-391 19:33:49 releng-openflowplugin-csit-1node-cbench-only-scandium-391 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-daexim-csit-3node-clustering-basic-only-scandium-391 19:33:49 releng-daexim-csit-3node-clustering-basic-only-scandium-391 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-bgpcep-csit-1node-bgp-ingest-mixed-all-scandium-394 19:33:49 releng-bgpcep-csit-1node-bgp-ingest-mixed-all-scandium-394 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-bgpcep-csit-1node-bgp-ingest-all-scandium-390 19:33:49 releng-bgpcep-csit-1node-bgp-ingest-all-scandium-390 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-ovsdb-csit-3node-upstream-clustering-only-scandium-387 19:33:49 releng-ovsdb-csit-3node-upstream-clustering-only-scandium-387 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-3node-clustering-bulkomatic-only-scandium-390 19:33:49 releng-openflowplugin-csit-3node-clustering-bulkomatic-only-scandium-390 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-1node-scale-link-only-scandium-389 19:33:49 releng-openflowplugin-csit-1node-scale-link-only-scandium-389 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-1node-perf-bulkomatic-only-scandium-389 19:33:49 releng-openflowplugin-csit-1node-perf-bulkomatic-only-scandium-389 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-1node-flow-services-all-scandium-389 19:33:49 releng-openflowplugin-csit-1node-flow-services-all-scandium-389 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-daexim-csit-1node-basic-only-scandium-390 19:33:49 releng-daexim-csit-1node-basic-only-scandium-390 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-bgpcep-csit-1node-throughpcep-all-scandium-390 19:33:49 releng-bgpcep-csit-1node-throughpcep-all-scandium-390 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-ovsdb-csit-3node-upstream-clustering-only-titanium-416 19:33:49 releng-ovsdb-csit-3node-upstream-clustering-only-titanium-416 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-3node-clustering-only-titanium-416 19:33:49 releng-openflowplugin-csit-3node-clustering-only-titanium-416 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-1node-scale-only-titanium-416 19:33:49 releng-openflowplugin-csit-1node-scale-only-titanium-416 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-1node-flow-services-all-titanium-416 19:33:49 releng-openflowplugin-csit-1node-flow-services-all-titanium-416 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-1node-scale-link-only-titanium-416 19:33:49 releng-openflowplugin-csit-1node-scale-link-only-titanium-416 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-1node-perf-bulkomatic-only-titanium-416 19:33:49 releng-openflowplugin-csit-1node-perf-bulkomatic-only-titanium-416 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-jsonrpc-csit-1node-basic-only-titanium-416 19:33:49 releng-jsonrpc-csit-1node-basic-only-titanium-416 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-1node-perf-stats-collection-only-titanium-416 19:33:49 releng-openflowplugin-csit-1node-perf-stats-collection-only-titanium-416 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-3node-clustering-only-titanium-415 19:33:49 releng-openflowplugin-csit-3node-clustering-only-titanium-415 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-openflowplugin-csit-3node-clustering-bulkomatic-only-titanium-415 19:33:49 releng-openflowplugin-csit-3node-clustering-bulkomatic-only-titanium-415 19:33:49 + for stack in "${OS_STACKS[@]}" 19:33:49 + echo releng-bgpcep-csit-1node-userfeatures-all-titanium-415 19:33:49 releng-bgpcep-csit-1node-userfeatures-all-titanium-415 19:33:49 + echo '-----> Delete orphaned stacks' 19:33:49 -----> Delete orphaned stacks 19:33:49 + for STACK_NAME in "${OS_STACKS[@]}" 19:33:49 + [[ 0 -gt 0 ]] 19:33:49 + stack_in_jenkins releng-ovsdb-csit-3node-upstream-clustering-only-scandium-392 https://jenkins.opendaylight.org/releng https://jenkins.opendaylight.org/sandbox 19:33:49 + STACK_NAME=releng-ovsdb-csit-3node-upstream-clustering-only-scandium-392 19:33:49 + builds=() 19:33:49 + for jenkins in "${@:2}" 19:33:49 + PARAMS='tree=computer[executors[currentExecutable[url]],' 19:33:49 + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]' 19:33:49 + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 19:33:49 + JENKINS_URL='https://jenkins.opendaylight.org/releng/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 19:33:49 ++ curl -s -w '\n\n%{http_code}' --globoff -H Content-Type:application/json 'https://jenkins.opendaylight.org/releng/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 19:33:49 + resp='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73840/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/netconf-maven-merge-master/4576/"}}],"oneOffExecutors":[]}]} 19:33:49 19:33:49 200' 19:33:49 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73840/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/netconf-maven-merge-master/4576/"}}],"oneOffExecutors":[]}]} 19:33:49 19:33:49 200' 19:33:49 ++ head -n1 19:33:49 + json_data='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73840/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/netconf-maven-merge-master/4576/"}}],"oneOffExecutors":[]}]}' 19:33:49 ++ awk 'END {print $NF}' 19:33:49 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73840/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/netconf-maven-merge-master/4576/"}}],"oneOffExecutors":[]}]} 19:33:49 19:33:49 200' 19:33:49 + status=200 19:33:49 + '[' 200 '!=' 200 ']' 19:33:49 + [[ https://jenkins.opendaylight.org/releng == *\j\e\n\k\i\n\s\.*\.\o\r\g ]] 19:33:49 + [[ https://jenkins.opendaylight.org/releng == *\j\e\n\k\i\n\s\.*\.\i\o ]] 19:33:49 ++ sed 's/\/*$//' 19:33:49 ++ awk -F/ '{print $NF}' 19:33:49 ++ echo https://jenkins.opendaylight.org/releng 19:33:49 + silo=releng 19:33:49 + export silo 19:33:49 + builds=(${builds[@]} $(echo "$json_data" | jq -r '.computer[].executors[].currentExecutable.url' | grep -v null | awk -F'/' '{print ENVIRON["silo"] "-" $6 "-" $7}')) 19:33:49 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73840/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/netconf-maven-merge-master/4576/"}}],"oneOffExecutors":[]}]}' 19:33:49 ++ awk -F/ '{print ENVIRON["silo"] "-" $6 "-" $7}' 19:33:49 ++ grep -v null 19:33:49 ++ jq -r '.computer[].executors[].currentExecutable.url' 19:33:49 + for jenkins in "${@:2}" 19:33:49 + PARAMS='tree=computer[executors[currentExecutable[url]],' 19:33:49 + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]' 19:33:49 + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 19:33:49 + JENKINS_URL='https://jenkins.opendaylight.org/sandbox/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 19:33:49 ++ curl -s -w '\n\n%{http_code}' --globoff -H Content-Type:application/json 'https://jenkins.opendaylight.org/sandbox/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 19:33:49 + resp='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]} 19:33:49 19:33:49 200' 19:33:49 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]} 19:33:49 19:33:49 200' 19:33:49 ++ head -n1 19:33:49 + json_data='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}' 19:33:49 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]} 19:33:49 19:33:49 200' 19:33:49 ++ awk 'END {print $NF}' 19:33:49 + status=200 19:33:49 + '[' 200 '!=' 200 ']' 19:33:49 + [[ https://jenkins.opendaylight.org/sandbox == *\j\e\n\k\i\n\s\.*\.\o\r\g ]] 19:33:49 + [[ https://jenkins.opendaylight.org/sandbox == *\j\e\n\k\i\n\s\.*\.\i\o ]] 19:33:49 ++ echo https://jenkins.opendaylight.org/sandbox 19:33:49 ++ awk -F/ '{print $NF}' 19:33:49 ++ sed 's/\/*$//' 19:33:49 + silo=sandbox 19:33:49 + export silo 19:33:49 + builds=(${builds[@]} $(echo "$json_data" | jq -r '.computer[].executors[].currentExecutable.url' | grep -v null | awk -F'/' '{print ENVIRON["silo"] "-" $6 "-" $7}')) 19:33:49 ++ grep -v null 19:33:49 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}' 19:33:49 ++ jq -r '.computer[].executors[].currentExecutable.url' 19:33:49 ++ awk -F/ '{print ENVIRON["silo"] "-" $6 "-" $7}' 19:33:49 + [[ releng-builder-openstack-cron-73840 releng-netconf-maven-merge-master-4576 =~ releng-ovsdb-csit-3node-upstream-clustering-only-scandium-392 ]] 19:33:49 + return 1 19:33:49 + echo 'Deleting orphaned stack: releng-ovsdb-csit-3node-upstream-clustering-only-scandium-392' 19:33:49 Deleting orphaned stack: releng-ovsdb-csit-3node-upstream-clustering-only-scandium-392 19:33:49 + lftools openstack --os-cloud vex stack delete --force releng-ovsdb-csit-3node-upstream-clustering-only-scandium-392 19:34:40 Deleting stack releng-ovsdb-csit-3node-upstream-clustering-only-scandium-392 19:34:40 WARNING: Failure: Unable to establish connection to https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-ovsdb-csit-3node-upstream-clustering-only-scandium-392/482b98e4-7cf2-4ac7-8f30-e35f461671bb?resolve_outputs=False: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')). Retrying in 0.5s. 1 retries left 19:35:31 WARNING: Failure: Unable to establish connection to https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-ovsdb-csit-3node-upstream-clustering-only-scandium-392/482b98e4-7cf2-4ac7-8f30-e35f461671bb: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')). Retrying in 0.5s. 1 retries left 19:36:32 WARNING: Failure: Unable to establish connection to https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-ovsdb-csit-3node-upstream-clustering-only-scandium-392/482b98e4-7cf2-4ac7-8f30-e35f461671bb: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')). Retrying in 0.5s. 1 retries left 19:37:32 Waiting for stack to delete... 19:37:32 WARNING: Failure: Unable to establish connection to https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-ovsdb-csit-3node-upstream-clustering-only-scandium-392: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')). Retrying in 0.5s. 1 retries left 19:38:23 WARN: Failed to delete $STACK_NAME. Reason: Resource DELETE failed: MessagingTimeout: resources.vm_0_group: Timed out waiting for a reply to message ID ad6c68ca54ec4a7688d0a01cd1cdbbc9 19:38:23 Retrying delete... 19:38:23 WARNING: Failure: Unable to establish connection to https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-ovsdb-csit-3node-upstream-clustering-only-scandium-392?resolve_outputs=False: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')). Retrying in 0.5s. 1 retries left 19:39:14 http.client.RemoteDisconnected: Remote end closed connection without response 19:39:14 19:39:14 During handling of the above exception, another exception occurred: 19:39:14 19:39:14 urllib3.exceptions.ProtocolError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) 19:39:14 19:39:14 During handling of the above exception, another exception occurred: 19:39:14 19:39:14 requests.exceptions.ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) 19:39:14 19:39:14 During handling of the above exception, another exception occurred: 19:39:14 19:39:14 keystoneauth1.exceptions.connection.ConnectFailure: Unable to establish connection to https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-ovsdb-csit-3node-upstream-clustering-only-scandium-392?resolve_outputs=False: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) 19:39:14 19:39:14 During handling of the above exception, another exception occurred: 19:39:14 19:39:14 http.client.RemoteDisconnected: Remote end closed connection without response 19:39:14 19:39:14 During handling of the above exception, another exception occurred: 19:39:14 19:39:14 urllib3.exceptions.ProtocolError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) 19:39:14 19:39:14 During handling of the above exception, another exception occurred: 19:39:14 19:39:14 requests.exceptions.ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) 19:39:14 19:39:14 During handling of the above exception, another exception occurred: 19:39:14 19:39:14 keystoneauth1.exceptions.connection.ConnectFailure: Unable to establish connection to https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-ovsdb-csit-3node-upstream-clustering-only-scandium-392/482b98e4-7cf2-4ac7-8f30-e35f461671bb?resolve_outputs=False: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) 19:39:14 + for STACK_NAME in "${OS_STACKS[@]}" 19:39:14 + [[ 0 -gt 0 ]] 19:39:14 + stack_in_jenkins releng-ovsdb-csit-1node-upstream-southbound-all-scandium-393 https://jenkins.opendaylight.org/releng https://jenkins.opendaylight.org/sandbox 19:39:14 + STACK_NAME=releng-ovsdb-csit-1node-upstream-southbound-all-scandium-393 19:39:14 + builds=() 19:39:14 + for jenkins in "${@:2}" 19:39:14 + PARAMS='tree=computer[executors[currentExecutable[url]],' 19:39:14 + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]' 19:39:14 + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 19:39:14 + JENKINS_URL='https://jenkins.opendaylight.org/releng/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 19:39:14 ++ curl -s -w '\n\n%{http_code}' --globoff -H Content-Type:application/json 'https://jenkins.opendaylight.org/releng/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 19:39:14 + resp='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73840/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/netconf-maven-merge-master/4576/"}}],"oneOffExecutors":[]}]} 19:39:14 19:39:14 200' 19:39:14 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73840/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/netconf-maven-merge-master/4576/"}}],"oneOffExecutors":[]}]} 19:39:14 19:39:14 200' 19:39:14 ++ head -n1 19:39:14 + json_data='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73840/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/netconf-maven-merge-master/4576/"}}],"oneOffExecutors":[]}]}' 19:39:14 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73840/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/netconf-maven-merge-master/4576/"}}],"oneOffExecutors":[]}]} 19:39:14 19:39:14 200' 19:39:14 ++ awk 'END {print $NF}' 19:39:14 + status=200 19:39:14 + '[' 200 '!=' 200 ']' 19:39:14 + [[ https://jenkins.opendaylight.org/releng == *\j\e\n\k\i\n\s\.*\.\o\r\g ]] 19:39:14 + [[ https://jenkins.opendaylight.org/releng == *\j\e\n\k\i\n\s\.*\.\i\o ]] 19:39:14 ++ awk -F/ '{print $NF}' 19:39:14 ++ echo https://jenkins.opendaylight.org/releng 19:39:14 ++ sed 's/\/*$//' 19:39:14 + silo=releng 19:39:14 + export silo 19:39:14 + builds=(${builds[@]} $(echo "$json_data" | jq -r '.computer[].executors[].currentExecutable.url' | grep -v null | awk -F'/' '{print ENVIRON["silo"] "-" $6 "-" $7}')) 19:39:14 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73840/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/netconf-maven-merge-master/4576/"}}],"oneOffExecutors":[]}]}' 19:39:14 ++ grep -v null 19:39:14 ++ jq -r '.computer[].executors[].currentExecutable.url' 19:39:14 ++ awk -F/ '{print ENVIRON["silo"] "-" $6 "-" $7}' 19:39:14 + for jenkins in "${@:2}" 19:39:14 + PARAMS='tree=computer[executors[currentExecutable[url]],' 19:39:14 + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]' 19:39:14 + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 19:39:14 + JENKINS_URL='https://jenkins.opendaylight.org/sandbox/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 19:39:14 ++ curl -s -w '\n\n%{http_code}' --globoff -H Content-Type:application/json 'https://jenkins.opendaylight.org/sandbox/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 19:39:14 + resp='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]} 19:39:14 19:39:14 200' 19:39:14 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]} 19:39:14 19:39:14 200' 19:39:14 ++ head -n1 19:39:14 + json_data='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}' 19:39:14 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]} 19:39:14 19:39:14 200' 19:39:14 ++ awk 'END {print $NF}' 19:39:14 + status=200 19:39:14 + '[' 200 '!=' 200 ']' 19:39:14 + [[ https://jenkins.opendaylight.org/sandbox == *\j\e\n\k\i\n\s\.*\.\o\r\g ]] 19:39:14 + [[ https://jenkins.opendaylight.org/sandbox == *\j\e\n\k\i\n\s\.*\.\i\o ]] 19:39:14 ++ echo https://jenkins.opendaylight.org/sandbox 19:39:14 ++ awk -F/ '{print $NF}' 19:39:14 ++ sed 's/\/*$//' 19:39:14 + silo=sandbox 19:39:14 + export silo 19:39:14 + builds=(${builds[@]} $(echo "$json_data" | jq -r '.computer[].executors[].currentExecutable.url' | grep -v null | awk -F'/' '{print ENVIRON["silo"] "-" $6 "-" $7}')) 19:39:14 ++ grep -v null 19:39:14 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}' 19:39:14 ++ jq -r '.computer[].executors[].currentExecutable.url' 19:39:14 ++ awk -F/ '{print ENVIRON["silo"] "-" $6 "-" $7}' 19:39:14 + [[ releng-builder-openstack-cron-73840 releng-netconf-maven-merge-master-4576 =~ releng-ovsdb-csit-1node-upstream-southbound-all-scandium-393 ]] 19:39:14 + return 1 19:39:14 + echo 'Deleting orphaned stack: releng-ovsdb-csit-1node-upstream-southbound-all-scandium-393' 19:39:14 Deleting orphaned stack: releng-ovsdb-csit-1node-upstream-southbound-all-scandium-393 19:39:14 + lftools openstack --os-cloud vex stack delete --force releng-ovsdb-csit-1node-upstream-southbound-all-scandium-393 19:40:05 Deleting stack releng-ovsdb-csit-1node-upstream-southbound-all-scandium-393 19:40:05 WARNING: Failure: Unable to establish connection to https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/4b37b27c-0ee6-4156-af2e-d3e274cb6def: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')). Retrying in 0.5s. 1 retries left 19:40:56 http.client.RemoteDisconnected: Remote end closed connection without response 19:40:56 19:40:56 During handling of the above exception, another exception occurred: 19:40:56 19:40:56 urllib3.exceptions.ProtocolError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) 19:40:56 19:40:56 During handling of the above exception, another exception occurred: 19:40:56 19:40:56 requests.exceptions.ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) 19:40:56 19:40:56 During handling of the above exception, another exception occurred: 19:40:56 19:40:56 keystoneauth1.exceptions.connection.ConnectFailure: Unable to establish connection to https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/4b37b27c-0ee6-4156-af2e-d3e274cb6def: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) 19:40:56 19:40:56 During handling of the above exception, another exception occurred: 19:40:56 19:40:56 http.client.RemoteDisconnected: Remote end closed connection without response 19:40:56 19:40:56 During handling of the above exception, another exception occurred: 19:40:56 19:40:56 urllib3.exceptions.ProtocolError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) 19:40:56 19:40:56 During handling of the above exception, another exception occurred: 19:40:56 19:40:56 requests.exceptions.ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) 19:40:56 19:40:56 During handling of the above exception, another exception occurred: 19:40:56 19:40:56 keystoneauth1.exceptions.connection.ConnectFailure: Unable to establish connection to https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-ovsdb-csit-1node-upstream-southbound-all-scandium-393/4b37b27c-0ee6-4156-af2e-d3e274cb6def: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) 19:40:56 + for STACK_NAME in "${OS_STACKS[@]}" 19:40:56 + [[ 0 -gt 0 ]] 19:40:56 + stack_in_jenkins releng-ovsdb-csit-3node-upstream-clustering-only-scandium-391 https://jenkins.opendaylight.org/releng https://jenkins.opendaylight.org/sandbox 19:40:56 + STACK_NAME=releng-ovsdb-csit-3node-upstream-clustering-only-scandium-391 19:40:56 + builds=() 19:40:56 + for jenkins in "${@:2}" 19:40:56 + PARAMS='tree=computer[executors[currentExecutable[url]],' 19:40:56 + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]' 19:40:56 + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 19:40:56 + JENKINS_URL='https://jenkins.opendaylight.org/releng/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 19:40:56 ++ curl -s -w '\n\n%{http_code}' --globoff -H Content-Type:application/json 'https://jenkins.opendaylight.org/releng/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 19:40:56 + resp='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73840/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-vanadium/46/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/netconf-maven-merge-master/4576/"}}],"oneOffExecutors":[]}]} 19:40:56 19:40:56 200' 19:40:56 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73840/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-vanadium/46/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/netconf-maven-merge-master/4576/"}}],"oneOffExecutors":[]}]} 19:40:56 19:40:56 200' 19:40:56 ++ head -n1 19:40:56 + json_data='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73840/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-vanadium/46/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/netconf-maven-merge-master/4576/"}}],"oneOffExecutors":[]}]}' 19:40:56 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73840/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-vanadium/46/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/netconf-maven-merge-master/4576/"}}],"oneOffExecutors":[]}]} 19:40:56 19:40:56 200' 19:40:56 ++ awk 'END {print $NF}' 19:40:56 + status=200 19:40:56 + '[' 200 '!=' 200 ']' 19:40:56 + [[ https://jenkins.opendaylight.org/releng == *\j\e\n\k\i\n\s\.*\.\o\r\g ]] 19:40:56 + [[ https://jenkins.opendaylight.org/releng == *\j\e\n\k\i\n\s\.*\.\i\o ]] 19:40:56 ++ echo https://jenkins.opendaylight.org/releng 19:40:56 ++ sed 's/\/*$//' 19:40:56 ++ awk -F/ '{print $NF}' 19:40:56 + silo=releng 19:40:56 + export silo 19:40:56 + builds=(${builds[@]} $(echo "$json_data" | jq -r '.computer[].executors[].currentExecutable.url' | grep -v null | awk -F'/' '{print ENVIRON["silo"] "-" $6 "-" $7}')) 19:40:56 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/73840/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":null},{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/integration-sanity-test-vanadium/46/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":null}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/netconf-maven-merge-master/4576/"}}],"oneOffExecutors":[]}]}' 19:40:56 ++ jq -r '.computer[].executors[].currentExecutable.url' 19:40:56 ++ grep -v null 19:40:56 ++ awk -F/ '{print ENVIRON["silo"] "-" $6 "-" $7}' 19:40:56 + for jenkins in "${@:2}" 19:40:56 + PARAMS='tree=computer[executors[currentExecutable[url]],' 19:40:56 + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]' 19:40:56 + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 19:40:56 + JENKINS_URL='https://jenkins.opendaylight.org/sandbox/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 19:40:56 ++ curl -s -w '\n\n%{http_code}' --globoff -H Content-Type:application/json 'https://jenkins.opendaylight.org/sandbox/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 19:40:56 + resp='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]} 19:40:56 19:40:56 200' 19:40:56 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]} 19:40:56 19:40:56 200' 19:40:56 ++ head -n1 19:40:56 + json_data='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}' 19:40:56 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]} 19:40:56 19:40:56 200' 19:40:56 ++ awk 'END {print $NF}' 19:40:56 + status=200 19:40:56 + '[' 200 '!=' 200 ']' 19:40:56 + [[ https://jenkins.opendaylight.org/sandbox == *\j\e\n\k\i\n\s\.*\.\o\r\g ]] 19:40:56 + [[ https://jenkins.opendaylight.org/sandbox == *\j\e\n\k\i\n\s\.*\.\i\o ]] 19:40:56 ++ echo https://jenkins.opendaylight.org/sandbox 19:40:56 ++ sed 's/\/*$//' 19:40:56 ++ awk -F/ '{print $NF}' 19:40:56 + silo=sandbox 19:40:56 + export silo 19:40:56 + builds=(${builds[@]} $(echo "$json_data" | jq -r '.computer[].executors[].currentExecutable.url' | grep -v null | awk -F'/' '{print ENVIRON["silo"] "-" $6 "-" $7}')) 19:40:56 ++ awk -F/ '{print ENVIRON["silo"] "-" $6 "-" $7}' 19:40:56 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}' 19:40:56 ++ jq -r '.computer[].executors[].currentExecutable.url' 19:40:56 ++ grep -v null 19:40:56 + [[ releng-builder-openstack-cron-73840 releng-integration-sanity-test-vanadium-46 releng-netconf-maven-merge-master-4576 =~ releng-ovsdb-csit-3node-upstream-clustering-only-scandium-391 ]] 19:40:56 + return 1 19:40:56 + echo 'Deleting orphaned stack: releng-ovsdb-csit-3node-upstream-clustering-only-scandium-391' 19:40:56 Deleting orphaned stack: releng-ovsdb-csit-3node-upstream-clustering-only-scandium-391 19:40:56 + lftools openstack --os-cloud vex stack delete --force releng-ovsdb-csit-3node-upstream-clustering-only-scandium-391 19:41:48 Deleting stack releng-ovsdb-csit-3node-upstream-clustering-only-scandium-391 19:41:48 WARNING: Failure: Unable to establish connection to https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-ovsdb-csit-3node-upstream-clustering-only-scandium-391?resolve_outputs=False: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')). Retrying in 0.5s. 1 retries left 19:42:15 Build timed out (after 10 minutes). Marking the build as failed. 19:42:15 $ ssh-agent -k 19:42:15 unset SSH_AUTH_SOCK; 19:42:15 unset SSH_AGENT_PID; 19:42:15 echo Agent pid 5457 killed; 19:42:15 [ssh-agent] Stopped. 19:42:15 Build was aborted 19:42:15 [PostBuildScript] - [INFO] Executing post build scripts. 19:42:15 /tmp/jenkins540951332558784982.sh: line 129: 7013 Terminated lftools openstack --os-cloud "${os_cloud}" stack delete --force "${STACK_NAME}" 19:42:15 + for STACK_NAME in "${OS_STACKS[@]}" 19:42:15 + [[ 0 -gt 0 ]] 19:42:15 + stack_in_jenkins releng-ovsdb-csit-1node-upstream-southbound-all-scandium-392 https://jenkins.opendaylight.org/releng https://jenkins.opendaylight.org/sandbox 19:42:15 + STACK_NAME=releng-ovsdb-csit-1node-upstream-southbound-all-scandium-392 19:42:15 + builds=() 19:42:15 + for jenkins in "${@:2}" 19:42:15 + PARAMS='tree=computer[executors[currentExecutable[url]],' 19:42:15 + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]' 19:42:15 + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 19:42:15 + JENKINS_URL='https://jenkins.opendaylight.org/releng/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 19:42:15 [builder-openstack-cron] $ /bin/bash /tmp/jenkins7728215403283400637.sh 19:42:15 ---> sysstat.sh 19:42:15 ++ curl -s -w '\n\n%{http_code}' --globoff -H Content-Type:application/json 'https://jenkins.opendaylight.org/releng/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 19:42:15 (23) Failed writing body 19:42:15 [builder-openstack-cron] $ /bin/bash /tmp/jenkins9855615178291105619.sh 19:42:15 ---> package-listing.sh 19:42:15 ++ facter osfamily 19:42:15 ++ tr '[:upper:]' '[:lower:]' 19:42:15 + OS_FAMILY=redhat 19:42:15 + workspace=/w/workspace/builder-openstack-cron 19:42:15 + START_PACKAGES=/tmp/packages_start.txt 19:42:15 + END_PACKAGES=/tmp/packages_end.txt 19:42:15 + DIFF_PACKAGES=/tmp/packages_diff.txt 19:42:15 + PACKAGES=/tmp/packages_start.txt 19:42:15 + '[' /w/workspace/builder-openstack-cron ']' 19:42:15 + PACKAGES=/tmp/packages_end.txt 19:42:15 + case "${OS_FAMILY}" in 19:42:15 + rpm -qa 19:42:15 + sort 19:42:16 + '[' -f /tmp/packages_start.txt ']' 19:42:16 + '[' -f /tmp/packages_end.txt ']' 19:42:16 + diff /tmp/packages_start.txt /tmp/packages_end.txt 19:42:16 + '[' /w/workspace/builder-openstack-cron ']' 19:42:16 + mkdir -p /w/workspace/builder-openstack-cron/archives/ 19:42:16 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/builder-openstack-cron/archives/ 19:42:16 [builder-openstack-cron] $ /bin/bash /tmp/jenkins1577493091126009582.sh 19:42:16 ---> capture-instance-metadata.sh 19:42:16 Setup pyenv: 19:42:16 system 19:42:16 3.8.13 19:42:16 3.9.13 19:42:16 3.10.13 19:42:16 * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version) 19:42:16 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-8RuE from file:/tmp/.os_lf_venv 19:42:18 lf-activate-venv(): INFO: Installing: lftools 19:42:33 lf-activate-venv(): INFO: Adding /tmp/venv-8RuE/bin to PATH 19:42:33 INFO: Running in OpenStack, capturing instance metadata 19:42:33 [builder-openstack-cron] $ /bin/bash /tmp/jenkins6940747684780840393.sh 19:42:33 provisioning config files... 19:42:33 Could not find credentials [logs] for builder-openstack-cron #73840 19:42:33 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/builder-openstack-cron@tmp/config14838556601285940196tmp 19:42:33 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] 19:42:33 Run condition [Regular expression match] enabling perform for step [Provide Configuration files] 19:42:33 provisioning config files... 19:42:34 copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials 19:42:34 [EnvInject] - Injecting environment variables from a build step. 19:42:34 [EnvInject] - Injecting as environment variables the properties content 19:42:34 SERVER_ID=logs 19:42:34 19:42:34 [EnvInject] - Variables injected successfully. 19:42:34 [builder-openstack-cron] $ /bin/bash /tmp/jenkins4060077561271134509.sh 19:42:34 ---> create-netrc.sh 19:42:34 WARN: Log server credential not found. 19:42:34 [builder-openstack-cron] $ /bin/bash /tmp/jenkins10004804405633104284.sh 19:42:34 ---> python-tools-install.sh 19:42:34 Setup pyenv: 19:42:34 system 19:42:34 3.8.13 19:42:34 3.9.13 19:42:34 3.10.13 19:42:34 * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version) 19:42:34 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-8RuE from file:/tmp/.os_lf_venv 19:42:36 lf-activate-venv(): INFO: Installing: lftools 19:42:46 lf-activate-venv(): INFO: Adding /tmp/venv-8RuE/bin to PATH 19:42:46 [builder-openstack-cron] $ /bin/bash /tmp/jenkins18299030713449294406.sh 19:42:46 ---> sudo-logs.sh 19:42:46 Archiving 'sudo' log.. 19:42:47 [builder-openstack-cron] $ /bin/bash /tmp/jenkins8326481313844559636.sh 19:42:47 ---> job-cost.sh 19:42:47 Setup pyenv: 19:42:47 system 19:42:47 3.8.13 19:42:47 3.9.13 19:42:47 3.10.13 19:42:47 * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version) 19:42:47 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-8RuE from file:/tmp/.os_lf_venv 19:42:49 lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 19:42:57 lf-activate-venv(): INFO: Adding /tmp/venv-8RuE/bin to PATH 19:42:57 INFO: No Stack... 19:42:57 INFO: Retrieving Pricing Info for: v3-standard-2 19:42:57 INFO: Archiving Costs 19:42:57 [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins14900972056662914255.sh 19:42:57 ---> logs-deploy.sh 19:42:57 Setup pyenv: 19:42:57 system 19:42:57 3.8.13 19:42:57 3.9.13 19:42:57 3.10.13 19:42:57 * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version) 19:42:58 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-8RuE from file:/tmp/.os_lf_venv 19:42:59 lf-activate-venv(): INFO: Installing: lftools 19:43:10 lf-activate-venv(): INFO: Adding /tmp/venv-8RuE/bin to PATH 19:43:10 WARNING: Nexus logging server not set 19:43:10 INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/builder-openstack-cron/73840/ 19:43:10 INFO: archiving logs to S3 19:43:11 ---> uname -a: 19:43:11 Linux prd-centos8-builder-2c-2g-233.novalocal 4.18.0-553.5.1.el8.x86_64 #1 SMP Tue May 21 05:46:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux 19:43:11 19:43:11 19:43:11 ---> lscpu: 19:43:11 Architecture: x86_64 19:43:11 CPU op-mode(s): 32-bit, 64-bit 19:43:11 Byte Order: Little Endian 19:43:11 CPU(s): 2 19:43:11 On-line CPU(s) list: 0,1 19:43:11 Thread(s) per core: 1 19:43:11 Core(s) per socket: 1 19:43:11 Socket(s): 2 19:43:11 NUMA node(s): 1 19:43:11 Vendor ID: AuthenticAMD 19:43:11 CPU family: 23 19:43:11 Model: 49 19:43:11 Model name: AMD EPYC-Rome Processor 19:43:11 Stepping: 0 19:43:11 CPU MHz: 2799.998 19:43:11 BogoMIPS: 5599.99 19:43:11 Virtualization: AMD-V 19:43:11 Hypervisor vendor: KVM 19:43:11 Virtualization type: full 19:43:11 L1d cache: 32K 19:43:11 L1i cache: 32K 19:43:11 L2 cache: 512K 19:43:11 L3 cache: 16384K 19:43:11 NUMA node0 CPU(s): 0,1 19:43:11 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities 19:43:11 19:43:11 19:43:11 ---> nproc: 19:43:11 2 19:43:11 19:43:11 19:43:11 ---> df -h: 19:43:11 Filesystem Size Used Avail Use% Mounted on 19:43:11 devtmpfs 3.8G 0 3.8G 0% /dev 19:43:11 tmpfs 3.8G 0 3.8G 0% /dev/shm 19:43:11 tmpfs 3.8G 17M 3.8G 1% /run 19:43:11 tmpfs 3.8G 0 3.8G 0% /sys/fs/cgroup 19:43:11 /dev/vda1 40G 8.5G 32G 22% / 19:43:11 tmpfs 770M 0 770M 0% /run/user/1001 19:43:11 19:43:11 19:43:11 ---> free -m: 19:43:11 total used free shared buff/cache available 19:43:11 Mem: 7697 621 4802 19 2274 6779 19:43:11 Swap: 1023 0 1023 19:43:11 19:43:11 19:43:11 ---> ip addr: 19:43:11 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 19:43:11 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 19:43:11 inet 127.0.0.1/8 scope host lo 19:43:11 valid_lft forever preferred_lft forever 19:43:11 inet6 ::1/128 scope host 19:43:11 valid_lft forever preferred_lft forever 19:43:11 2: eth0: mtu 1458 qdisc mq state UP group default qlen 1000 19:43:11 link/ether fa:16:3e:1b:c8:92 brd ff:ff:ff:ff:ff:ff 19:43:11 altname enp0s3 19:43:11 altname ens3 19:43:11 inet 10.30.171.251/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0 19:43:11 valid_lft 85696sec preferred_lft 85696sec 19:43:11 inet6 fe80::f816:3eff:fe1b:c892/64 scope link 19:43:11 valid_lft forever preferred_lft forever 19:43:11 3: docker0: mtu 1458 qdisc noqueue state DOWN group default 19:43:11 link/ether 02:42:22:0c:43:09 brd ff:ff:ff:ff:ff:ff 19:43:11 inet 10.250.0.254/24 brd 10.250.0.255 scope global docker0 19:43:11 valid_lft forever preferred_lft forever 19:43:11 19:43:11 19:43:11 ---> sar -b -r -n DEV: 19:43:11 Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-builder-5e6ee0fb-b6d9-4116-90d4-35c890e2b0f7.nov) 09/19/2025 _x86_64_ (2 CPU) 19:43:11 19:43:11 19:31:23 LINUX RESTART (2 CPU) 19:43:11 19:43:11 07:32:01 PM tps rtps wtps bread/s bwrtn/s 19:43:11 07:33:01 PM 191.37 9.48 181.89 1552.28 7407.75 19:43:11 07:34:01 PM 97.15 1.10 96.05 133.69 11154.93 19:43:11 07:35:01 PM 14.10 0.03 14.06 0.53 1161.24 19:43:11 07:36:01 PM 0.55 0.00 0.55 0.00 8.17 19:43:11 07:37:01 PM 0.35 0.00 0.35 0.00 3.97 19:43:11 07:38:01 PM 0.55 0.00 0.55 0.00 7.62 19:43:11 07:39:01 PM 0.35 0.00 0.35 0.00 3.42 19:43:11 07:40:01 PM 0.33 0.00 0.33 0.00 3.37 19:43:11 07:41:01 PM 0.52 0.00 0.52 0.00 7.55 19:43:11 07:42:01 PM 0.48 0.00 0.48 0.00 6.45 19:43:11 07:43:01 PM 26.94 0.50 26.44 63.71 1373.06 19:43:11 Average: 30.25 1.01 29.24 159.12 1921.69 19:43:11 19:43:11 07:32:01 PM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 19:43:11 07:33:01 PM 5132144 7015496 2750288 34.89 2688 2065700 958044 10.73 202160 2223520 183940 19:43:11 07:34:01 PM 4959236 6963564 2923196 37.08 2688 2179600 971620 10.88 231724 2335932 27852 19:43:11 07:35:01 PM 4958820 6962648 2923612 37.09 2688 2179620 971620 10.88 231744 2335840 4 19:43:11 07:36:01 PM 4954592 6958420 2927840 37.14 2688 2179620 971620 10.88 231744 2340152 4 19:43:11 07:37:01 PM 4952508 6956340 2929924 37.17 2688 2179624 971620 10.88 231744 2342480 12 19:43:11 07:38:01 PM 4952748 6956580 2929684 37.17 2688 2179624 971620 10.88 231744 2342572 8 19:43:11 07:39:01 PM 4952840 6956672 2929592 37.17 2688 2179624 971620 10.88 231744 2342440 4 19:43:11 07:40:01 PM 4952924 6956748 2929508 37.17 2688 2179628 996244 11.15 244564 2329620 4 19:43:11 07:41:01 PM 4952244 6956068 2930188 37.17 2688 2179628 981692 10.99 246052 2328920 4 19:43:11 07:42:01 PM 4952236 6956064 2930196 37.17 2688 2179632 981692 10.99 246052 2329020 4 19:43:11 07:43:01 PM 4966228 6988296 2916204 37.00 2688 2196668 952688 10.67 400792 2161156 51388 19:43:11 Average: 4971502 6966081 2910930 36.93 2688 2170815 972735 10.89 248188 2310150 23929 19:43:11 19:43:11 07:32:01 PM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 19:43:11 07:33:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:43:11 07:33:01 PM eth0 206.66 147.02 1655.53 50.38 0.00 0.00 0.00 0.00 19:43:11 07:33:01 PM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:43:11 07:34:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:43:11 07:34:01 PM eth0 56.63 45.05 626.63 8.89 0.00 0.00 0.00 0.00 19:43:11 07:34:01 PM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:43:11 07:35:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:43:11 07:35:01 PM eth0 0.53 0.35 0.14 0.08 0.00 0.00 0.00 0.00 19:43:11 07:35:01 PM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:43:11 07:36:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:43:11 07:36:01 PM eth0 0.53 0.38 0.12 0.08 0.00 0.00 0.00 0.00 19:43:11 07:36:01 PM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:43:11 07:37:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:43:11 07:37:01 PM eth0 0.58 0.43 0.20 0.13 0.00 0.00 0.00 0.00 19:43:11 07:37:01 PM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:43:11 07:38:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:43:11 07:38:01 PM eth0 0.57 0.38 0.20 0.07 0.00 0.00 0.00 0.00 19:43:11 07:38:01 PM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:43:11 07:39:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:43:11 07:39:01 PM eth0 0.45 0.30 0.11 0.07 0.00 0.00 0.00 0.00 19:43:11 07:39:01 PM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:43:11 07:40:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:43:11 07:40:01 PM eth0 2.60 1.95 1.11 0.56 0.00 0.00 0.00 0.00 19:43:11 07:40:01 PM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:43:11 07:41:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:43:11 07:41:01 PM eth0 3.17 2.42 1.44 0.86 0.00 0.00 0.00 0.00 19:43:11 07:41:01 PM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:43:11 07:42:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:43:11 07:42:01 PM eth0 1.48 0.40 0.27 0.12 0.00 0.00 0.00 0.00 19:43:11 07:42:01 PM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:43:11 07:43:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:43:11 07:43:01 PM eth0 30.12 25.77 254.85 14.88 0.00 0.00 0.00 0.00 19:43:11 07:43:01 PM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:43:11 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:43:11 Average: eth0 27.58 20.41 230.98 6.92 0.00 0.00 0.00 0.00 19:43:11 Average: docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:43:11 19:43:11 19:43:11 ---> sar -P ALL: 19:43:11 Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-builder-5e6ee0fb-b6d9-4116-90d4-35c890e2b0f7.nov) 09/19/2025 _x86_64_ (2 CPU) 19:43:11 19:43:11 19:31:23 LINUX RESTART (2 CPU) 19:43:11 19:43:11 07:32:01 PM CPU %user %nice %system %iowait %steal %idle 19:43:11 07:33:01 PM all 36.24 0.00 6.31 2.02 0.13 55.31 19:43:11 07:33:01 PM 0 29.42 0.00 5.95 1.18 0.13 63.31 19:43:11 07:33:01 PM 1 43.10 0.00 6.67 2.85 0.12 47.26 19:43:11 07:34:01 PM all 28.79 0.00 4.30 1.23 0.11 65.57 19:43:11 07:34:01 PM 0 30.92 0.00 4.35 1.15 0.12 63.46 19:43:11 07:34:01 PM 1 26.66 0.00 4.25 1.31 0.10 67.69 19:43:11 07:35:01 PM all 0.29 0.00 0.13 0.13 0.05 99.40 19:43:11 07:35:01 PM 0 0.12 0.00 0.07 0.03 0.05 99.73 19:43:11 07:35:01 PM 1 0.47 0.00 0.20 0.22 0.05 99.06 19:43:11 07:36:01 PM all 0.29 0.00 0.08 0.00 0.05 99.57 19:43:11 07:36:01 PM 0 0.05 0.00 0.10 0.00 0.05 99.80 19:43:11 07:36:01 PM 1 0.53 0.00 0.07 0.00 0.05 99.35 19:43:11 07:37:01 PM all 0.35 0.00 0.10 0.00 0.06 99.49 19:43:11 07:37:01 PM 0 0.33 0.00 0.15 0.00 0.07 99.45 19:43:11 07:37:01 PM 1 0.37 0.00 0.05 0.00 0.05 99.53 19:43:11 07:38:01 PM all 0.36 0.00 0.07 0.00 0.03 99.54 19:43:11 07:38:01 PM 0 0.13 0.00 0.07 0.00 0.02 99.78 19:43:11 07:38:01 PM 1 0.58 0.00 0.07 0.00 0.05 99.30 19:43:11 07:39:01 PM all 0.32 0.00 0.07 0.00 0.07 99.55 19:43:11 07:39:01 PM 0 0.12 0.00 0.08 0.00 0.07 99.73 19:43:11 07:39:01 PM 1 0.52 0.00 0.05 0.00 0.07 99.37 19:43:11 07:40:01 PM all 1.20 0.00 0.22 0.00 0.05 98.53 19:43:11 07:40:01 PM 0 0.83 0.00 0.13 0.00 0.05 98.98 19:43:11 07:40:01 PM 1 1.57 0.00 0.30 0.00 0.05 98.08 19:43:11 07:41:01 PM all 1.22 0.00 0.24 0.00 0.04 98.50 19:43:11 07:41:01 PM 0 0.78 0.00 0.10 0.00 0.02 99.10 19:43:11 07:41:01 PM 1 1.65 0.00 0.38 0.00 0.07 97.90 19:43:11 07:42:01 PM all 0.23 0.00 0.08 0.00 0.06 99.63 19:43:11 07:42:01 PM 0 0.38 0.00 0.12 0.00 0.07 99.43 19:43:11 07:42:01 PM 1 0.07 0.00 0.05 0.00 0.05 99.83 19:43:11 07:43:01 PM all 28.18 0.00 4.28 0.18 0.10 67.26 19:43:11 07:43:01 PM 0 22.10 0.00 3.77 0.13 0.10 73.89 19:43:11 07:43:01 PM 1 34.28 0.00 4.79 0.22 0.10 60.62 19:43:11 19:43:11 Average: CPU %user %nice %system %iowait %steal %idle 19:43:11 Average: all 8.85 0.00 1.44 0.32 0.07 89.32 19:43:11 Average: 0 7.75 0.00 1.36 0.23 0.07 90.60 19:43:11 Average: 1 9.96 0.00 1.53 0.42 0.07 88.03 19:43:11 19:43:11 19:43:11