05:48:54 Started by upstream project "autorelease-release-chromium-mvn39-openjdk21" build number 133 05:48:54 originally caused by: 05:48:54 Started by timer 05:48:54 Running as SYSTEM 05:48:54 [EnvInject] - Loading node environment variables. 05:48:54 Building remotely on prd-queue-disttest-2c-1g-23010 (queue-disttest-2c-1g) in workspace /w/workspace/integration-distribution-test-vanadium 05:48:55 [ssh-agent] Looking for ssh-agent implementation... 05:48:55 [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) 05:48:55 $ ssh-agent 05:48:55 SSH_AUTH_SOCK=/tmp/ssh-pKmxYtpnu4Xz/agent.3132 05:48:55 SSH_AGENT_PID=3134 05:48:55 [ssh-agent] Started. 05:48:55 Running ssh-add (command line suppressed) 05:48:55 Identity added: /w/workspace/integration-distribution-test-vanadium@tmp/private_key_13080254002612715555.key (/w/workspace/integration-distribution-test-vanadium@tmp/private_key_13080254002612715555.key) 05:48:55 [ssh-agent] Using credentials jenkins (jenkins-ssh) 05:48:55 No emails were triggered. 05:48:55 provisioning config files... 05:48:55 copy managed file [npmrc] to file:/home/jenkins/.npmrc 05:48:55 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 05:48:55 [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins7995685886805693604.sh 05:48:55 ---> python-tools-install.sh 05:48:55 Setup pyenv: 05:48:56 * system (set by /opt/pyenv/version) 05:48:56 * 3.8.20 (set by /opt/pyenv/version) 05:48:56 * 3.9.20 (set by /opt/pyenv/version) 05:48:56 3.10.15 05:48:56 3.11.10 05:49:00 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-01G3 05:49:00 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 05:49:00 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 05:49:00 lf-activate-venv(): INFO: Attempting to install with network-safe options... 05:49:05 lf-activate-venv(): INFO: Base packages installed successfully 05:49:05 lf-activate-venv(): INFO: Installing additional packages: lftools 05:49:32 lf-activate-venv(): INFO: Adding /tmp/venv-01G3/bin to PATH 05:49:32 Generating Requirements File 05:49:58 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 05:49:58 httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible. 05:49:58 Python 3.11.10 05:49:58 pip 26.1.2 from /tmp/venv-01G3/lib/python3.11/site-packages/pip (python 3.11) 05:49:58 aiohappyeyeballs==2.6.2 05:49:58 aiohttp==3.14.0 05:49:58 aiosignal==1.4.0 05:49:58 appdirs==1.4.4 05:49:58 argcomplete==3.6.3 05:49:58 aspy.yaml==1.3.0 05:49:58 attrs==26.1.0 05:49:58 autopage==0.6.0 05:49:58 beautifulsoup4==4.14.3 05:49:58 boto3==1.43.20 05:49:58 botocore==1.43.20 05:49:58 bs4==0.0.2 05:49:58 certifi==2026.5.20 05:49:58 cffi==2.0.0 05:49:58 cfgv==3.5.0 05:49:58 chardet==7.4.3 05:49:58 charset-normalizer==3.4.7 05:49:58 click==8.4.1 05:49:58 cliff==4.14.0 05:49:58 cmd2==3.5.1 05:49:58 cryptography==3.3.2 05:49:58 debtcollector==3.1.0 05:49:58 decorator==5.3.1 05:49:58 defusedxml==0.7.1 05:49:58 Deprecated==1.3.1 05:49:58 distlib==0.4.1 05:49:58 dnspython==2.8.0 05:49:58 docker==7.1.0 05:49:58 dogpile.cache==1.5.0 05:49:58 durationpy==0.10 05:49:58 email-validator==2.3.0 05:49:58 filelock==3.29.0 05:49:58 frozenlist==1.8.0 05:49:58 future==1.0.0 05:49:58 gitdb==4.0.12 05:49:58 GitPython==3.1.50 05:49:58 httplib2==0.30.2 05:49:58 identify==2.6.19 05:49:58 idna==3.18 05:49:58 importlib-resources==1.5.0 05:49:58 iso8601==2.1.0 05:49:58 Jinja2==3.1.6 05:49:58 jmespath==1.1.0 05:49:58 jsonpatch==1.33 05:49:58 jsonpointer==3.1.1 05:49:58 jsonschema==4.26.0 05:49:58 jsonschema-specifications==2025.9.1 05:49:58 keystoneauth1==5.14.0 05:49:58 kubernetes==36.0.2 05:49:58 lftools==0.37.22 05:49:58 lxml==6.1.1 05:49:58 markdown-it-py==4.2.0 05:49:58 MarkupSafe==3.0.3 05:49:58 mdurl==0.1.2 05:49:58 msgpack==1.1.2 05:49:58 multi_key_dict==2.0.3 05:49:58 multidict==6.7.1 05:49:58 munch==4.0.0 05:49:58 netaddr==1.3.0 05:49:58 niet==1.4.2 05:49:58 nodeenv==1.10.0 05:49:58 oauth2client==4.1.3 05:49:58 oauthlib==3.3.1 05:49:58 openstacksdk==4.14.0 05:49:58 os-service-types==1.8.2 05:49:58 osc-lib==4.6.0 05:49:58 oslo.config==10.4.0 05:49:58 oslo.context==6.4.0 05:49:58 oslo.i18n==6.8.0 05:49:58 oslo.log==8.2.0 05:49:58 oslo.serialization==5.10.0 05:49:58 oslo.utils==10.1.0 05:49:58 packaging==26.2 05:49:58 pbr==7.0.3 05:49:58 platformdirs==4.10.0 05:49:58 prettytable==3.17.0 05:49:58 propcache==0.5.2 05:49:58 psutil==7.2.2 05:49:58 pyasn1==0.6.3 05:49:58 pyasn1_modules==0.4.2 05:49:58 pycparser==3.0 05:49:58 pygerrit2==2.0.15 05:49:58 PyGithub==2.9.1 05:49:58 Pygments==2.20.0 05:49:58 PyJWT==2.13.0 05:49:58 PyNaCl==1.6.2 05:49:58 pyparsing==2.4.7 05:49:58 pyperclip==1.11.0 05:49:58 pyrsistent==0.20.0 05:49:58 python-cinderclient==9.9.0 05:49:58 python-dateutil==2.9.0.post0 05:49:58 python-discovery==1.4.0 05:49:58 python-heatclient==5.2.0 05:49:58 python-jenkins==1.8.3 05:49:58 python-keystoneclient==5.8.0 05:49:58 python-magnumclient==4.10.0 05:49:58 python-openstackclient==10.0.0 05:49:58 python-swiftclient==4.10.0 05:49:58 PyYAML==6.0.3 05:49:58 referencing==0.37.0 05:49:58 requests==2.34.2 05:49:58 requests-oauthlib==2.0.0 05:49:58 rfc3986==2.0.0 05:49:58 rich==15.0.0 05:49:58 rich-argparse==1.8.0 05:49:58 rpds-py==2026.5.1 05:49:58 rsa==4.9.1 05:49:58 ruamel.yaml==0.19.1 05:49:58 ruamel.yaml.clib==0.2.15 05:49:58 s3transfer==0.18.0 05:49:58 simplejson==4.1.1 05:49:58 six==1.17.0 05:49:58 smmap==5.0.3 05:49:58 soupsieve==2.8.4 05:49:58 stevedore==5.8.0 05:49:58 tabulate==0.10.0 05:49:58 toml==0.10.2 05:49:58 tomlkit==0.15.0 05:49:58 tqdm==4.67.3 05:49:58 typing_extensions==4.15.0 05:49:58 urllib3==1.26.20 05:49:58 virtualenv==21.4.2 05:49:58 wcwidth==0.7.0 05:49:58 websocket-client==1.9.0 05:49:58 wrapt==2.2.1 05:49:58 xdg==6.0.0 05:49:58 xmltodict==1.0.4 05:49:58 yarl==1.24.2 05:49:58 yq==3.4.3 05:49:59 [integration-distribution-test-vanadium] $ /bin/sh /tmp/jenkins8116294289802081297.sh 05:49:59 ---> uv-install.sh 05:49:59 Installing uv/uvx (latest) using shell installer 05:49:59 2026-06-03 05:49:59 URL:https://releases.astral.sh/installers/uv/latest/uv-installer.sh [71233/71233] -> "/tmp/uv-install-ODoMyl.sh" [1] 05:49:59 downloading uv 0.11.18 x86_64-unknown-linux-gnu 05:50:00 installing to /home/jenkins/.local/bin 05:50:00 uv 05:50:00 uvx 05:50:00 everything's installed! 05:50:00 05:50:00 To add $HOME/.local/bin to your PATH, either restart your shell or run: 05:50:00 05:50:00 source $HOME/.local/bin/env (sh, bash, zsh) 05:50:00 source $HOME/.local/bin/env.fish (fish) 05:50:00 Adding install location to PATH 05:50:00 ---> Validating uv/uvx install 05:50:00 uvx 0.11.18 (x86_64-unknown-linux-gnu) 05:50:00 Waiting for the completion of bgpcep-csit-1node-bgp-ingest-all-vanadium 05:50:00 bgpcep-csit-1node-bgp-ingest-all-vanadium #282 started. 07:22:35 bgpcep-csit-1node-bgp-ingest-all-vanadium #282 completed. Result was UNSTABLE 07:22:35 Waiting for the completion of bgpcep-csit-1node-bgp-ingest-mixed-all-vanadium 07:22:35 bgpcep-csit-1node-bgp-ingest-mixed-all-vanadium #282 started. 07:22:35 bgpcep-csit-1node-bgp-ingest-mixed-all-vanadium #282 completed. Result was UNSTABLE 07:22:35 Waiting for the completion of bgpcep-csit-1node-throughpcep-all-vanadium 07:22:35 bgpcep-csit-1node-throughpcep-all-vanadium #282 started. 07:22:35 bgpcep-csit-1node-throughpcep-all-vanadium #282 completed. Result was UNSTABLE 07:22:35 Waiting for the completion of bgpcep-csit-1node-userfeatures-all-vanadium 07:22:35 bgpcep-csit-1node-userfeatures-all-vanadium #282 started. 07:22:35 bgpcep-csit-1node-userfeatures-all-vanadium #282 completed. Result was UNSTABLE 07:22:35 Waiting for the completion of daexim-csit-1node-basic-only-vanadium 07:22:35 daexim-csit-1node-basic-only-vanadium #282 started. 07:22:35 daexim-csit-1node-basic-only-vanadium #282 completed. Result was UNSTABLE 07:22:35 Waiting for the completion of daexim-csit-3node-clustering-basic-only-vanadium 07:22:35 daexim-csit-3node-clustering-basic-only-vanadium #282 started. 07:22:35 daexim-csit-3node-clustering-basic-only-vanadium #282 completed. Result was FAILURE 07:22:35 Waiting for the completion of distribution-csit-managed-vanadium 07:22:35 distribution-csit-managed-vanadium #282 started. 07:22:35 distribution-csit-managed-vanadium #282 completed. Result was SUCCESS 07:22:35 Waiting for the completion of jsonrpc-csit-1node-basic-only-vanadium 07:22:35 jsonrpc-csit-1node-basic-only-vanadium #283 started. 07:22:35 jsonrpc-csit-1node-basic-only-vanadium #283 completed. Result was UNSTABLE 07:22:35 Waiting for the completion of openflowplugin-csit-1node-cbench-only-vanadium 07:22:35 openflowplugin-csit-1node-cbench-only-vanadium #282 started. 07:22:35 openflowplugin-csit-1node-cbench-only-vanadium #282 completed. Result was UNSTABLE 07:22:35 Waiting for the completion of openflowplugin-csit-1node-flow-services-all-vanadium 07:22:35 openflowplugin-csit-1node-flow-services-all-vanadium #282 started. 07:22:35 openflowplugin-csit-1node-flow-services-all-vanadium #282 completed. Result was UNSTABLE 07:22:35 Waiting for the completion of openflowplugin-csit-1node-perf-bulkomatic-only-vanadium 07:22:35 openflowplugin-csit-1node-perf-bulkomatic-only-vanadium #282 started. 07:22:35 openflowplugin-csit-1node-perf-bulkomatic-only-vanadium #282 completed. Result was UNSTABLE 07:22:35 Waiting for the completion of openflowplugin-csit-1node-perf-stats-collection-only-vanadium 07:22:35 openflowplugin-csit-1node-perf-stats-collection-only-vanadium #282 started. 07:22:35 openflowplugin-csit-1node-perf-stats-collection-only-vanadium #282 completed. Result was UNSTABLE 07:22:35 Waiting for the completion of openflowplugin-csit-1node-scale-link-only-vanadium 07:22:35 openflowplugin-csit-1node-scale-link-only-vanadium #282 started. 07:22:35 openflowplugin-csit-1node-scale-link-only-vanadium #282 completed. Result was UNSTABLE 07:22:35 Waiting for the completion of openflowplugin-csit-1node-scale-only-vanadium 07:22:35 openflowplugin-csit-1node-scale-only-vanadium #282 started. 07:22:35 openflowplugin-csit-1node-scale-only-vanadium #282 completed. Result was UNSTABLE 07:22:35 Waiting for the completion of openflowplugin-csit-1node-scale-switch-only-vanadium 07:22:35 openflowplugin-csit-1node-scale-switch-only-vanadium #282 started. 07:22:35 openflowplugin-csit-1node-scale-switch-only-vanadium #282 completed. Result was UNSTABLE 07:22:35 Waiting for the completion of openflowplugin-csit-3node-clustering-bulkomatic-only-vanadium 07:22:35 openflowplugin-csit-3node-clustering-bulkomatic-only-vanadium #282 started. 07:22:35 openflowplugin-csit-3node-clustering-bulkomatic-only-vanadium #282 completed. Result was FAILURE 07:22:35 Waiting for the completion of openflowplugin-csit-3node-clustering-only-vanadium 07:22:35 openflowplugin-csit-3node-clustering-only-vanadium #282 started. 07:22:35 openflowplugin-csit-3node-clustering-only-vanadium #282 completed. Result was FAILURE 07:22:35 Waiting for the completion of openflowplugin-csit-3node-clustering-perf-bulkomatic-only-vanadium 07:22:35 openflowplugin-csit-3node-clustering-perf-bulkomatic-only-vanadium #282 started. 07:22:35 openflowplugin-csit-3node-clustering-perf-bulkomatic-only-vanadium #282 completed. Result was FAILURE 07:22:35 Waiting for the completion of ovsdb-csit-1node-upstream-southbound-all-vanadium 07:22:35 ovsdb-csit-1node-upstream-southbound-all-vanadium #283 started. 07:22:35 ovsdb-csit-1node-upstream-southbound-all-vanadium #283 completed. Result was UNSTABLE 07:22:35 Waiting for the completion of ovsdb-csit-3node-upstream-clustering-only-vanadium 07:22:35 ovsdb-csit-3node-upstream-clustering-only-vanadium #282 started. 07:22:35 ovsdb-csit-3node-upstream-clustering-only-vanadium #282 completed. Result was FAILURE 07:22:35 Build step 'Trigger/call builds on other projects' changed build result to UNSTABLE 07:22:35 Build step 'Trigger/call builds on other projects' marked build as failure 07:22:35 $ ssh-agent -k 07:22:35 unset SSH_AUTH_SOCK; 07:22:35 unset SSH_AGENT_PID; 07:22:35 echo Agent pid 3134 killed; 07:22:35 [ssh-agent] Stopped. 07:22:35 [PostBuildScript] - [INFO] Executing post build scripts. 07:22:35 [integration-distribution-test-vanadium] $ /bin/sh /tmp/jenkins16553287932857930576.sh 07:22:44 python /tmp/tmp.pYXx5Kw0Ot https://jenkins.opendaylight.org/releng/job/integration-distribution-test-vanadium/284/ 07:22:45 /tmp/tmp.pYXx5Kw0Ot:26: DeprecationWarning: Call to deprecated method findAll. (Replaced by find_all) -- Deprecated since version 4.0.0. 07:22:45 links = soup.findAll("a", { "class" : "model-link" }) 07:22:45 [PostBuildScript] - [INFO] Executing post build scripts. 07:22:45 [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins13203328008525686398.sh 07:22:45 ---> sysstat.sh 07:22:45 /tmp/jenkins13203328008525686398.sh: line 19: facter: command not found 07:22:45 [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins275296368690491205.sh 07:22:45 ---> package-listing.sh 07:22:45 ++ tr '[:upper:]' '[:lower:]' 07:22:45 ++ facter osfamily 07:22:45 /tmp/jenkins275296368690491205.sh: line 19: facter: command not found 07:22:45 + OS_FAMILY= 07:22:45 [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins6217164557580959995.sh 07:22:45 ---> capture-instance-metadata.sh 07:22:45 Setup pyenv: 07:22:45 system 07:22:45 3.8.20 07:22:45 3.9.20 07:22:45 3.10.15 07:22:45 * 3.11.10 (set by /w/workspace/integration-distribution-test-vanadium/.python-version) 07:22:45 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-01G3 from file:/tmp/.os_lf_venv 07:22:45 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 07:22:45 lf-activate-venv(): INFO: Attempting to install with network-safe options... 07:22:47 lf-activate-venv(): INFO: Base packages installed successfully 07:22:47 lf-activate-venv(): INFO: Installing additional packages: lftools 07:22:59 lf-activate-venv(): INFO: Adding /tmp/venv-01G3/bin to PATH 07:22:59 INFO: Running in OpenStack, capturing instance metadata 07:22:59 [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins16548628046564230539.sh 07:22:59 provisioning config files... 07:23:00 Could not find credentials [logs] for integration-distribution-test-vanadium #284 07:23:00 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/integration-distribution-test-vanadium@tmp/config13576581773508006016tmp 07:23:00 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] 07:23:00 Run condition [Regular expression match] enabling perform for step [Provide Configuration files] 07:23:00 provisioning config files... 07:23:00 copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials 07:23:00 [EnvInject] - Injecting environment variables from a build step. 07:23:00 [EnvInject] - Injecting as environment variables the properties content 07:23:00 SERVER_ID=logs 07:23:00 07:23:00 [EnvInject] - Variables injected successfully. 07:23:00 [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins17070589723349636030.sh 07:23:00 ---> create-netrc.sh 07:23:00 WARN: Log server credential not found. 07:23:00 [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins2123557048003414187.sh 07:23:00 ---> python-tools-install.sh 07:23:00 Setup pyenv: 07:23:00 system 07:23:00 3.8.20 07:23:00 3.9.20 07:23:00 3.10.15 07:23:00 * 3.11.10 (set by /w/workspace/integration-distribution-test-vanadium/.python-version) 07:23:00 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-01G3 from file:/tmp/.os_lf_venv 07:23:00 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 07:23:00 lf-activate-venv(): INFO: Attempting to install with network-safe options... 07:23:02 lf-activate-venv(): INFO: Base packages installed successfully 07:23:02 lf-activate-venv(): INFO: Installing additional packages: lftools 07:23:12 lf-activate-venv(): INFO: Adding /tmp/venv-01G3/bin to PATH 07:23:12 [integration-distribution-test-vanadium] $ /bin/sh /tmp/jenkins16615342754170784350.sh 07:23:12 ---> uv-install.sh 07:23:12 uv 0.11.18 is already installed 07:23:12 uvx 0.11.18 (x86_64-unknown-linux-gnu) 07:23:12 [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins6595290293581997484.sh 07:23:12 ---> sudo-logs.sh 07:23:12 Archiving 'sudo' log.. 07:23:12 /tmp/jenkins6595290293581997484.sh: line 41: facter: command not found 07:23:12 [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins8910107397840707693.sh 07:23:12 ---> job-cost.sh 07:23:12 INFO: Activating Python virtual environment... 07:23:12 Setup pyenv: 07:23:12 system 07:23:12 3.8.20 07:23:12 3.9.20 07:23:12 3.10.15 07:23:12 * 3.11.10 (set by /w/workspace/integration-distribution-test-vanadium/.python-version) 07:23:12 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-01G3 from file:/tmp/.os_lf_venv 07:23:12 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 07:23:12 lf-activate-venv(): INFO: Attempting to install with network-safe options... 07:23:14 lf-activate-venv(): INFO: Base packages installed successfully 07:23:14 lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 07:23:21 lf-activate-venv(): INFO: Adding /tmp/venv-01G3/bin to PATH 07:23:21 INFO: No stack-cost file found 07:23:21 INFO: Instance uptime: 5693s 07:23:21 INFO: Fetching instance metadata (attempt 1 of 3)... 07:23:21 DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type 07:23:21 INFO: Successfully fetched instance metadata 07:23:21 INFO: Instance type: v3-standard-2 07:23:21 INFO: Retrieving pricing info for: v3-standard-2 07:23:21 INFO: Fetching Vexxhost pricing API (attempt 1 of 3)... 07:23:21 DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-standard-2/cost?seconds=5693 07:23:21 INFO: Successfully fetched Vexxhost pricing API 07:23:21 INFO: Retrieved cost: 0.11 07:23:22 INFO: Retrieved resource: v3-standard-2 07:23:22 INFO: Creating archive directory: /w/workspace/integration-distribution-test-vanadium/archives/cost 07:23:22 INFO: Archiving costs to: /w/workspace/integration-distribution-test-vanadium/archives/cost.csv 07:23:22 INFO: Successfully archived job cost data 07:23:22 DEBUG: Cost data: integration-distribution-test-vanadium,284,2026-06-03 07:23:22,v3-standard-2,5693,0.11,0.00,FAILURE 07:23:22 [integration-distribution-test-vanadium] $ /bin/bash -l /tmp/jenkins8453291921162644037.sh 07:23:22 ---> logs-deploy.sh 07:23:22 Setup pyenv: 07:23:22 system 07:23:22 3.8.20 07:23:22 3.9.20 07:23:22 3.10.15 07:23:22 * 3.11.10 (set by /w/workspace/integration-distribution-test-vanadium/.python-version) 07:23:22 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-01G3 from file:/tmp/.os_lf_venv 07:23:22 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 07:23:22 lf-activate-venv(): INFO: Attempting to install with network-safe options... 07:23:24 lf-activate-venv(): INFO: Base packages installed successfully 07:23:24 lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 07:23:35 lf-activate-venv(): INFO: Adding /tmp/venv-01G3/bin to PATH 07:23:35 WARNING: Nexus logging server not set 07:23:35 INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/integration-distribution-test-vanadium/284/ 07:23:35 INFO: archiving logs to S3 07:23:36 ---> uname -a: 07:23:36 Linux prd-queue-disttest-2c-1g-23010 6.8.0-90-generic #91-Ubuntu SMP PREEMPT_DYNAMIC Tue Nov 18 14:14:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux 07:23:36 07:23:36 07:23:36 ---> lscpu: 07:23:36 Architecture: x86_64 07:23:36 CPU op-mode(s): 32-bit, 64-bit 07:23:36 Address sizes: 40 bits physical, 48 bits virtual 07:23:36 Byte Order: Little Endian 07:23:36 CPU(s): 2 07:23:36 On-line CPU(s) list: 0,1 07:23:36 Vendor ID: AuthenticAMD 07:23:36 Model name: AMD EPYC-Rome Processor 07:23:36 CPU family: 23 07:23:36 Model: 49 07:23:36 Thread(s) per core: 1 07:23:36 Core(s) per socket: 1 07:23:36 Socket(s): 2 07:23:36 Stepping: 0 07:23:36 BogoMIPS: 5599.99 07:23:36 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities 07:23:36 Virtualization: AMD-V 07:23:36 Hypervisor vendor: KVM 07:23:36 Virtualization type: full 07:23:36 L1d cache: 64 KiB (2 instances) 07:23:36 L1i cache: 64 KiB (2 instances) 07:23:36 L2 cache: 1 MiB (2 instances) 07:23:36 L3 cache: 32 MiB (2 instances) 07:23:36 NUMA node(s): 1 07:23:36 NUMA node0 CPU(s): 0,1 07:23:36 Vulnerability Gather data sampling: Not affected 07:23:36 Vulnerability Itlb multihit: Not affected 07:23:36 Vulnerability L1tf: Not affected 07:23:36 Vulnerability Mds: Not affected 07:23:36 Vulnerability Meltdown: Not affected 07:23:36 Vulnerability Mmio stale data: Not affected 07:23:36 Vulnerability Reg file data sampling: Not affected 07:23:36 Vulnerability Retbleed: Mitigation; untrained return thunk; SMT disabled 07:23:36 Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode 07:23:36 Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl 07:23:36 Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization 07:23:36 Vulnerability Spectre v2: Mitigation; Retpolines; IBPB conditional; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected 07:23:36 Vulnerability Srbds: Not affected 07:23:36 Vulnerability Tsx async abort: Not affected 07:23:36 Vulnerability Vmscape: Not affected 07:23:36 07:23:36 07:23:36 ---> nproc: 07:23:36 2 07:23:36 07:23:36 07:23:36 ---> df -h: 07:23:36 Filesystem Size Used Avail Use% Mounted on 07:23:36 tmpfs 795M 1.1M 794M 1% /run 07:23:36 /dev/vda1 38G 7.8G 30G 21% / 07:23:36 tmpfs 3.9G 0 3.9G 0% /dev/shm 07:23:36 tmpfs 5.0M 0 5.0M 0% /run/lock 07:23:36 /dev/vda16 881M 117M 703M 15% /boot 07:23:36 /dev/vda15 105M 6.2M 99M 6% /boot/efi 07:23:36 tmpfs 795M 16K 795M 1% /run/user/1001 07:23:36 07:23:36 07:23:36 ---> free -m: 07:23:36 total used free shared buff/cache available 07:23:36 Mem: 7941 696 5427 4 2105 7245 07:23:36 Swap: 1023 0 1023 07:23:36 07:23:36 07:23:36 ---> ip addr: 07:23:36 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 07:23:36 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 07:23:36 inet 127.0.0.1/8 scope host lo 07:23:36 valid_lft forever preferred_lft forever 07:23:36 inet6 ::1/128 scope host noprefixroute 07:23:36 valid_lft forever preferred_lft forever 07:23:36 2: ens3: mtu 1458 qdisc mq state UP group default qlen 1000 07:23:36 link/ether fa:16:3e:4b:d3:40 brd ff:ff:ff:ff:ff:ff 07:23:36 altname enp0s3 07:23:36 inet 10.30.170.117/23 metric 100 brd 10.30.171.255 scope global dynamic ens3 07:23:36 valid_lft 80702sec preferred_lft 80702sec 07:23:36 inet6 fe80::f816:3eff:fe4b:d340/64 scope link 07:23:36 valid_lft forever preferred_lft forever 07:23:36 07:23:36 07:23:36 ---> sar -b -r -n DEV: 07:23:36 Linux 6.8.0-90-generic (prd-queue-disttest-2c-1g-23010) 06/03/26 _x86_64_ (2 CPU) 07:23:36 07:23:36 05:48:40 LINUX RESTART (2 CPU) 07:23:36 07:23:36 05:50:02 tps rtps wtps dtps bread/s bwrtn/s bdscd/s 07:23:36 06:00:09 4.21 0.28 3.83 0.11 31.86 1167.82 2.08 07:23:36 06:10:09 1.44 0.01 1.42 0.02 0.05 16.57 1.21 07:23:36 06:20:09 1.39 0.00 1.37 0.02 0.01 15.80 1.20 07:23:36 06:30:09 1.63 0.01 1.59 0.03 0.09 19.33 1.51 07:23:36 06:40:08 1.41 0.00 1.39 0.02 0.00 15.90 1.08 07:23:36 06:50:09 1.39 0.00 1.38 0.02 0.00 15.69 1.20 07:23:36 07:00:09 14.78 0.02 1.79 12.97 0.75 21.04 107517.25 07:23:36 07:10:09 1.40 0.00 1.39 0.02 0.00 16.03 1.20 07:23:36 07:20:08 1.40 0.00 1.39 0.02 0.00 16.06 1.20 07:23:36 Average: 3.23 0.04 1.73 1.47 3.68 146.25 11933.14 07:23:36 07:23:36 05:50:02 kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 07:23:36 06:00:09 5657944 7479884 307068 3.78 63228 1935440 727520 7.92 474748 1707000 168 07:23:36 06:10:09 5657696 7480168 306548 3.77 63436 1935780 727516 7.92 474864 1707528 288 07:23:36 06:20:09 5657696 7480672 306044 3.76 63616 1936092 727652 7.93 474968 1708028 176 07:23:36 06:30:09 5664272 7487860 298832 3.67 63824 1936448 727740 7.93 474992 1708604 172 07:23:36 06:40:08 5671612 7495712 290964 3.58 64004 1936788 727740 7.93 475160 1709112 156 07:23:36 06:50:09 5670916 7495624 291060 3.58 64152 1937228 727740 7.93 475304 1709584 140 07:23:36 07:00:09 5669160 7494620 291928 3.59 64344 1937776 727748 7.93 475508 1710176 156 07:23:36 07:10:09 5671944 7497908 288636 3.55 64512 1938108 727740 7.93 475420 1710676 160 07:23:36 07:20:08 5679280 7505728 280772 3.45 64668 1938432 727740 7.93 475584 1711156 124 07:23:36 Average: 5666724 7490908 295761 3.64 63976 1936899 727682 7.93 475172 1709096 171 07:23:36 07:23:36 05:50:02 IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 07:23:36 06:00:09 lo 1.02 1.02 0.05 0.05 0.00 0.00 0.00 0.00 07:23:36 06:00:09 ens3 3.05 0.36 3.51 0.12 0.00 0.00 0.00 0.00 07:23:36 06:10:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 07:23:36 06:10:09 ens3 1.14 0.04 0.11 0.01 0.00 0.00 0.00 0.00 07:23:36 06:20:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 07:23:36 06:20:09 ens3 0.40 0.08 0.09 0.04 0.00 0.00 0.00 0.00 07:23:36 06:30:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 07:23:36 06:30:09 ens3 0.44 0.05 4.59 0.03 0.00 0.00 0.00 0.00 07:23:36 06:40:08 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 07:23:36 06:40:08 ens3 0.66 0.18 0.23 0.14 0.00 0.00 0.00 0.00 07:23:36 06:50:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 07:23:36 06:50:09 ens3 0.67 0.09 0.12 0.05 0.00 0.00 0.00 0.00 07:23:36 07:00:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 07:23:36 07:00:09 ens3 0.25 0.08 0.07 0.04 0.00 0.00 0.00 0.00 07:23:36 07:10:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 07:23:36 07:10:09 ens3 0.50 0.08 0.75 0.05 0.00 0.00 0.00 0.00 07:23:36 07:20:08 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 07:23:36 07:20:08 ens3 0.26 0.05 0.07 0.03 0.00 0.00 0.00 0.00 07:23:36 Average: lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 07:23:36 Average: ens3 0.82 0.11 1.06 0.06 0.00 0.00 0.00 0.00 07:23:36 07:23:36 07:23:36 ---> sar -P ALL: 07:23:36 Linux 6.8.0-90-generic (prd-queue-disttest-2c-1g-23010) 06/03/26 _x86_64_ (2 CPU) 07:23:36 07:23:36 05:48:40 LINUX RESTART (2 CPU) 07:23:36 07:23:36 05:50:02 CPU %user %nice %system %iowait %steal %idle 07:23:36 06:00:09 all 0.40 0.00 0.26 0.05 0.03 99.27 07:23:36 06:00:09 0 0.35 0.00 0.26 0.03 0.03 99.33 07:23:36 06:00:09 1 0.44 0.00 0.25 0.07 0.02 99.21 07:23:36 06:10:09 all 0.26 0.00 0.08 0.01 0.03 99.62 07:23:36 06:10:09 0 0.18 0.00 0.08 0.01 0.03 99.70 07:23:36 06:10:09 1 0.34 0.00 0.08 0.01 0.03 99.54 07:23:36 06:20:09 all 0.24 0.00 0.07 0.01 0.03 99.66 07:23:36 06:20:09 0 0.40 0.00 0.04 0.01 0.02 99.53 07:23:36 06:20:09 1 0.09 0.00 0.09 0.01 0.04 99.78 07:23:36 06:30:09 all 0.28 0.00 0.16 0.01 0.03 99.53 07:23:36 06:30:09 0 0.06 0.00 0.18 0.01 0.03 99.72 07:23:36 06:30:09 1 0.50 0.00 0.13 0.01 0.03 99.33 07:23:36 06:40:08 all 0.24 0.00 0.07 0.01 0.03 99.66 07:23:36 06:40:08 0 0.15 0.00 0.08 0.01 0.03 99.73 07:23:36 06:40:08 1 0.33 0.00 0.05 0.01 0.03 99.58 07:23:36 06:50:09 all 0.26 0.00 0.06 0.02 0.02 99.64 07:23:36 06:50:09 0 0.24 0.00 0.06 0.01 0.02 99.67 07:23:36 06:50:09 1 0.28 0.00 0.07 0.03 0.03 99.60 07:23:36 07:00:09 all 0.29 0.00 0.20 0.03 0.02 99.46 07:23:36 07:00:09 0 0.45 0.00 0.17 0.02 0.02 99.35 07:23:36 07:00:09 1 0.13 0.00 0.22 0.04 0.02 99.58 07:23:36 07:10:09 all 0.24 0.00 0.07 0.01 0.03 99.66 07:23:36 07:10:09 0 0.06 0.00 0.07 0.01 0.03 99.82 07:23:36 07:10:09 1 0.42 0.00 0.06 0.00 0.02 99.49 07:23:36 07:20:08 all 0.24 0.00 0.07 0.02 0.03 99.65 07:23:36 07:20:08 0 0.05 0.00 0.08 0.03 0.03 99.81 07:23:36 07:20:08 1 0.43 0.00 0.05 0.00 0.02 99.50 07:23:36 Average: all 0.27 0.00 0.11 0.02 0.03 99.57 07:23:36 Average: 0 0.22 0.00 0.12 0.01 0.03 99.63 07:23:36 Average: 1 0.33 0.00 0.11 0.02 0.03 99.51 07:23:36 07:23:36 07:23:36