00:33:38 Started by upstream project "autorelease-release-vanadium-mvn39-openjdk21" build number 332 00:33:38 originally caused by: 00:33:38 Started by timer 00:33:38 Running as SYSTEM 00:33:38 [EnvInject] - Loading node environment variables. 00:33:38 Building remotely on prd-queue-disttest-2c-1g-30569 (queue-disttest-2c-1g) in workspace /w/workspace/integration-distribution-test-vanadium 00:33:38 [ssh-agent] Looking for ssh-agent implementation... 00:33:38 [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) 00:33:38 $ ssh-agent 00:33:38 SSH_AUTH_SOCK=/tmp/ssh-2ejSkiYB0eMl/agent.3113 00:33:38 SSH_AGENT_PID=3115 00:33:38 [ssh-agent] Started. 00:33:38 Running ssh-add (command line suppressed) 00:33:38 Identity added: /w/workspace/integration-distribution-test-vanadium@tmp/private_key_9644103277668148499.key (/w/workspace/integration-distribution-test-vanadium@tmp/private_key_9644103277668148499.key) 00:33:38 [ssh-agent] Using credentials jenkins (jenkins-ssh) 00:33:38 No emails were triggered. 00:33:38 provisioning config files... 00:33:38 copy managed file [npmrc] to file:/home/jenkins/.npmrc 00:33:38 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 00:33:38 [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins2011780422197061475.sh 00:33:38 ---> python-tools-install.sh 00:33:38 Setup pyenv: 00:33:38 * system (set by /opt/pyenv/version) 00:33:38 * 3.8.20 (set by /opt/pyenv/version) 00:33:38 * 3.9.20 (set by /opt/pyenv/version) 00:33:38 3.10.15 00:33:38 3.11.10 00:33:43 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-wply 00:33:43 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 00:33:43 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 00:33:43 lf-activate-venv(): INFO: Attempting to install with network-safe options... 00:33:48 lf-activate-venv(): INFO: Base packages installed successfully 00:33:48 lf-activate-venv(): INFO: Installing additional packages: lftools 00:34:12 lf-activate-venv(): INFO: Adding /tmp/venv-wply/bin to PATH 00:34:12 Generating Requirements File 00:34:38 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 00:34:38 httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible. 00:34:38 Python 3.11.10 00:34:39 pip 26.1.2 from /tmp/venv-wply/lib/python3.11/site-packages/pip (python 3.11) 00:34:39 aiohappyeyeballs==2.6.2 00:34:39 aiohttp==3.14.1 00:34:39 aiosignal==1.4.0 00:34:39 appdirs==1.4.4 00:34:39 argcomplete==3.6.3 00:34:39 aspy.yaml==1.3.0 00:34:39 attrs==26.1.0 00:34:39 autopage==0.6.0 00:34:39 beautifulsoup4==4.15.0 00:34:39 boto3==1.43.36 00:34:39 botocore==1.43.36 00:34:39 bs4==0.0.2 00:34:39 certifi==2026.6.17 00:34:39 cffi==2.0.0 00:34:39 cfgv==3.5.0 00:34:39 chardet==7.4.3 00:34:39 charset-normalizer==3.4.7 00:34:39 click==8.4.2 00:34:39 cliff==4.14.0 00:34:39 cmd2==4.0.0 00:34:39 cryptography==3.3.2 00:34:39 debtcollector==3.1.0 00:34:39 decorator==5.3.1 00:34:39 defusedxml==0.7.1 00:34:39 Deprecated==1.3.1 00:34:39 distlib==0.4.3 00:34:39 dnspython==2.8.0 00:34:39 docker==7.1.0 00:34:39 dogpile.cache==1.5.0 00:34:39 durationpy==0.10 00:34:39 email-validator==2.3.0 00:34:39 filelock==3.29.4 00:34:39 frozenlist==1.8.0 00:34:39 future==1.0.0 00:34:39 gitdb==4.0.12 00:34:39 GitPython==3.1.50 00:34:39 httplib2==0.30.2 00:34:39 identify==2.6.19 00:34:39 idna==3.18 00:34:39 importlib-resources==1.5.0 00:34:39 iso8601==2.1.0 00:34:39 Jinja2==3.1.6 00:34:39 jmespath==1.1.0 00:34:39 jsonpatch==1.33 00:34:39 jsonpointer==3.1.1 00:34:39 jsonschema==4.26.0 00:34:39 jsonschema-specifications==2025.9.1 00:34:39 keystoneauth1==5.14.0 00:34:39 kubernetes==36.0.2 00:34:39 lftools==0.37.22 00:34:39 lxml==6.1.1 00:34:39 markdown-it-py==4.2.0 00:34:39 MarkupSafe==3.0.3 00:34:39 mdurl==0.1.2 00:34:39 msgpack==1.2.1 00:34:39 multi_key_dict==2.0.3 00:34:39 multidict==6.7.1 00:34:39 munch==4.0.0 00:34:39 netaddr==1.3.0 00:34:39 niet==1.4.2 00:34:39 nodeenv==1.10.0 00:34:39 oauth2client==4.1.3 00:34:39 oauthlib==3.3.1 00:34:39 openstacksdk==4.17.0 00:34:39 os-service-types==1.8.2 00:34:39 osc-lib==4.6.0 00:34:39 oslo.config==10.5.0 00:34:39 oslo.context==6.4.0 00:34:39 oslo.i18n==6.8.0 00:34:39 oslo.log==8.2.0 00:34:39 oslo.serialization==5.10.0 00:34:39 oslo.utils==10.1.1 00:34:39 packaging==26.2 00:34:39 pbr==7.0.3 00:34:39 platformdirs==4.10.0 00:34:39 prettytable==3.18.0 00:34:39 prompt_toolkit==3.0.52 00:34:39 propcache==0.5.2 00:34:39 psutil==7.2.2 00:34:39 pyasn1==0.6.3 00:34:39 pyasn1_modules==0.4.2 00:34:39 pycparser==3.0 00:34:39 pygerrit2==2.0.15 00:34:39 PyGithub==2.9.1 00:34:39 Pygments==2.20.0 00:34:39 PyJWT==2.13.0 00:34:39 PyNaCl==1.6.2 00:34:39 pyparsing==2.4.7 00:34:39 pyperclip==1.11.0 00:34:39 pyrsistent==0.20.0 00:34:39 python-cinderclient==9.9.0 00:34:39 python-dateutil==2.9.0.post0 00:34:39 python-discovery==1.4.2 00:34:39 python-heatclient==5.2.0 00:34:39 python-jenkins==1.8.3 00:34:39 python-keystoneclient==5.8.0 00:34:39 python-magnumclient==4.10.0 00:34:39 python-openstackclient==10.1.0 00:34:39 python-swiftclient==4.10.0 00:34:39 PyYAML==6.0.3 00:34:39 referencing==0.37.0 00:34:39 requests==2.34.2 00:34:39 requests-oauthlib==2.0.0 00:34:39 rfc3986==2.0.0 00:34:39 rich==15.0.0 00:34:39 rich-argparse==1.8.0 00:34:39 rpds-py==2026.5.1 00:34:39 rsa==4.9.1 00:34:39 ruamel.yaml==0.19.1 00:34:39 ruamel.yaml.clib==0.2.15 00:34:39 s3transfer==0.19.0 00:34:39 simplejson==4.1.1 00:34:39 six==1.17.0 00:34:39 smmap==5.0.3 00:34:39 soupsieve==2.8.4 00:34:39 stevedore==5.8.0 00:34:39 tabulate==0.10.0 00:34:39 toml==0.10.2 00:34:39 tomlkit==0.15.0 00:34:39 tqdm==4.68.3 00:34:39 typing_extensions==4.15.0 00:34:39 urllib3==1.26.20 00:34:39 virtualenv==21.5.1 00:34:39 wcwidth==0.8.1 00:34:39 websocket-client==1.9.0 00:34:39 wrapt==2.2.2 00:34:39 xdg==6.0.0 00:34:39 xmltodict==1.0.4 00:34:39 yarl==1.24.2 00:34:39 yq==3.4.3 00:34:39 [integration-distribution-test-vanadium] $ /bin/sh /tmp/jenkins4098080655944438529.sh 00:34:39 ---> uv-install.sh 00:34:39 Installing uv/uvx (latest) using shell installer 00:34:39 2026-06-26 00:34:39 URL:https://releases.astral.sh/installers/uv/latest/uv-installer.sh [71233/71233] -> "/tmp/uv-install-xhpqH9.sh" [1] 00:34:39 downloading uv 0.11.24 x86_64-unknown-linux-gnu 00:34:40 installing to /home/jenkins/.local/bin 00:34:40 uv 00:34:40 uvx 00:34:40 everything's installed! 00:34:40 00:34:40 To add $HOME/.local/bin to your PATH, either restart your shell or run: 00:34:40 00:34:40 source $HOME/.local/bin/env (sh, bash, zsh) 00:34:40 source $HOME/.local/bin/env.fish (fish) 00:34:40 Adding install location to PATH 00:34:40 ---> Validating uv/uvx install 00:34:40 uvx 0.11.24 (x86_64-unknown-linux-gnu) 00:34:40 Waiting for the completion of bgpcep-csit-1node-bgp-ingest-all-vanadium 00:34:40 bgpcep-csit-1node-bgp-ingest-all-vanadium #321 started. 01:36:27 bgpcep-csit-1node-bgp-ingest-all-vanadium #321 completed. Result was UNSTABLE 01:36:27 Waiting for the completion of bgpcep-csit-1node-bgp-ingest-mixed-all-vanadium 01:36:27 bgpcep-csit-1node-bgp-ingest-mixed-all-vanadium #321 started. 01:36:27 bgpcep-csit-1node-bgp-ingest-mixed-all-vanadium #321 completed. Result was UNSTABLE 01:36:27 Waiting for the completion of bgpcep-csit-1node-throughpcep-all-vanadium 01:36:27 bgpcep-csit-1node-throughpcep-all-vanadium #321 started. 01:36:27 bgpcep-csit-1node-throughpcep-all-vanadium #321 completed. Result was UNSTABLE 01:36:27 Waiting for the completion of bgpcep-csit-1node-userfeatures-all-vanadium 01:36:27 bgpcep-csit-1node-userfeatures-all-vanadium #321 started. 01:36:27 bgpcep-csit-1node-userfeatures-all-vanadium #321 completed. Result was UNSTABLE 01:36:27 Waiting for the completion of daexim-csit-1node-basic-only-vanadium 01:36:27 daexim-csit-1node-basic-only-vanadium #321 started. 01:36:27 daexim-csit-1node-basic-only-vanadium #321 completed. Result was UNSTABLE 01:36:27 Waiting for the completion of daexim-csit-3node-clustering-basic-only-vanadium 01:36:27 daexim-csit-3node-clustering-basic-only-vanadium #321 started. 01:36:27 daexim-csit-3node-clustering-basic-only-vanadium #321 completed. Result was UNSTABLE 01:36:27 Waiting for the completion of distribution-csit-managed-vanadium 01:36:27 distribution-csit-managed-vanadium #321 started. 01:36:27 distribution-csit-managed-vanadium #321 completed. Result was SUCCESS 01:36:27 Waiting for the completion of jsonrpc-csit-1node-basic-only-vanadium 01:36:27 jsonrpc-csit-1node-basic-only-vanadium #322 started. 01:36:27 jsonrpc-csit-1node-basic-only-vanadium #322 completed. Result was UNSTABLE 01:36:27 Waiting for the completion of openflowplugin-csit-1node-cbench-only-vanadium 01:36:27 openflowplugin-csit-1node-cbench-only-vanadium #321 started. 01:36:27 openflowplugin-csit-1node-cbench-only-vanadium #321 completed. Result was UNSTABLE 01:36:27 Waiting for the completion of openflowplugin-csit-1node-flow-services-all-vanadium 01:36:27 openflowplugin-csit-1node-flow-services-all-vanadium #321 started. 01:36:27 openflowplugin-csit-1node-flow-services-all-vanadium #321 completed. Result was UNSTABLE 01:36:27 Waiting for the completion of openflowplugin-csit-1node-perf-bulkomatic-only-vanadium 01:36:27 openflowplugin-csit-1node-perf-bulkomatic-only-vanadium #321 started. 01:36:27 openflowplugin-csit-1node-perf-bulkomatic-only-vanadium #321 completed. Result was UNSTABLE 01:36:27 Waiting for the completion of openflowplugin-csit-1node-perf-stats-collection-only-vanadium 01:36:27 openflowplugin-csit-1node-perf-stats-collection-only-vanadium #321 started. 01:36:27 openflowplugin-csit-1node-perf-stats-collection-only-vanadium #321 completed. Result was UNSTABLE 01:36:27 Waiting for the completion of openflowplugin-csit-1node-scale-link-only-vanadium 01:36:27 openflowplugin-csit-1node-scale-link-only-vanadium #321 started. 01:36:27 openflowplugin-csit-1node-scale-link-only-vanadium #321 completed. Result was UNSTABLE 01:36:27 Waiting for the completion of openflowplugin-csit-1node-scale-only-vanadium 01:36:27 openflowplugin-csit-1node-scale-only-vanadium #321 started. 01:36:27 openflowplugin-csit-1node-scale-only-vanadium #321 completed. Result was UNSTABLE 01:36:27 Waiting for the completion of openflowplugin-csit-1node-scale-switch-only-vanadium 01:36:27 openflowplugin-csit-1node-scale-switch-only-vanadium #321 started. 01:36:27 openflowplugin-csit-1node-scale-switch-only-vanadium #321 completed. Result was UNSTABLE 01:36:27 Waiting for the completion of openflowplugin-csit-3node-clustering-bulkomatic-only-vanadium 01:36:27 openflowplugin-csit-3node-clustering-bulkomatic-only-vanadium #321 started. 01:36:27 openflowplugin-csit-3node-clustering-bulkomatic-only-vanadium #321 completed. Result was UNSTABLE 01:36:27 Waiting for the completion of openflowplugin-csit-3node-clustering-only-vanadium 01:36:27 openflowplugin-csit-3node-clustering-only-vanadium #321 started. 01:36:27 openflowplugin-csit-3node-clustering-only-vanadium #321 completed. Result was UNSTABLE 01:36:27 Waiting for the completion of openflowplugin-csit-3node-clustering-perf-bulkomatic-only-vanadium 01:36:27 openflowplugin-csit-3node-clustering-perf-bulkomatic-only-vanadium #321 started. 01:36:27 openflowplugin-csit-3node-clustering-perf-bulkomatic-only-vanadium #321 completed. Result was UNSTABLE 01:36:27 Waiting for the completion of ovsdb-csit-1node-upstream-southbound-all-vanadium 01:36:27 ovsdb-csit-1node-upstream-southbound-all-vanadium #322 started. 01:36:27 ovsdb-csit-1node-upstream-southbound-all-vanadium #322 completed. Result was UNSTABLE 01:36:27 Waiting for the completion of ovsdb-csit-3node-upstream-clustering-only-vanadium 01:36:27 ovsdb-csit-3node-upstream-clustering-only-vanadium #321 started. 01:36:27 ovsdb-csit-3node-upstream-clustering-only-vanadium #321 completed. Result was FAILURE 01:36:27 Build step 'Trigger/call builds on other projects' changed build result to UNSTABLE 01:36:27 Build step 'Trigger/call builds on other projects' marked build as failure 01:36:27 $ ssh-agent -k 01:36:27 unset SSH_AUTH_SOCK; 01:36:27 unset SSH_AGENT_PID; 01:36:27 echo Agent pid 3115 killed; 01:36:27 [ssh-agent] Stopped. 01:36:27 [PostBuildScript] - [INFO] Executing post build scripts. 01:36:27 [integration-distribution-test-vanadium] $ /bin/sh /tmp/jenkins1452539301387959235.sh 01:36:39 python /tmp/tmp.LT7h8HmKV7 https://jenkins.opendaylight.org/releng/job/integration-distribution-test-vanadium/323/ 01:36:39 /tmp/tmp.LT7h8HmKV7:26: DeprecationWarning: Call to deprecated method findAll. (Replaced by find_all) -- Deprecated since version 4.0.0. 01:36:39 links = soup.findAll("a", { "class" : "model-link" }) 01:36:39 [PostBuildScript] - [INFO] Executing post build scripts. 01:36:39 [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins13670214950586526763.sh 01:36:39 ---> sysstat.sh 01:36:39 /tmp/jenkins13670214950586526763.sh: line 19: facter: command not found 01:36:39 [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins13774139207955470492.sh 01:36:39 ---> package-listing.sh 01:36:39 ++ facter osfamily 01:36:39 /tmp/jenkins13774139207955470492.sh: line 19: facter: command not found 01:36:39 ++ tr '[:upper:]' '[:lower:]' 01:36:39 + OS_FAMILY= 01:36:39 [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins5927289904678115527.sh 01:36:39 ---> capture-instance-metadata.sh 01:36:39 Setup pyenv: 01:36:39 system 01:36:39 3.8.20 01:36:39 3.9.20 01:36:39 3.10.15 01:36:39 * 3.11.10 (set by /w/workspace/integration-distribution-test-vanadium/.python-version) 01:36:40 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-wply from file:/tmp/.os_lf_venv 01:36:40 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 01:36:40 lf-activate-venv(): INFO: Attempting to install with network-safe options... 01:36:42 lf-activate-venv(): INFO: Base packages installed successfully 01:36:42 lf-activate-venv(): INFO: Installing additional packages: lftools 01:36:59 lf-activate-venv(): INFO: Adding /tmp/venv-wply/bin to PATH 01:36:59 INFO: Running in OpenStack, capturing instance metadata 01:36:59 [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins14621044779371791307.sh 01:36:59 provisioning config files... 01:37:00 Could not find credentials [logs] for integration-distribution-test-vanadium #323 01:37:00 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/integration-distribution-test-vanadium@tmp/config1819935968551328283tmp 01:37:00 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] 01:37:00 Run condition [Regular expression match] enabling perform for step [Provide Configuration files] 01:37:00 provisioning config files... 01:37:00 copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials 01:37:00 [EnvInject] - Injecting environment variables from a build step. 01:37:00 [EnvInject] - Injecting as environment variables the properties content 01:37:00 SERVER_ID=logs 01:37:00 01:37:00 [EnvInject] - Variables injected successfully. 01:37:00 [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins17119136430501616427.sh 01:37:00 ---> create-netrc.sh 01:37:00 WARN: Log server credential not found. 01:37:00 [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins7455926676338213910.sh 01:37:00 ---> python-tools-install.sh 01:37:00 Setup pyenv: 01:37:00 system 01:37:01 3.8.20 01:37:01 3.9.20 01:37:01 3.10.15 01:37:01 * 3.11.10 (set by /w/workspace/integration-distribution-test-vanadium/.python-version) 01:37:01 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-wply from file:/tmp/.os_lf_venv 01:37:01 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 01:37:01 lf-activate-venv(): INFO: Attempting to install with network-safe options... 01:37:03 lf-activate-venv(): INFO: Base packages installed successfully 01:37:03 lf-activate-venv(): INFO: Installing additional packages: lftools 01:37:13 lf-activate-venv(): INFO: Adding /tmp/venv-wply/bin to PATH 01:37:13 [integration-distribution-test-vanadium] $ /bin/sh /tmp/jenkins8833289026502072402.sh 01:37:13 ---> uv-install.sh 01:37:13 uv 0.11.24 is already installed 01:37:13 uvx 0.11.24 (x86_64-unknown-linux-gnu) 01:37:13 [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins9307541103148867403.sh 01:37:13 ---> sudo-logs.sh 01:37:13 Archiving 'sudo' log.. 01:37:13 /tmp/jenkins9307541103148867403.sh: line 41: facter: command not found 01:37:13 [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins10692556313958728372.sh 01:37:13 ---> job-cost.sh 01:37:13 INFO: Activating Python virtual environment... 01:37:13 Setup pyenv: 01:37:13 system 01:37:13 3.8.20 01:37:13 3.9.20 01:37:13 3.10.15 01:37:13 * 3.11.10 (set by /w/workspace/integration-distribution-test-vanadium/.python-version) 01:37:13 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-wply from file:/tmp/.os_lf_venv 01:37:13 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 01:37:13 lf-activate-venv(): INFO: Attempting to install with network-safe options... 01:37:15 lf-activate-venv(): INFO: Base packages installed successfully 01:37:15 lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 01:37:21 lf-activate-venv(): INFO: Adding /tmp/venv-wply/bin to PATH 01:37:21 INFO: No stack-cost file found 01:37:21 INFO: Instance uptime: 3857s 01:37:21 INFO: Fetching instance metadata (attempt 1 of 3)... 01:37:21 DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type 01:37:22 INFO: Successfully fetched instance metadata 01:37:22 INFO: Instance type: v3-standard-2 01:37:22 INFO: Retrieving pricing info for: v3-standard-2 01:37:22 INFO: Fetching Vexxhost pricing API (attempt 1 of 3)... 01:37:22 DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-standard-2/cost?seconds=3857 01:37:22 INFO: Successfully fetched Vexxhost pricing API 01:37:22 INFO: Retrieved cost: 0.11 01:37:22 INFO: Retrieved resource: v3-standard-2 01:37:22 INFO: Creating archive directory: /w/workspace/integration-distribution-test-vanadium/archives/cost 01:37:22 INFO: Archiving costs to: /w/workspace/integration-distribution-test-vanadium/archives/cost.csv 01:37:22 INFO: Successfully archived job cost data 01:37:22 DEBUG: Cost data: integration-distribution-test-vanadium,323,2026-06-26 01:37:22,v3-standard-2,3857,0.11,0.00,FAILURE 01:37:22 [integration-distribution-test-vanadium] $ /bin/bash -l /tmp/jenkins5957153266710097098.sh 01:37:22 ---> logs-deploy.sh 01:37:22 Setup pyenv: 01:37:22 system 01:37:22 3.8.20 01:37:22 3.9.20 01:37:22 3.10.15 01:37:22 * 3.11.10 (set by /w/workspace/integration-distribution-test-vanadium/.python-version) 01:37:22 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-wply from file:/tmp/.os_lf_venv 01:37:22 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 01:37:22 lf-activate-venv(): INFO: Attempting to install with network-safe options... 01:37:24 lf-activate-venv(): INFO: Base packages installed successfully 01:37:24 lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 01:37:34 lf-activate-venv(): INFO: Adding /tmp/venv-wply/bin to PATH 01:37:34 WARNING: Nexus logging server not set 01:37:34 INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/integration-distribution-test-vanadium/323/ 01:37:34 INFO: archiving logs to S3 01:37:36 ---> uname -a: 01:37:36 Linux prd-queue-disttest-2c-1g-30569 6.8.0-90-generic #91-Ubuntu SMP PREEMPT_DYNAMIC Tue Nov 18 14:14:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux 01:37:36 01:37:36 01:37:36 ---> lscpu: 01:37:36 Architecture: x86_64 01:37:36 CPU op-mode(s): 32-bit, 64-bit 01:37:36 Address sizes: 40 bits physical, 48 bits virtual 01:37:36 Byte Order: Little Endian 01:37:36 CPU(s): 2 01:37:36 On-line CPU(s) list: 0,1 01:37:36 Vendor ID: AuthenticAMD 01:37:36 Model name: AMD EPYC-Rome Processor 01:37:36 CPU family: 23 01:37:36 Model: 49 01:37:36 Thread(s) per core: 1 01:37:36 Core(s) per socket: 1 01:37:36 Socket(s): 2 01:37:36 Stepping: 0 01:37:36 BogoMIPS: 5600.00 01:37:36 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities 01:37:36 Virtualization: AMD-V 01:37:36 Hypervisor vendor: KVM 01:37:36 Virtualization type: full 01:37:36 L1d cache: 64 KiB (2 instances) 01:37:36 L1i cache: 64 KiB (2 instances) 01:37:36 L2 cache: 1 MiB (2 instances) 01:37:36 L3 cache: 32 MiB (2 instances) 01:37:36 NUMA node(s): 1 01:37:36 NUMA node0 CPU(s): 0,1 01:37:36 Vulnerability Gather data sampling: Not affected 01:37:36 Vulnerability Itlb multihit: Not affected 01:37:36 Vulnerability L1tf: Not affected 01:37:36 Vulnerability Mds: Not affected 01:37:36 Vulnerability Meltdown: Not affected 01:37:36 Vulnerability Mmio stale data: Not affected 01:37:36 Vulnerability Reg file data sampling: Not affected 01:37:36 Vulnerability Retbleed: Mitigation; untrained return thunk; SMT disabled 01:37:36 Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode 01:37:36 Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl 01:37:36 Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization 01:37:36 Vulnerability Spectre v2: Mitigation; Retpolines; IBPB conditional; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected 01:37:36 Vulnerability Srbds: Not affected 01:37:36 Vulnerability Tsx async abort: Not affected 01:37:36 Vulnerability Vmscape: Not affected 01:37:36 01:37:36 01:37:36 ---> nproc: 01:37:36 2 01:37:36 01:37:36 01:37:36 ---> df -h: 01:37:36 Filesystem Size Used Avail Use% Mounted on 01:37:36 tmpfs 795M 1.1M 794M 1% /run 01:37:36 /dev/vda1 38G 7.8G 30G 21% / 01:37:36 tmpfs 3.9G 0 3.9G 0% /dev/shm 01:37:36 tmpfs 5.0M 0 5.0M 0% /run/lock 01:37:36 /dev/vda16 881M 117M 703M 15% /boot 01:37:36 /dev/vda15 105M 6.2M 99M 6% /boot/efi 01:37:36 tmpfs 795M 16K 795M 1% /run/user/1001 01:37:36 01:37:36 01:37:36 ---> free -m: 01:37:36 total used free shared buff/cache available 01:37:36 Mem: 7941 711 5429 4 2088 7229 01:37:36 Swap: 1023 0 1023 01:37:36 01:37:36 01:37:36 ---> ip addr: 01:37:36 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 01:37:36 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 01:37:36 inet 127.0.0.1/8 scope host lo 01:37:36 valid_lft forever preferred_lft forever 01:37:36 inet6 ::1/128 scope host noprefixroute 01:37:36 valid_lft forever preferred_lft forever 01:37:36 2: ens3: mtu 1458 qdisc mq state UP group default qlen 1000 01:37:36 link/ether fa:16:3e:58:d2:7e brd ff:ff:ff:ff:ff:ff 01:37:36 altname enp0s3 01:37:36 inet 10.30.170.33/23 metric 100 brd 10.30.171.255 scope global dynamic ens3 01:37:36 valid_lft 82541sec preferred_lft 82541sec 01:37:36 inet6 fe80::f816:3eff:fe58:d27e/64 scope link 01:37:36 valid_lft forever preferred_lft forever 01:37:36 01:37:36 01:37:36 ---> sar -b -r -n DEV: 01:37:36 Linux 6.8.0-90-generic (prd-queue-disttest-2c-1g-30569) 06/26/26 _x86_64_ (2 CPU) 01:37:36 01:37:36 00:33:21 LINUX RESTART (2 CPU) 01:37:36 01:37:36 00:40:30 tps rtps wtps dtps bread/s bwrtn/s bdscd/s 01:37:36 00:50:29 1.23 0.01 1.22 0.00 0.05 14.90 0.24 01:37:36 01:00:30 1.33 0.00 1.32 0.01 0.00 16.34 0.25 01:37:36 01:10:31 1.25 0.00 1.24 0.01 0.00 15.18 0.72 01:37:36 01:20:12 1.25 0.00 1.23 0.02 0.01 14.81 1.24 01:37:36 01:30:30 1.93 0.25 1.65 0.04 30.07 75.31 1.45 01:37:36 Average: 1.40 0.05 1.33 0.02 6.21 27.67 0.78 01:37:36 01:37:36 00:40:30 kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 01:37:36 00:50:29 5691984 7495072 291112 3.58 63524 1916196 535824 5.84 465328 1696324 212 01:37:36 01:00:30 5685196 7488772 297432 3.66 63668 1916524 535824 5.84 465456 1696800 220 01:37:36 01:10:31 5683772 7487836 298400 3.67 63832 1916848 536096 5.84 465752 1697288 144 01:37:36 01:20:12 5683268 7487800 298436 3.67 64000 1917148 536096 5.84 465876 1697756 184 01:37:36 01:30:30 5637672 7469280 316396 3.89 64320 1943632 734040 8.00 480236 1715668 132 01:37:36 Average: 5676378 7485752 300355 3.69 63869 1922070 575576 6.27 468530 1700767 178 01:37:36 01:37:36 00:40:30 IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 01:37:36 00:50:29 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 01:37:36 00:50:29 ens3 3.36 0.17 0.48 0.10 0.00 0.00 0.00 0.00 01:37:36 01:00:30 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 01:37:36 01:00:30 ens3 0.60 0.05 0.08 0.03 0.00 0.00 0.00 0.00 01:37:36 01:10:31 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 01:37:36 01:10:31 ens3 1.20 0.20 9.31 0.14 0.00 0.00 0.00 0.00 01:37:36 01:20:12 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 01:37:36 01:20:12 ens3 0.59 0.14 0.16 0.10 0.00 0.00 0.00 0.00 01:37:36 01:30:30 lo 1.02 1.02 0.05 0.05 0.00 0.00 0.00 0.00 01:37:36 01:30:30 ens3 0.88 0.49 3.14 0.06 0.00 0.00 0.00 0.00 01:37:36 Average: lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 01:37:36 Average: ens3 1.33 0.21 2.65 0.09 0.00 0.00 0.00 0.00 01:37:36 01:37:36 01:37:36 ---> sar -P ALL: 01:37:36 Linux 6.8.0-90-generic (prd-queue-disttest-2c-1g-30569) 06/26/26 _x86_64_ (2 CPU) 01:37:36 01:37:36 00:33:21 LINUX RESTART (2 CPU) 01:37:36 01:37:36 00:40:30 CPU %user %nice %system %iowait %steal %idle 01:37:36 00:50:29 all 0.27 0.00 0.08 0.01 0.03 99.62 01:37:36 00:50:29 0 0.45 0.00 0.09 0.01 0.02 99.43 01:37:36 00:50:29 1 0.09 0.00 0.07 0.01 0.03 99.80 01:37:36 01:00:30 all 0.26 0.00 0.15 0.04 0.02 99.54 01:37:36 01:00:30 0 0.30 0.00 0.15 0.07 0.02 99.46 01:37:36 01:00:30 1 0.22 0.00 0.14 0.01 0.03 99.61 01:37:36 01:10:31 all 0.24 0.00 0.06 0.01 0.05 99.64 01:37:36 01:10:31 0 0.30 0.00 0.05 0.01 0.07 99.56 01:37:36 01:10:31 1 0.18 0.00 0.07 0.01 0.03 99.72 01:37:36 01:20:12 all 0.22 0.00 0.07 1.01 0.02 98.67 01:37:36 01:20:12 0 0.05 0.00 0.10 1.98 0.03 97.84 01:37:36 01:20:12 1 0.39 0.00 0.04 0.05 0.01 99.51 01:37:36 01:30:30 all 0.39 0.00 0.19 0.32 0.02 99.08 01:37:36 01:30:30 0 0.30 0.00 0.24 0.53 0.02 98.92 01:37:36 01:30:30 1 0.49 0.00 0.15 0.10 0.01 99.25 01:37:36 Average: all 0.28 0.00 0.11 0.27 0.03 99.31 01:37:36 Average: 0 0.28 0.00 0.13 0.51 0.03 99.05 01:37:36 Average: 1 0.27 0.00 0.09 0.03 0.02 99.58 01:37:36 01:37:36 01:37:36