Started by upstream project "autorelease-release-chromium-mvn39-openjdk21" build number 76 originally caused by: Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on prd-queue-disttest-2c-1g-895 (queue-disttest-2c-1g) in workspace /w/workspace/integration-distribution-test-vanadium [ssh-agent] Looking for ssh-agent implementation... [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) $ ssh-agent SSH_AUTH_SOCK=/tmp/ssh-GGtrUhmLS2bL/agent.3138 SSH_AGENT_PID=3140 [ssh-agent] Started. Running ssh-add (command line suppressed) Identity added: /w/workspace/integration-distribution-test-vanadium@tmp/private_key_15331313988756702977.key (/w/workspace/integration-distribution-test-vanadium@tmp/private_key_15331313988756702977.key) [ssh-agent] Using credentials jenkins (jenkins-ssh) No emails were triggered. provisioning config files... copy managed file [npmrc] to file:/home/jenkins/.npmrc copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins13853987742145962508.sh ---> python-tools-install.sh Setup pyenv: * system (set by /opt/pyenv/version) * 3.8.20 (set by /opt/pyenv/version) * 3.9.20 (set by /opt/pyenv/version) 3.10.15 3.11.10 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-hBv1 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools lf-activate-venv(): INFO: Adding /tmp/venv-hBv1/bin to PATH Generating Requirements File WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/cryptography/3.3.2/cryptography-3.3.2-cp36-abi3-manylinux2010_x86_64.whl ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible. Python 3.11.10 pip 26.0.1 from /tmp/venv-hBv1/lib/python3.11/site-packages/pip (python 3.11) appdirs==1.4.4 argcomplete==3.6.3 aspy.yaml==1.3.0 attrs==26.1.0 autopage==0.6.0 beautifulsoup4==4.14.3 boto3==1.42.84 botocore==1.42.84 bs4==0.0.2 certifi==2026.2.25 cffi==2.0.0 cfgv==3.5.0 chardet==7.4.0.post2 charset-normalizer==3.4.7 click==8.3.2 cliff==4.13.2 cmd2==3.4.0 cryptography==3.3.2 debtcollector==3.1.0 decorator==5.2.1 defusedxml==0.7.1 Deprecated==1.3.1 distlib==0.4.0 dnspython==2.8.0 docker==7.1.0 dogpile.cache==1.5.0 durationpy==0.10 email-validator==2.3.0 filelock==3.25.2 future==1.0.0 gitdb==4.0.12 GitPython==3.1.46 httplib2==0.30.2 identify==2.6.18 idna==3.11 importlib-resources==1.5.0 iso8601==2.1.0 Jinja2==3.1.6 jmespath==1.1.0 jsonpatch==1.33 jsonpointer==3.1.1 jsonschema==4.26.0 jsonschema-specifications==2025.9.1 keystoneauth1==5.13.1 kubernetes==35.0.0 lftools==0.37.22 lxml==6.0.2 markdown-it-py==4.0.0 MarkupSafe==3.0.3 mdurl==0.1.2 msgpack==1.1.2 multi_key_dict==2.0.3 munch==4.0.0 netaddr==1.3.0 niet==1.4.2 nodeenv==1.10.0 oauth2client==4.1.3 oauthlib==3.3.1 openstacksdk==4.10.0 os-service-types==1.8.2 osc-lib==4.4.0 oslo.config==10.3.0 oslo.context==6.3.0 oslo.i18n==6.7.2 oslo.log==8.1.0 oslo.serialization==5.9.1 oslo.utils==10.0.0 packaging==26.0 pbr==7.0.3 platformdirs==4.9.4 prettytable==3.17.0 psutil==7.2.2 pyasn1==0.6.3 pyasn1_modules==0.4.2 pycparser==3.0 pygerrit2==2.0.15 PyGithub==2.9.0 Pygments==2.20.0 PyJWT==2.12.1 PyNaCl==1.6.2 pyparsing==2.4.7 pyperclip==1.11.0 pyrsistent==0.20.0 python-cinderclient==9.9.0 python-dateutil==2.9.0.post0 python-discovery==1.2.1 python-heatclient==5.1.0 python-jenkins==1.8.3 python-keystoneclient==5.8.0 python-magnumclient==4.10.0 python-openstackclient==9.0.0 python-swiftclient==4.10.0 PyYAML==6.0.3 referencing==0.37.0 requests==2.33.1 requests-oauthlib==2.0.0 requestsexceptions==1.4.0 rfc3986==2.0.0 rich==14.3.3 rich-argparse==1.7.2 rpds-py==0.30.0 rsa==4.9.1 ruamel.yaml==0.19.1 ruamel.yaml.clib==0.2.15 s3transfer==0.16.0 simplejson==3.20.2 six==1.17.0 smmap==5.0.3 soupsieve==2.8.3 stevedore==5.7.0 tabulate==0.10.0 toml==0.10.2 tomlkit==0.14.0 tqdm==4.67.3 typing_extensions==4.15.0 urllib3==1.26.20 virtualenv==21.2.0 wcwidth==0.6.0 websocket-client==1.9.0 wrapt==2.1.2 xdg==6.0.0 xmltodict==1.0.4 yq==3.4.3 [integration-distribution-test-vanadium] $ /bin/sh /tmp/jenkins2125946008857349792.sh ---> uv-install.sh Installing uv/uvx (latest) using shell installer 2026-04-07 09:40:02 URL:https://release-assets.githubusercontent.com/github-production-release-asset/699532645/c459da62-e838-45dc-bfca-ac56a38b294c?sp=r&sv=2018-11-09&sr=b&spr=https&se=2026-04-07T10%3A28%3A55Z&rscd=attachment%3B+filename%3Duv-installer.sh&rsct=application%2Foctet-stream&skoid=96c2d410-5711-43a1-aedd-ab1947aa7ab0&sktid=398a6654-997b-47e9-b12b-9515b896b4de&skt=2026-04-07T09%3A28%3A16Z&ske=2026-04-07T10%3A28%3A55Z&sks=b&skv=2018-11-09&sig=saD4wDVSpXIUYINqp1fmpJGjk1GQ9EVWA9TLmhtC2gU%3D&jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmVsZWFzZS1hc3NldHMuZ2l0aHVidXNlcmNvbnRlbnQuY29tIiwia2V5Ijoia2V5MSIsImV4cCI6MTc3NTU1NTA5NSwibmJmIjoxNzc1NTU0Nzk1LCJwYXRoIjoicmVsZWFzZWFzc2V0cHJvZHVjdGlvbi5ibG9iLmNvcmUud2luZG93cy5uZXQifQ.8UD2AZK4cdD1SXv2Nkc0I4q1RJrzW0Wz6jiy0eqMVOg&response-content-disposition=attachment%3B%20filename%3Duv-installer.sh&response-content-type=application%2Foctet-stream [71225/71225] -> "/tmp/uv-install-Gsaf2b.sh" [1] downloading uv 0.11.3 x86_64-unknown-linux-gnu installing to /home/jenkins/.local/bin uv uvx everything's installed! To add $HOME/.local/bin to your PATH, either restart your shell or run: source $HOME/.local/bin/env (sh, bash, zsh) source $HOME/.local/bin/env.fish (fish) Adding install location to PATH ---> Validating uv/uvx install uvx 0.11.3 (x86_64-unknown-linux-gnu) Waiting for the completion of bgpcep-csit-1node-bgp-ingest-all-vanadium bgpcep-csit-1node-bgp-ingest-all-vanadium #167 started. bgpcep-csit-1node-bgp-ingest-all-vanadium #167 completed. Result was UNSTABLE Waiting for the completion of bgpcep-csit-1node-bgp-ingest-mixed-all-vanadium bgpcep-csit-1node-bgp-ingest-mixed-all-vanadium #167 started. bgpcep-csit-1node-bgp-ingest-mixed-all-vanadium #167 completed. Result was UNSTABLE Waiting for the completion of bgpcep-csit-1node-throughpcep-all-vanadium bgpcep-csit-1node-throughpcep-all-vanadium #167 started. bgpcep-csit-1node-throughpcep-all-vanadium #167 completed. Result was UNSTABLE Waiting for the completion of bgpcep-csit-1node-userfeatures-all-vanadium bgpcep-csit-1node-userfeatures-all-vanadium #167 started. bgpcep-csit-1node-userfeatures-all-vanadium #167 completed. Result was UNSTABLE Waiting for the completion of daexim-csit-1node-basic-only-vanadium daexim-csit-1node-basic-only-vanadium #167 started. daexim-csit-1node-basic-only-vanadium #167 completed. Result was UNSTABLE Waiting for the completion of daexim-csit-3node-clustering-basic-only-vanadium daexim-csit-3node-clustering-basic-only-vanadium #167 started. daexim-csit-3node-clustering-basic-only-vanadium #167 completed. Result was FAILURE Waiting for the completion of distribution-csit-managed-vanadium distribution-csit-managed-vanadium #167 started. distribution-csit-managed-vanadium #167 completed. Result was FAILURE Waiting for the completion of jsonrpc-csit-1node-basic-only-vanadium jsonrpc-csit-1node-basic-only-vanadium #168 started. jsonrpc-csit-1node-basic-only-vanadium #168 completed. Result was UNSTABLE Waiting for the completion of openflowplugin-csit-1node-cbench-only-vanadium openflowplugin-csit-1node-cbench-only-vanadium #167 started. openflowplugin-csit-1node-cbench-only-vanadium #167 completed. Result was UNSTABLE Waiting for the completion of openflowplugin-csit-1node-flow-services-all-vanadium openflowplugin-csit-1node-flow-services-all-vanadium #167 started. openflowplugin-csit-1node-flow-services-all-vanadium #167 completed. Result was UNSTABLE Waiting for the completion of openflowplugin-csit-1node-perf-bulkomatic-only-vanadium openflowplugin-csit-1node-perf-bulkomatic-only-vanadium #167 started. openflowplugin-csit-1node-perf-bulkomatic-only-vanadium #167 completed. Result was FAILURE Waiting for the completion of openflowplugin-csit-1node-perf-stats-collection-only-vanadium openflowplugin-csit-1node-perf-stats-collection-only-vanadium #167 started. openflowplugin-csit-1node-perf-stats-collection-only-vanadium #167 completed. Result was FAILURE Waiting for the completion of openflowplugin-csit-1node-scale-link-only-vanadium openflowplugin-csit-1node-scale-link-only-vanadium #167 started. openflowplugin-csit-1node-scale-link-only-vanadium #167 completed. Result was UNSTABLE Waiting for the completion of openflowplugin-csit-1node-scale-only-vanadium openflowplugin-csit-1node-scale-only-vanadium #167 started. openflowplugin-csit-1node-scale-only-vanadium #167 completed. Result was UNSTABLE Waiting for the completion of openflowplugin-csit-1node-scale-switch-only-vanadium openflowplugin-csit-1node-scale-switch-only-vanadium #167 started. openflowplugin-csit-1node-scale-switch-only-vanadium #167 completed. Result was UNSTABLE Waiting for the completion of openflowplugin-csit-3node-clustering-bulkomatic-only-vanadium openflowplugin-csit-3node-clustering-bulkomatic-only-vanadium #167 started. openflowplugin-csit-3node-clustering-bulkomatic-only-vanadium #167 completed. Result was FAILURE Waiting for the completion of openflowplugin-csit-3node-clustering-only-vanadium openflowplugin-csit-3node-clustering-only-vanadium #167 started. openflowplugin-csit-3node-clustering-only-vanadium #167 completed. Result was FAILURE Waiting for the completion of openflowplugin-csit-3node-clustering-perf-bulkomatic-only-vanadium openflowplugin-csit-3node-clustering-perf-bulkomatic-only-vanadium #167 started. openflowplugin-csit-3node-clustering-perf-bulkomatic-only-vanadium #167 completed. Result was FAILURE Waiting for the completion of ovsdb-csit-1node-upstream-southbound-all-vanadium ovsdb-csit-1node-upstream-southbound-all-vanadium #168 started. ovsdb-csit-1node-upstream-southbound-all-vanadium #168 completed. Result was UNSTABLE Waiting for the completion of ovsdb-csit-3node-upstream-clustering-only-vanadium ovsdb-csit-3node-upstream-clustering-only-vanadium #167 started. ovsdb-csit-3node-upstream-clustering-only-vanadium #167 completed. Result was FAILURE Build step 'Trigger/call builds on other projects' changed build result to UNSTABLE Build step 'Trigger/call builds on other projects' marked build as failure $ ssh-agent -k unset SSH_AUTH_SOCK; unset SSH_AGENT_PID; echo Agent pid 3140 killed; [ssh-agent] Stopped. [PostBuildScript] - [INFO] Executing post build scripts. [integration-distribution-test-vanadium] $ /bin/sh /tmp/jenkins12445643090335250401.sh python /tmp/tmp.bS1libtEVx https://jenkins.opendaylight.org/releng/job/integration-distribution-test-vanadium/169/ /tmp/tmp.bS1libtEVx:26: DeprecationWarning: Call to deprecated method findAll. (Replaced by find_all) -- Deprecated since version 4.0.0. links = soup.findAll("a", { "class" : "model-link" }) [PostBuildScript] - [INFO] Executing post build scripts. [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins10486790181352033547.sh ---> sysstat.sh /tmp/jenkins10486790181352033547.sh: line 19: facter: command not found [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins7787765537544420079.sh ---> package-listing.sh ++ tr '[:upper:]' '[:lower:]' ++ facter osfamily /tmp/jenkins7787765537544420079.sh: line 19: facter: command not found + OS_FAMILY= [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins5957817598446333612.sh ---> capture-instance-metadata.sh Setup pyenv: system 3.8.20 3.9.20 3.10.15 * 3.11.10 (set by /w/workspace/integration-distribution-test-vanadium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-hBv1 from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools lf-activate-venv(): INFO: Adding /tmp/venv-hBv1/bin to PATH INFO: Running in OpenStack, capturing instance metadata [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins15907399984065540092.sh provisioning config files... Could not find credentials [logs] for integration-distribution-test-vanadium #169 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/integration-distribution-test-vanadium@tmp/config732336002662019476tmp Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] Run condition [Regular expression match] enabling perform for step [Provide Configuration files] provisioning config files... copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content SERVER_ID=logs [EnvInject] - Variables injected successfully. [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins11976966841112389994.sh ---> create-netrc.sh WARN: Log server credential not found. [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins3557810585274345193.sh ---> python-tools-install.sh Setup pyenv: system 3.8.20 3.9.20 3.10.15 * 3.11.10 (set by /w/workspace/integration-distribution-test-vanadium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-hBv1 from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools lf-activate-venv(): INFO: Adding /tmp/venv-hBv1/bin to PATH [integration-distribution-test-vanadium] $ /bin/sh /tmp/jenkins8088311593982496264.sh ---> uv-install.sh uv 0.11.3 is already installed uvx 0.11.3 (x86_64-unknown-linux-gnu) [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins11568577400319949758.sh ---> sudo-logs.sh Archiving 'sudo' log.. /tmp/jenkins11568577400319949758.sh: line 41: facter: command not found [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins13664433408993512760.sh ---> job-cost.sh INFO: Activating Python virtual environment... Setup pyenv: system 3.8.20 3.9.20 3.10.15 * 3.11.10 (set by /w/workspace/integration-distribution-test-vanadium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-hBv1 from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 lf-activate-venv(): INFO: Adding /tmp/venv-hBv1/bin to PATH INFO: No stack-cost file found INFO: Instance uptime: 21966s INFO: Fetching instance metadata (attempt 1 of 3)... DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type INFO: Successfully fetched instance metadata INFO: Instance type: v3-standard-2 INFO: Retrieving pricing info for: v3-standard-2 INFO: Fetching Vexxhost pricing API (attempt 1 of 3)... DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-standard-2/cost?seconds=21966 INFO: Successfully fetched Vexxhost pricing API INFO: Retrieved cost: 0.39 INFO: Retrieved resource: v3-standard-2 INFO: Creating archive directory: /w/workspace/integration-distribution-test-vanadium/archives/cost INFO: Archiving costs to: /w/workspace/integration-distribution-test-vanadium/archives/cost.csv INFO: Successfully archived job cost data DEBUG: Cost data: integration-distribution-test-vanadium,169,2026-04-07 15:44:39,v3-standard-2,21966,0.39,0.00,FAILURE [integration-distribution-test-vanadium] $ /bin/bash -l /tmp/jenkins12156837694278212646.sh ---> logs-deploy.sh Setup pyenv: system 3.8.20 3.9.20 3.10.15 * 3.11.10 (set by /w/workspace/integration-distribution-test-vanadium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-hBv1 from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 lf-activate-venv(): INFO: Adding /tmp/venv-hBv1/bin to PATH WARNING: Nexus logging server not set INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/integration-distribution-test-vanadium/169/ INFO: archiving logs to S3 ---> uname -a: Linux prd-queue-disttest-2c-1g-895 6.8.0-90-generic #91-Ubuntu SMP PREEMPT_DYNAMIC Tue Nov 18 14:14:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux ---> lscpu: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Address sizes: 40 bits physical, 48 bits virtual Byte Order: Little Endian CPU(s): 2 On-line CPU(s) list: 0,1 Vendor ID: AuthenticAMD Model name: AMD EPYC-Rome Processor CPU family: 23 Model: 49 Thread(s) per core: 1 Core(s) per socket: 1 Socket(s): 2 Stepping: 0 BogoMIPS: 5599.99 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities Virtualization: AMD-V Hypervisor vendor: KVM Virtualization type: full L1d cache: 64 KiB (2 instances) L1i cache: 64 KiB (2 instances) L2 cache: 1 MiB (2 instances) L3 cache: 32 MiB (2 instances) NUMA node(s): 1 NUMA node0 CPU(s): 0,1 Vulnerability Gather data sampling: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Mitigation; untrained return thunk; SMT disabled Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization Vulnerability Spectre v2: Mitigation; Retpolines; IBPB conditional; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected Vulnerability Srbds: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ---> nproc: 2 ---> df -h: Filesystem Size Used Avail Use% Mounted on tmpfs 795M 1.1M 794M 1% /run /dev/vda1 38G 7.8G 30G 21% / tmpfs 3.9G 0 3.9G 0% /dev/shm tmpfs 5.0M 0 5.0M 0% /run/lock /dev/vda16 881M 117M 703M 15% /boot /dev/vda15 105M 6.2M 99M 6% /boot/efi tmpfs 795M 16K 795M 1% /run/user/1001 ---> free -m: total used free shared buff/cache available Mem: 7941 718 5483 4 2024 7223 Swap: 1023 0 1023 ---> ip addr: 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host noprefixroute valid_lft forever preferred_lft forever 2: ens3: mtu 1458 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:2f:29:57 brd ff:ff:ff:ff:ff:ff altname enp0s3 inet 10.30.171.113/23 metric 100 brd 10.30.171.255 scope global dynamic ens3 valid_lft 64429sec preferred_lft 64429sec inet6 fe80::f816:3eff:fe2f:2957/64 scope link valid_lft forever preferred_lft forever ---> sar -b -r -n DEV: Linux 6.8.0-90-generic (prd-queue-disttest-2c-1g-895) 04/07/26 _x86_64_ (2 CPU) 09:38:44 LINUX RESTART (2 CPU) 09:40:02 tps rtps wtps dtps bread/s bwrtn/s bdscd/s 09:50:06 4.01 0.03 3.92 0.06 1.39 1081.31 0.86 10:00:06 14.44 0.01 1.51 12.92 0.20 19.60 107841.51 10:10:00 1.17 0.00 1.15 0.02 0.00 14.23 0.98 10:20:00 1.17 0.00 1.15 0.02 0.01 14.41 1.20 10:30:06 1.95 0.31 1.59 0.05 38.61 73.90 1.53 10:40:06 1.19 0.00 1.17 0.02 0.00 14.87 1.32 10:50:06 1.23 0.00 1.23 0.00 0.00 15.04 0.12 11:00:00 1.44 0.00 1.42 0.02 0.00 18.56 0.23 11:10:06 1.09 0.00 1.09 0.00 0.00 13.97 0.00 11:20:06 1.24 0.00 1.24 0.00 0.00 15.17 0.00 11:30:06 1.51 0.00 1.49 0.02 0.00 19.25 0.23 11:40:00 1.19 0.00 1.19 0.00 0.00 15.18 0.00 11:50:06 1.22 0.00 1.22 0.00 0.00 15.47 0.00 12:00:06 1.40 0.00 1.39 0.01 0.00 18.27 0.23 12:10:06 1.29 0.00 1.29 0.00 0.00 15.44 0.00 12:20:00 1.16 0.00 1.16 0.00 0.00 14.50 0.00 12:30:06 1.48 0.00 1.46 0.02 0.00 18.76 0.22 12:40:00 1.19 0.00 1.19 0.00 0.00 14.91 0.00 12:50:06 1.16 0.00 1.16 0.00 0.00 14.50 0.00 13:00:06 1.45 0.00 1.44 0.01 0.00 18.68 0.23 13:10:06 1.23 0.00 1.23 0.00 0.00 15.15 0.00 13:20:00 1.26 0.00 1.26 0.00 0.00 15.65 0.00 13:30:06 1.50 0.00 1.48 0.02 0.00 19.29 0.22 13:40:06 1.13 0.00 1.13 0.00 0.00 14.17 0.00 13:50:06 1.23 0.00 1.23 0.00 0.00 15.41 0.00 14:00:00 1.42 0.00 1.40 0.02 0.00 18.29 0.23 14:10:06 1.24 0.00 1.24 0.00 0.00 15.32 0.00 14:20:06 1.27 0.00 1.27 0.00 0.00 15.77 0.00 14:30:06 1.47 0.00 1.45 0.02 0.00 18.55 0.23 14:40:06 1.33 0.00 1.33 0.00 0.00 16.48 0.00 14:50:06 1.32 0.00 1.32 0.00 0.00 16.19 0.00 15:00:06 1.46 0.00 1.45 0.01 0.00 18.43 0.23 15:10:06 1.32 0.00 1.32 0.00 0.00 16.03 0.00 15:20:06 1.27 0.00 1.27 0.00 0.00 15.24 0.00 15:30:06 1.48 0.00 1.46 0.02 0.00 18.33 0.23 15:40:06 1.37 0.00 1.37 0.00 0.00 16.12 0.00 Average: 1.76 0.01 1.38 0.37 1.13 47.72 2995.19 09:40:02 kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 09:50:06 5796688 7513020 277860 3.42 61568 1835124 537124 5.85 463968 1613904 224 10:00:06 5784364 7501276 289352 3.56 61760 1835504 537128 5.85 464124 1614440 232 10:10:00 5787588 7505016 285628 3.51 61956 1835812 537260 5.85 464208 1614956 8 10:20:00 5787588 7505512 285132 3.51 62116 1836156 537264 5.85 464156 1615456 160 10:30:06 5754600 7501124 289016 3.55 62432 1864124 743456 8.10 481184 1632680 224 10:40:06 5767292 7514448 275692 3.39 62604 1864576 743456 8.10 481524 1633176 252 10:50:06 5767292 7514924 275208 3.38 62752 1864900 743456 8.10 481380 1633648 136 11:00:00 5756892 7505024 285080 3.51 62904 1865232 743456 8.10 481492 1634124 180 11:10:06 5756892 7505488 284616 3.50 63032 1865556 743456 8.10 481464 1634584 248 11:20:06 5756652 7505740 284356 3.50 63188 1865884 743520 8.10 481688 1635068 220 11:30:06 5747368 7497064 292960 3.60 63332 1866336 743520 8.10 481748 1635536 192 11:40:00 5747644 7497816 292200 3.59 63476 1866664 743520 8.10 481872 1636008 144 11:50:06 5754196 7504816 285224 3.51 63592 1866992 743520 8.10 481876 1636448 308 12:00:06 5754252 7505380 284632 3.50 63756 1867316 743520 8.10 481876 1636940 260 12:10:06 5754252 7505852 284156 3.49 63896 1867644 743664 8.10 482044 1637408 160 12:20:00 5754252 7506472 283524 3.49 64064 1868096 743664 8.10 482240 1637892 164 12:30:06 5752492 7505200 284800 3.50 64204 1868428 743736 8.10 482192 1638372 136 12:40:00 5752492 7505656 284336 3.50 64328 1868756 743792 8.10 482196 1638824 188 12:50:06 5752492 7506116 283872 3.49 64452 1869084 743800 8.10 482256 1639276 260 13:00:06 5752380 7506620 283348 3.48 64624 1869524 743800 8.10 482576 1639772 208 13:10:06 5751384 7506112 283884 3.49 64760 1869868 743800 8.10 482460 1640240 252 13:20:00 5751384 7506600 283388 3.48 64912 1870196 743800 8.10 482792 1640720 160 13:30:06 5742576 7498268 291700 3.59 65068 1870524 743864 8.10 482488 1641200 208 13:40:06 5750416 7506596 283368 3.48 65220 1870848 743864 8.10 482652 1641680 276 13:50:06 5750416 7507096 282860 3.48 65380 1871180 743860 8.10 482596 1642172 192 14:00:00 5742864 7500060 289812 3.56 65556 1871504 743928 8.10 482780 1642672 160 14:10:06 5742864 7500544 289388 3.56 65708 1871832 743928 8.10 482728 1643152 244 14:20:06 5749424 7507588 282304 3.47 65856 1872156 744080 8.10 482812 1643624 204 14:30:06 5752052 7510692 279160 3.43 66000 1872484 744508 8.11 483208 1644096 236 14:40:06 5727860 7487004 302832 3.72 66168 1872812 757780 8.25 489240 1644592 204 14:50:06 5727608 7487256 302564 3.72 66348 1873136 757780 8.25 489248 1645088 192 15:00:06 5729680 7489856 299940 3.69 66536 1873468 757780 8.25 489252 1645608 256 15:10:06 5729680 7490424 299364 3.68 66704 1873860 757780 8.25 489320 1646104 260 15:20:06 5729680 7490920 298864 3.67 66868 1874184 757780 8.25 489324 1646592 288 15:30:06 5732148 7493960 295828 3.64 67032 1874584 757780 8.25 489444 1647092 296 15:40:06 5731432 7493736 296048 3.64 67192 1874908 757780 8.25 489444 1647580 280 Average: 5752198 7502480 287564 3.54 64426 1865813 723506 7.88 481551 1637242 211 09:40:02 IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 09:50:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 09:50:06 ens3 4.30 0.40 0.71 0.26 0.00 0.00 0.00 0.00 10:00:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 10:00:06 ens3 2.00 0.09 0.18 0.05 0.00 0.00 0.00 0.00 10:10:00 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 10:10:00 ens3 0.32 0.03 0.05 0.01 0.00 0.00 0.00 0.00 10:20:00 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 10:20:00 ens3 0.39 0.06 0.08 0.04 0.00 0.00 0.00 0.00 10:30:06 lo 1.02 1.02 0.05 0.05 0.00 0.00 0.00 0.00 10:30:06 ens3 0.42 0.20 3.02 0.03 0.00 0.00 0.00 0.00 10:40:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 10:40:06 ens3 1.81 0.08 0.30 0.06 0.00 0.00 0.00 0.00 10:50:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 10:50:06 ens3 0.65 0.08 0.12 0.04 0.00 0.00 0.00 0.00 11:00:00 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 11:00:00 ens3 0.35 0.05 0.08 0.03 0.00 0.00 0.00 0.00 11:10:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 11:10:06 ens3 0.39 0.07 0.10 0.04 0.00 0.00 0.00 0.00 11:20:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 11:20:06 ens3 0.28 0.05 0.08 0.04 0.00 0.00 0.00 0.00 11:30:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 11:30:06 ens3 0.71 0.09 0.15 0.08 0.00 0.00 0.00 0.00 11:40:00 lo 0.98 0.98 0.05 0.05 0.00 0.00 0.00 0.00 11:40:00 ens3 0.37 0.06 0.10 0.05 0.00 0.00 0.00 0.00 11:50:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 11:50:06 ens3 0.30 0.07 0.10 0.05 0.00 0.00 0.00 0.00 12:00:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 12:00:06 ens3 0.33 0.09 0.11 0.06 0.00 0.00 0.00 0.00 12:10:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 12:10:06 ens3 0.17 0.05 0.04 0.02 0.00 0.00 0.00 0.00 12:20:00 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 12:20:00 ens3 0.25 0.05 0.07 0.03 0.00 0.00 0.00 0.00 12:30:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 12:30:06 ens3 0.17 0.04 0.04 0.01 0.00 0.00 0.00 0.00 12:40:00 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 12:40:00 ens3 0.38 0.11 0.14 0.08 0.00 0.00 0.00 0.00 12:50:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 12:50:06 ens3 0.19 0.03 0.04 0.01 0.00 0.00 0.00 0.00 13:00:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 13:00:06 ens3 0.27 0.07 0.09 0.05 0.00 0.00 0.00 0.00 13:10:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 13:10:06 ens3 0.18 0.03 0.04 0.01 0.00 0.00 0.00 0.00 13:20:00 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 13:20:00 ens3 0.40 0.09 0.14 0.08 0.00 0.00 0.00 0.00 13:30:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 13:30:06 ens3 0.47 0.09 0.14 0.08 0.00 0.00 0.00 0.00 13:40:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 13:40:06 ens3 0.41 0.06 0.08 0.03 0.00 0.00 0.00 0.00 13:50:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 13:50:06 ens3 0.30 0.07 0.08 0.04 0.00 0.00 0.00 0.00 14:00:00 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 14:00:00 ens3 0.28 0.07 0.10 0.05 0.00 0.00 0.00 0.00 14:10:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 14:10:06 ens3 1.15 0.22 0.38 0.22 0.00 0.00 0.00 0.00 14:20:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 14:20:06 ens3 0.34 0.08 0.08 0.04 0.00 0.00 0.00 0.00 14:30:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 14:30:06 ens3 1.47 0.42 0.36 2.11 0.00 0.00 0.00 0.00 14:40:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 14:40:06 ens3 0.97 0.22 0.20 0.67 0.00 0.00 0.00 0.00 14:50:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 14:50:06 ens3 0.24 0.04 0.04 0.01 0.00 0.00 0.00 0.00 15:00:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 15:00:06 ens3 0.39 0.10 0.13 0.07 0.00 0.00 0.00 0.00 15:10:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 15:10:06 ens3 0.24 0.04 0.04 0.01 0.00 0.00 0.00 0.00 15:20:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 15:20:06 ens3 0.20 0.04 0.04 0.01 0.00 0.00 0.00 0.00 15:30:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 15:30:06 ens3 0.19 0.03 0.04 0.01 0.00 0.00 0.00 0.00 15:40:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 15:40:06 ens3 0.25 0.06 0.07 0.03 0.00 0.00 0.00 0.00 Average: lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 Average: ens3 0.60 0.10 0.21 0.13 0.00 0.00 0.00 0.00 ---> sar -P ALL: Linux 6.8.0-90-generic (prd-queue-disttest-2c-1g-895) 04/07/26 _x86_64_ (2 CPU) 09:38:44 LINUX RESTART (2 CPU) 09:40:02 CPU %user %nice %system %iowait %steal %idle 09:50:06 all 0.31 0.00 0.16 0.05 0.02 99.46 09:50:06 0 0.38 0.00 0.17 0.04 0.02 99.39 09:50:06 1 0.25 0.00 0.15 0.05 0.02 99.53 10:00:06 all 0.28 0.00 0.18 0.03 0.03 99.49 10:00:06 0 0.25 0.00 0.20 0.05 0.03 99.48 10:00:06 1 0.31 0.00 0.16 0.01 0.03 99.49 10:10:00 all 0.24 0.00 0.06 0.01 0.03 99.67 10:10:00 0 0.42 0.00 0.05 0.00 0.02 99.51 10:10:00 1 0.05 0.00 0.08 0.01 0.04 99.82 10:20:00 all 0.22 0.00 0.07 0.76 0.03 98.92 10:20:00 0 0.10 0.00 0.07 1.50 0.03 98.29 10:20:00 1 0.33 0.00 0.07 0.01 0.03 99.56 10:30:06 all 0.38 0.00 0.19 0.05 0.02 99.36 10:30:06 0 0.30 0.00 0.17 0.07 0.02 99.44 10:30:06 1 0.45 0.00 0.21 0.04 0.02 99.28 10:40:06 all 0.25 0.00 0.07 0.02 0.02 99.63 10:40:06 0 0.44 0.00 0.04 0.00 0.02 99.50 10:40:06 1 0.06 0.00 0.10 0.05 0.03 99.77 10:50:06 all 0.26 0.00 0.08 0.01 0.02 99.62 10:50:06 0 0.45 0.00 0.07 0.01 0.02 99.46 10:50:06 1 0.07 0.00 0.10 0.02 0.03 99.79 11:00:00 all 0.23 0.00 0.17 0.01 0.03 99.56 11:00:00 0 0.40 0.00 0.16 0.03 0.02 99.39 11:00:00 1 0.06 0.00 0.17 0.00 0.03 99.73 11:10:06 all 0.24 0.00 0.07 0.01 0.03 99.65 11:10:06 0 0.43 0.00 0.05 0.02 0.02 99.47 11:10:06 1 0.05 0.00 0.09 0.00 0.03 99.83 11:20:06 all 0.22 0.00 0.07 0.01 0.03 99.68 11:20:06 0 0.39 0.00 0.05 0.01 0.02 99.53 11:20:06 1 0.05 0.00 0.09 0.01 0.04 99.82 11:30:06 all 0.20 0.00 0.17 0.01 0.03 99.59 11:30:06 0 0.32 0.00 0.14 0.01 0.02 99.51 11:30:06 1 0.08 0.00 0.20 0.01 0.04 99.67 11:30:06 CPU %user %nice %system %iowait %steal %idle 11:40:00 all 0.24 0.00 0.07 2.59 0.03 97.08 11:40:00 0 0.34 0.00 0.05 2.49 0.02 97.11 11:40:00 1 0.14 0.00 0.09 2.68 0.04 97.05 11:50:06 all 0.23 0.00 0.08 0.18 0.02 99.49 11:50:06 0 0.06 0.00 0.08 0.23 0.02 99.61 11:50:06 1 0.41 0.00 0.07 0.14 0.01 99.37 12:00:06 all 0.25 0.00 0.18 0.22 0.02 99.33 12:00:06 0 0.26 0.00 0.18 0.16 0.02 99.38 12:00:06 1 0.25 0.00 0.18 0.27 0.02 99.28 12:10:06 all 0.25 0.00 0.08 0.06 0.02 99.58 12:10:06 0 0.21 0.00 0.08 0.12 0.02 99.58 12:10:06 1 0.30 0.00 0.08 0.01 0.02 99.59 12:20:00 all 0.24 0.00 0.08 0.03 0.02 99.62 12:20:00 0 0.23 0.00 0.09 0.06 0.02 99.60 12:20:00 1 0.26 0.00 0.08 0.00 0.02 99.64 12:30:06 all 0.30 0.00 0.19 0.02 0.02 99.47 12:30:06 0 0.22 0.00 0.18 0.01 0.02 99.56 12:30:06 1 0.37 0.00 0.20 0.03 0.02 99.37 12:40:00 all 0.27 0.00 0.09 0.02 0.02 99.61 12:40:00 0 0.38 0.00 0.08 0.02 0.02 99.49 12:40:00 1 0.15 0.00 0.09 0.01 0.03 99.72 12:50:06 all 0.22 0.00 0.09 0.03 0.02 99.64 12:50:06 0 0.24 0.00 0.08 0.00 0.02 99.66 12:50:06 1 0.21 0.00 0.09 0.06 0.02 99.62 13:00:06 all 0.31 0.00 0.21 0.01 0.02 99.46 13:00:06 0 0.47 0.00 0.18 0.01 0.02 99.33 13:00:06 1 0.15 0.00 0.23 0.02 0.02 99.58 13:10:06 all 0.24 0.00 0.08 0.02 0.02 99.63 13:10:06 0 0.18 0.00 0.08 0.01 0.02 99.70 13:10:06 1 0.31 0.00 0.08 0.03 0.02 99.56 13:20:00 all 0.27 0.00 0.07 0.04 0.03 99.59 13:20:00 0 0.07 0.00 0.10 0.00 0.04 99.79 13:20:00 1 0.46 0.00 0.05 0.07 0.02 99.40 13:20:00 CPU %user %nice %system %iowait %steal %idle 13:30:06 all 0.30 0.00 0.17 0.01 0.03 99.48 13:30:06 0 0.37 0.00 0.18 0.02 0.03 99.40 13:30:06 1 0.24 0.00 0.16 0.01 0.03 99.57 13:40:06 all 0.22 0.00 0.07 0.01 0.03 99.67 13:40:06 0 0.17 0.00 0.08 0.01 0.03 99.72 13:40:06 1 0.28 0.00 0.07 0.01 0.03 99.61 13:50:06 all 0.24 0.00 0.07 0.01 0.03 99.65 13:50:06 0 0.30 0.00 0.07 0.01 0.03 99.59 13:50:06 1 0.18 0.00 0.07 0.01 0.03 99.71 14:00:00 all 0.25 0.00 0.17 0.01 0.03 99.54 14:00:00 0 0.43 0.00 0.16 0.01 0.03 99.38 14:00:00 1 0.07 0.00 0.18 0.01 0.04 99.70 14:10:06 all 0.26 0.00 0.07 0.03 0.04 99.60 14:10:06 0 0.46 0.00 0.06 0.02 0.02 99.44 14:10:06 1 0.06 0.00 0.08 0.05 0.05 99.76 14:20:06 all 0.24 0.00 0.08 0.02 0.04 99.63 14:20:06 0 0.20 0.00 0.08 0.00 0.04 99.68 14:20:06 1 0.28 0.00 0.07 0.04 0.04 99.57 14:30:06 all 0.12 0.00 0.16 0.01 0.03 99.67 14:30:06 0 0.12 0.00 0.15 0.02 0.03 99.68 14:30:06 1 0.12 0.00 0.17 0.01 0.03 99.67 14:40:06 all 0.24 0.00 0.07 0.05 0.03 99.61 14:40:06 0 0.31 0.00 0.07 0.00 0.02 99.60 14:40:06 1 0.17 0.00 0.08 0.10 0.03 99.62 14:50:06 all 0.25 0.00 0.07 0.02 0.03 99.64 14:50:06 0 0.45 0.00 0.05 0.02 0.02 99.47 14:50:06 1 0.04 0.00 0.08 0.02 0.04 99.81 15:00:06 all 0.26 0.00 0.15 0.01 0.03 99.55 15:00:06 0 0.34 0.00 0.16 0.01 0.02 99.47 15:00:06 1 0.18 0.00 0.15 0.02 0.04 99.62 15:10:06 all 0.22 0.00 0.08 0.02 0.03 99.66 15:10:06 0 0.27 0.00 0.08 0.03 0.03 99.59 15:10:06 1 0.17 0.00 0.07 0.01 0.03 99.73 15:10:06 CPU %user %nice %system %iowait %steal %idle 15:20:06 all 0.25 0.00 0.07 0.02 0.03 99.63 15:20:06 0 0.05 0.00 0.09 0.01 0.04 99.82 15:20:06 1 0.45 0.00 0.06 0.02 0.02 99.45 15:30:06 all 0.26 0.00 0.17 0.03 0.03 99.51 15:30:06 0 0.09 0.00 0.20 0.01 0.03 99.67 15:30:06 1 0.44 0.00 0.14 0.04 0.02 99.36 15:40:06 all 0.23 0.00 0.07 0.02 0.03 99.65 15:40:06 0 0.05 0.00 0.08 0.03 0.03 99.81 15:40:06 1 0.40 0.00 0.06 0.01 0.03 99.50 Average: all 0.25 0.00 0.11 0.12 0.03 99.49 Average: 0 0.28 0.00 0.11 0.14 0.02 99.45 Average: 1 0.22 0.00 0.11 0.11 0.03 99.53