01:10:02 Started by upstream project "autorelease-release-chromium-mvn39-openjdk21" build number 253 01:10:02 originally caused by: 01:10:02 Started by timer 01:10:02 Running as SYSTEM 01:10:02 [EnvInject] - Loading node environment variables. 01:10:02 Building remotely on prd-queue-disttest-2c-1g-61452 (queue-disttest-2c-1g) in workspace /w/workspace/integration-distribution-test-chromium 01:10:02 [ssh-agent] Looking for ssh-agent implementation... 01:10:02 [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) 01:10:02 $ ssh-agent 01:10:02 SSH_AUTH_SOCK=/tmp/ssh-fFHb2kfKUTuq/agent.5918 01:10:02 SSH_AGENT_PID=5920 01:10:02 [ssh-agent] Started. 01:10:02 Running ssh-add (command line suppressed) 01:10:02 Identity added: /w/workspace/integration-distribution-test-chromium@tmp/private_key_415832905031350282.key (/w/workspace/integration-distribution-test-chromium@tmp/private_key_415832905031350282.key) 01:10:02 [ssh-agent] Using credentials jenkins (jenkins-ssh) 01:10:02 No emails were triggered. 01:10:02 provisioning config files... 01:10:02 copy managed file [npmrc] to file:/home/jenkins/.npmrc 01:10:02 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 01:10:02 [integration-distribution-test-chromium] $ /bin/bash /tmp/jenkins14202267976125470508.sh 01:10:02 ---> python-tools-install.sh 01:10:02 Setup pyenv: 01:10:02 * system (set by /opt/pyenv/version) 01:10:02 * 3.8.20 (set by /opt/pyenv/version) 01:10:02 * 3.9.20 (set by /opt/pyenv/version) 01:10:02 3.10.15 01:10:02 3.11.10 01:10:03 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jpjz from file:/tmp/.os_lf_venv 01:10:03 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 01:10:04 lf-activate-venv(): INFO: Installing additional packages: lftools 01:10:13 lf-activate-venv(): INFO: Adding /tmp/venv-jpjz/bin to PATH 01:10:13 [integration-distribution-test-chromium] $ /bin/sh /tmp/jenkins1259317894394158479.sh 01:10:13 ---> uv-install.sh 01:10:13 uv 0.12.22 is already installed 01:10:13 uvx 0.12.22 (x86_64-unknown-linux-gnu) 01:10:13 Waiting for the completion of bgpcep-csit-1node-bgp-ingest-all-chromium 01:10:13 bgpcep-csit-1node-bgp-ingest-all-chromium #3 started. 03:19:51 bgpcep-csit-1node-bgp-ingest-all-chromium #3 completed. Result was UNSTABLE 03:19:51 Waiting for the completion of bgpcep-csit-1node-bgp-ingest-mixed-all-chromium 03:19:51 bgpcep-csit-1node-bgp-ingest-mixed-all-chromium #3 started. 03:19:51 bgpcep-csit-1node-bgp-ingest-mixed-all-chromium #3 completed. Result was SUCCESS 03:19:51 Waiting for the completion of bgpcep-csit-1node-throughpcep-all-chromium 03:19:51 bgpcep-csit-1node-throughpcep-all-chromium #3 started. 03:19:51 bgpcep-csit-1node-throughpcep-all-chromium #3 completed. Result was UNSTABLE 03:19:51 Waiting for the completion of bgpcep-csit-1node-userfeatures-all-chromium 03:19:51 bgpcep-csit-1node-userfeatures-all-chromium #3 started. 03:19:51 bgpcep-csit-1node-userfeatures-all-chromium #3 completed. Result was UNSTABLE 03:19:51 Waiting for the completion of daexim-csit-1node-basic-only-chromium 03:19:51 daexim-csit-1node-basic-only-chromium #102 started. 03:19:51 daexim-csit-1node-basic-only-chromium #102 completed. Result was UNSTABLE 03:19:51 Waiting for the completion of daexim-csit-3node-clustering-basic-only-chromium 03:19:51 daexim-csit-3node-clustering-basic-only-chromium #102 started. 03:19:51 daexim-csit-3node-clustering-basic-only-chromium #102 completed. Result was UNSTABLE 03:19:51 Waiting for the completion of distribution-csit-managed-chromium 03:19:51 distribution-csit-managed-chromium #102 started. 03:19:51 distribution-csit-managed-chromium #102 completed. Result was SUCCESS 03:19:51 Waiting for the completion of jsonrpc-csit-1node-basic-only-chromium 03:19:51 jsonrpc-csit-1node-basic-only-chromium #102 started. 03:19:51 jsonrpc-csit-1node-basic-only-chromium #102 completed. Result was UNSTABLE 03:19:51 Waiting for the completion of openflowplugin-csit-1node-cbench-only-chromium 03:19:51 openflowplugin-csit-1node-cbench-only-chromium #102 started. 03:19:51 openflowplugin-csit-1node-cbench-only-chromium #102 completed. Result was FAILURE 03:19:51 Waiting for the completion of openflowplugin-csit-1node-flow-services-all-chromium 03:19:51 openflowplugin-csit-1node-flow-services-all-chromium #102 started. 03:19:51 openflowplugin-csit-1node-flow-services-all-chromium #102 completed. Result was UNSTABLE 03:19:51 Waiting for the completion of openflowplugin-csit-1node-perf-bulkomatic-only-chromium 03:19:51 openflowplugin-csit-1node-perf-bulkomatic-only-chromium #102 started. 03:19:51 openflowplugin-csit-1node-perf-bulkomatic-only-chromium #102 completed. Result was UNSTABLE 03:19:51 Waiting for the completion of openflowplugin-csit-1node-perf-stats-collection-only-chromium 03:19:51 openflowplugin-csit-1node-perf-stats-collection-only-chromium #102 started. 03:19:51 openflowplugin-csit-1node-perf-stats-collection-only-chromium #102 completed. Result was UNSTABLE 03:19:51 Waiting for the completion of openflowplugin-csit-1node-scale-link-only-chromium 03:19:51 openflowplugin-csit-1node-scale-link-only-chromium #102 started. 03:19:51 openflowplugin-csit-1node-scale-link-only-chromium #102 completed. Result was FAILURE 03:19:51 Waiting for the completion of openflowplugin-csit-1node-scale-only-chromium 03:19:51 openflowplugin-csit-1node-scale-only-chromium #102 started. 03:19:51 openflowplugin-csit-1node-scale-only-chromium #102 completed. Result was UNSTABLE 03:19:51 Waiting for the completion of openflowplugin-csit-1node-scale-switch-only-chromium 03:19:51 openflowplugin-csit-1node-scale-switch-only-chromium #102 started. 03:19:51 openflowplugin-csit-1node-scale-switch-only-chromium #102 completed. Result was UNSTABLE 03:19:51 Waiting for the completion of openflowplugin-csit-3node-clustering-bulkomatic-only-chromium 03:19:51 openflowplugin-csit-3node-clustering-bulkomatic-only-chromium #102 started. 03:19:51 openflowplugin-csit-3node-clustering-bulkomatic-only-chromium #102 completed. Result was FAILURE 03:19:51 Waiting for the completion of openflowplugin-csit-3node-clustering-only-chromium 03:19:51 openflowplugin-csit-3node-clustering-only-chromium #102 started. 03:19:51 openflowplugin-csit-3node-clustering-only-chromium #102 completed. Result was FAILURE 03:19:51 Waiting for the completion of openflowplugin-csit-3node-clustering-perf-bulkomatic-only-chromium 03:19:51 openflowplugin-csit-3node-clustering-perf-bulkomatic-only-chromium #102 started. 03:19:51 openflowplugin-csit-3node-clustering-perf-bulkomatic-only-chromium #102 completed. Result was FAILURE 03:19:51 Waiting for the completion of ovsdb-csit-1node-upstream-southbound-all-chromium 03:19:51 ovsdb-csit-1node-upstream-southbound-all-chromium #102 started. 03:19:51 ovsdb-csit-1node-upstream-southbound-all-chromium #102 completed. Result was UNSTABLE 03:19:51 Waiting for the completion of ovsdb-csit-3node-upstream-clustering-only-chromium 03:19:51 ovsdb-csit-3node-upstream-clustering-only-chromium #102 started. 03:19:51 ovsdb-csit-3node-upstream-clustering-only-chromium #102 completed. Result was FAILURE 03:19:51 Build step 'Trigger/call builds on other projects' changed build result to UNSTABLE 03:19:51 Build step 'Trigger/call builds on other projects' marked build as failure 03:19:51 $ ssh-agent -k 03:19:51 unset SSH_AUTH_SOCK; 03:19:51 unset SSH_AGENT_PID; 03:19:51 echo Agent pid 5920 killed; 03:19:51 [ssh-agent] Stopped. 03:19:51 [PostBuildScript] - [INFO] Executing post build scripts. 03:19:51 [integration-distribution-test-chromium] $ /bin/sh /tmp/jenkins10775763048771949753.sh 03:19:55 python /tmp/tmp.d9RMgr5KsR https://jenkins.opendaylight.org/releng/job/integration-distribution-test-chromium/104/ 03:19:56 /tmp/tmp.d9RMgr5KsR:26: DeprecationWarning: Call to deprecated method findAll. (Replaced by find_all) -- Deprecated since version 4.0.0. 03:19:56 links = soup.findAll("a", { "class" : "model-link" }) 03:19:56 [PostBuildScript] - [INFO] Executing post build scripts. 03:19:56 [integration-distribution-test-chromium] $ /bin/bash /tmp/jenkins8074554645107817652.sh 03:19:56 ---> sysstat.sh 03:19:56 [integration-distribution-test-chromium] $ /bin/bash /tmp/jenkins9645402245330743520.sh 03:19:56 ---> package-listing.sh 03:19:56 + '[' -f /etc/os-release ']' 03:19:56 + . /etc/os-release 03:19:56 ++ PRETTY_NAME='Ubuntu 24.04.4 LTS' 03:19:56 ++ NAME=Ubuntu 03:19:56 ++ VERSION_ID=24.04 03:19:56 ++ VERSION='24.04.4 LTS (Noble Numbat)' 03:19:56 ++ VERSION_CODENAME=noble 03:19:56 ++ ID=ubuntu 03:19:56 ++ ID_LIKE=debian 03:19:56 ++ HOME_URL=https://www.ubuntu.com/ 03:19:56 ++ SUPPORT_URL=https://help.ubuntu.com/ 03:19:56 ++ BUG_REPORT_URL=https://bugs.launchpad.net/ubuntu/ 03:19:56 ++ PRIVACY_POLICY_URL=https://www.ubuntu.com/legal/terms-and-policies/privacy-policy 03:19:56 ++ UBUNTU_CODENAME=noble 03:19:56 ++ LOGO=ubuntu-logo 03:19:56 + case " ${ID:-} ${ID_LIKE:-} " in 03:19:56 + OS_FAMILY=debian 03:19:56 + workspace=/w/workspace/integration-distribution-test-chromium 03:19:56 + START_PACKAGES=/tmp/packages_start.txt 03:19:56 + END_PACKAGES=/tmp/packages_end.txt 03:19:56 + DIFF_PACKAGES=/tmp/packages_diff.txt 03:19:56 + PACKAGES=/tmp/packages_start.txt 03:19:56 + '[' /w/workspace/integration-distribution-test-chromium ']' 03:19:56 + PACKAGES=/tmp/packages_end.txt 03:19:56 + case "${OS_FAMILY}" in 03:19:56 + dpkg -l 03:19:56 + grep '^ii' 03:19:56 + '[' -f /tmp/packages_start.txt ']' 03:19:56 + '[' -f /tmp/packages_end.txt ']' 03:19:56 + diff /tmp/packages_start.txt /tmp/packages_end.txt 03:19:56 + '[' /w/workspace/integration-distribution-test-chromium ']' 03:19:56 + mkdir -p /w/workspace/integration-distribution-test-chromium/archives/ 03:19:56 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/integration-distribution-test-chromium/archives/ 03:19:56 + exit 0 03:19:56 [integration-distribution-test-chromium] $ /bin/bash /tmp/jenkins10570764730137944478.sh 03:19:56 ---> capture-instance-metadata.sh 03:19:56 Setup pyenv: 03:19:56 system 03:19:56 3.8.20 03:19:56 3.9.20 03:19:56 3.10.15 03:19:56 * 3.11.10 (set by /w/workspace/integration-distribution-test-chromium/.python-version) 03:19:56 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jpjz from file:/tmp/.os_lf_venv 03:19:56 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 03:19:58 lf-activate-venv(): INFO: Installing additional packages: lftools 03:20:08 lf-activate-venv(): INFO: Adding /tmp/venv-jpjz/bin to PATH 03:20:08 INFO: Running in OpenStack, capturing instance metadata 03:20:09 [integration-distribution-test-chromium] $ /bin/bash /tmp/jenkins10866086067415262530.sh 03:20:09 provisioning config files... 03:20:09 Could not find credentials [logs] for integration-distribution-test-chromium #104 03:20:09 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/integration-distribution-test-chromium@tmp/config13245094099767260063tmp 03:20:09 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] 03:20:09 Run condition [Regular expression match] enabling perform for step [Provide Configuration files] 03:20:09 provisioning config files... 03:20:09 copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials 03:20:09 [EnvInject] - Injecting environment variables from a build step. 03:20:09 [EnvInject] - Injecting as environment variables the properties content 03:20:09 SERVER_ID=logs 03:20:09 03:20:09 [EnvInject] - Variables injected successfully. 03:20:09 [integration-distribution-test-chromium] $ /bin/bash /tmp/jenkins11195390363289659611.sh 03:20:09 ---> create-netrc.sh 03:20:09 WARN: Log server credential not found. 03:20:09 [integration-distribution-test-chromium] $ /bin/bash /tmp/jenkins17739527321849104268.sh 03:20:09 ---> python-tools-install.sh 03:20:09 Setup pyenv: 03:20:09 system 03:20:09 3.8.20 03:20:09 3.9.20 03:20:09 3.10.15 03:20:09 * 3.11.10 (set by /w/workspace/integration-distribution-test-chromium/.python-version) 03:20:10 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jpjz from file:/tmp/.os_lf_venv 03:20:10 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 03:20:12 lf-activate-venv(): INFO: Installing additional packages: lftools 03:20:22 lf-activate-venv(): INFO: Adding /tmp/venv-jpjz/bin to PATH 03:20:22 [integration-distribution-test-chromium] $ /bin/sh /tmp/jenkins2976198101040470676.sh 03:20:22 ---> uv-install.sh 03:20:22 uv 0.12.22 is already installed 03:20:22 uvx 0.12.22 (x86_64-unknown-linux-gnu) 03:20:22 [integration-distribution-test-chromium] $ /bin/bash /tmp/jenkins3225188027531830395.sh 03:20:22 ---> sudo-logs.sh 03:20:22 Archiving 'sudo' log.. 03:20:22 [integration-distribution-test-chromium] $ /bin/bash /tmp/jenkins8634978749058766383.sh 03:20:22 ---> job-cost.sh 03:20:23 INFO: Activating Python virtual environment... 03:20:23 Setup pyenv: 03:20:23 system 03:20:23 3.8.20 03:20:23 3.9.20 03:20:23 3.10.15 03:20:23 * 3.11.10 (set by /w/workspace/integration-distribution-test-chromium/.python-version) 03:20:23 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jpjz from file:/tmp/.os_lf_venv 03:20:23 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 03:20:25 lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 03:20:34 lf-activate-venv(): INFO: Adding /tmp/venv-jpjz/bin to PATH 03:20:34 INFO: No stack-cost file found 03:20:34 INFO: Instance uptime: 9853s 03:20:34 INFO: Fetching instance metadata (attempt 1 of 3)... 03:20:34 DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type 03:20:35 INFO: Successfully fetched instance metadata 03:20:35 INFO: Instance type: v3-standard-2 03:20:35 INFO: Retrieving pricing info for: v3-standard-2 03:20:35 INFO: Fetching Vexxhost pricing API (attempt 1 of 3)... 03:20:35 DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-standard-2/cost?seconds=9853 03:20:35 INFO: Successfully fetched Vexxhost pricing API 03:20:35 INFO: Retrieved cost: 0.17 03:20:35 INFO: Retrieved resource: v3-standard-2 03:20:35 INFO: Creating archive directory: /w/workspace/integration-distribution-test-chromium/archives/cost 03:20:35 INFO: Archiving costs to: /w/workspace/integration-distribution-test-chromium/archives/cost.csv 03:20:35 INFO: Successfully archived job cost data 03:20:35 DEBUG: Cost data: integration-distribution-test-chromium,104,2026-10-03 03:20:35,v3-standard-2,9853,0.17,0.00,FAILURE 03:20:35 [integration-distribution-test-chromium] $ /bin/bash -l /tmp/jenkins12270214260439463346.sh 03:20:35 ---> logs-deploy.sh 03:20:35 Setup pyenv: 03:20:35 system 03:20:35 3.8.20 03:20:35 3.9.20 03:20:35 3.10.15 03:20:35 * 3.11.10 (set by /w/workspace/integration-distribution-test-chromium/.python-version) 03:20:35 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jpjz from file:/tmp/.os_lf_venv 03:20:35 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 03:20:37 lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 03:20:53 lf-activate-venv(): INFO: Adding /tmp/venv-jpjz/bin to PATH 03:20:53 WARNING: Nexus logging server not set 03:20:53 INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/integration-distribution-test-chromium/104/ 03:20:53 INFO: archiving logs to S3 03:20:54 ---> uname -a: 03:20:54 Linux prd-queue-disttest-2c-1g-61452 6.8.0-138-generic #138-Ubuntu SMP PREEMPT_DYNAMIC Fri Jul 31 22:41:49 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux 03:20:54 03:20:54 03:20:54 ---> lscpu: 03:20:54 Architecture: x86_64 03:20:54 CPU op-mode(s): 32-bit, 64-bit 03:20:54 Address sizes: 40 bits physical, 48 bits virtual 03:20:54 Byte Order: Little Endian 03:20:54 CPU(s): 2 03:20:54 On-line CPU(s) list: 0,1 03:20:54 Vendor ID: AuthenticAMD 03:20:54 Model name: AMD EPYC-Rome Processor 03:20:54 CPU family: 23 03:20:54 Model: 49 03:20:54 Thread(s) per core: 1 03:20:54 Core(s) per socket: 1 03:20:54 Socket(s): 2 03:20:54 Stepping: 0 03:20:54 BogoMIPS: 5600.00 03:20:54 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 clzero xsaveerptr wbnoinvd arat npt lbrv nrip_save tsc_scale vmcb_clean flushbyasid pausefilter pfthreshold v_vmsave_vmload vgif umip rdpid arch_capabilities 03:20:54 Virtualization: AMD-V 03:20:54 Hypervisor vendor: KVM 03:20:54 Virtualization type: full 03:20:54 L1d cache: 64 KiB (2 instances) 03:20:54 L1i cache: 64 KiB (2 instances) 03:20:54 L2 cache: 1 MiB (2 instances) 03:20:54 L3 cache: 32 MiB (2 instances) 03:20:54 NUMA node(s): 1 03:20:54 NUMA node0 CPU(s): 0,1 03:20:54 Vulnerability Gather data sampling: Not affected 03:20:54 Vulnerability Indirect target selection: Not affected 03:20:54 Vulnerability Itlb multihit: Not affected 03:20:54 Vulnerability L1tf: Not affected 03:20:54 Vulnerability Mds: Not affected 03:20:54 Vulnerability Meltdown: Not affected 03:20:54 Vulnerability Mmio stale data: Not affected 03:20:54 Vulnerability Reg file data sampling: Not affected 03:20:54 Vulnerability Retbleed: Mitigation; untrained return thunk; SMT disabled 03:20:54 Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode 03:20:54 Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl 03:20:54 Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization 03:20:54 Vulnerability Spectre v2: Mitigation; Retpolines; IBPB conditional; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected 03:20:54 Vulnerability Srbds: Not affected 03:20:54 Vulnerability Tsa: Not affected 03:20:54 Vulnerability Tsx async abort: Not affected 03:20:54 Vulnerability Vmscape: Not affected 03:20:54 03:20:54 03:20:54 ---> nproc: 03:20:54 2 03:20:54 03:20:54 03:20:54 ---> df -h: 03:20:54 Filesystem Size Used Avail Use% Mounted on 03:20:54 tmpfs 795M 1.1M 794M 1% /run 03:20:54 /dev/vda1 38G 7.9G 30G 21% / 03:20:54 tmpfs 3.9G 0 3.9G 0% /dev/shm 03:20:54 tmpfs 5.0M 0 5.0M 0% /run/lock 03:20:54 /dev/vda16 881M 117M 703M 15% /boot 03:20:54 /dev/vda15 105M 6.2M 99M 6% /boot/efi 03:20:54 tmpfs 795M 16K 795M 1% /run/user/1001 03:20:54 03:20:54 03:20:54 ---> free -m: 03:20:54 total used free shared buff/cache available 03:20:54 Mem: 7941 706 5410 4 2113 7235 03:20:54 Swap: 1023 0 1023 03:20:54 03:20:54 03:20:54 ---> ip addr: 03:20:54 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 03:20:54 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 03:20:54 inet 127.0.0.1/8 scope host lo 03:20:54 valid_lft forever preferred_lft forever 03:20:54 inet6 ::1/128 scope host noprefixroute 03:20:54 valid_lft forever preferred_lft forever 03:20:54 2: ens3: mtu 1458 qdisc mq state UP group default qlen 1000 03:20:54 link/ether fa:16:3e:14:84:6a brd ff:ff:ff:ff:ff:ff 03:20:54 altname enp0s3 03:20:54 inet 10.30.171.7/23 metric 100 brd 10.30.171.255 scope global dynamic ens3 03:20:54 valid_lft 76537sec preferred_lft 76537sec 03:20:54 inet6 fe80::f816:3eff:fe14:846a/64 scope link 03:20:54 valid_lft forever preferred_lft forever 03:20:54 03:20:54 03:20:54 ---> sar -b -r -n DEV: 03:20:54 Linux 6.8.0-138-generic (prd-queue-disttest-2c-1g-61452) 10/03/26 _x86_64_ (2 CPU) 03:20:54 03:20:54 00:36:35 LINUX RESTART (2 CPU) 03:20:54 03:20:54 00:40:07 tps rtps wtps dtps bread/s bwrtn/s bdscd/s 03:20:54 00:50:01 1.88 0.35 1.52 0.01 44.76 99.61 0.48 03:20:54 01:00:07 2.87 0.01 2.61 0.26 0.05 152.35 846.21 03:20:54 01:10:03 2.25 0.00 2.05 0.20 0.00 69.43 29.23 03:20:54 01:20:01 15.88 0.01 1.92 13.96 0.16 66.37 107871.71 03:20:54 01:30:07 1.53 0.00 1.51 0.02 0.00 18.62 1.08 03:20:54 01:40:07 1.17 0.00 1.17 0.00 0.00 14.76 0.00 03:20:54 01:50:01 1.18 0.00 1.18 0.00 0.00 14.79 0.00 03:20:54 02:00:07 1.59 0.00 1.58 0.01 0.00 19.41 0.70 03:20:54 02:10:07 6.63 0.44 5.05 1.14 37.04 375.57 3941.41 03:20:54 02:20:01 1.44 0.00 1.41 0.03 0.00 52.79 437.51 03:20:54 02:30:07 5.22 0.00 4.31 0.92 0.00 196.71 2859.31 03:20:54 02:40:07 1.09 0.00 1.09 0.00 0.00 14.04 0.01 03:20:54 02:50:01 1.28 0.00 1.28 0.00 0.00 16.38 0.00 03:20:54 03:00:07 1.58 0.00 1.57 0.02 0.00 19.96 0.33 03:20:54 03:10:07 1.46 0.00 1.46 0.00 0.00 17.96 0.00 03:20:54 03:20:01 5.80 0.00 4.56 1.24 0.00 225.09 1956.77 03:20:54 Average: 3.30 0.05 2.14 1.11 5.10 85.87 7357.10 03:20:54 03:20:54 00:40:07 kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 03:20:54 00:50:01 5627536 7473140 312148 3.84 63360 1958952 728260 7.93 481016 1728472 2112 03:20:54 01:00:07 5634288 7489856 294636 3.62 65304 1966628 731104 7.96 483456 1738092 64 03:20:54 01:10:03 5609240 7466536 317784 3.91 66568 1966964 764652 8.33 515412 1739692 192 03:20:54 01:20:01 5623292 7481904 302260 3.72 67428 1967332 732164 7.97 484488 1740892 336 03:20:54 01:30:07 5624992 7484232 299932 3.69 67596 1967792 732160 7.97 484620 1741392 164 03:20:54 01:40:07 5624320 7484056 300112 3.69 67764 1968120 732164 7.97 484912 1741888 196 03:20:54 01:50:01 5625888 7486104 298068 3.67 67924 1968440 732224 7.98 485024 1742368 252 03:20:54 02:00:07 5627612 7488312 295840 3.64 68076 1968772 732228 7.98 484792 1742852 72 03:20:54 02:10:07 5616224 7480268 301312 3.71 77148 1960760 732736 7.98 492812 1737328 8336 03:20:54 02:20:01 5614588 7479204 302388 3.72 77292 1961220 732744 7.98 492744 1737804 160 03:20:54 02:30:07 5623628 7483020 298356 3.67 80416 1952612 732092 7.97 492436 1732320 96 03:20:54 02:40:07 5624532 7484348 297028 3.65 80532 1952932 732092 7.97 492452 1732748 292 03:20:54 02:50:01 5624280 7484512 296872 3.65 80604 1953268 732124 7.97 492500 1733164 240 03:20:54 03:00:07 5602396 7463248 318160 3.91 80764 1953724 732120 7.97 492580 1733652 204 03:20:54 03:10:07 5603944 7465240 316144 3.89 80884 1954048 732120 7.97 492580 1734096 188 03:20:54 03:20:01 5554860 7417892 364048 4.48 84256 1953072 790480 8.61 550096 1736440 11116 03:20:54 Average: 5616351 7475742 307193 3.78 73495 1960915 737592 8.03 493870 1737075 1501 03:20:54 03:20:54 00:40:07 IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 03:20:54 00:50:01 lo 1.03 1.03 0.05 0.05 0.00 0.00 0.00 0.00 03:20:54 00:50:01 ens3 3.43 0.42 3.82 0.15 0.00 0.00 0.00 0.00 03:20:54 01:00:07 lo 1.01 1.01 0.05 0.05 0.00 0.00 0.00 0.00 03:20:54 01:00:07 ens3 2.30 0.60 0.77 0.37 0.00 0.00 0.00 0.00 03:20:54 01:10:03 lo 1.02 1.02 0.05 0.05 0.00 0.00 0.00 0.00 03:20:54 01:10:03 ens3 4.30 1.01 1.41 0.65 0.00 0.00 0.00 0.00 03:20:54 01:20:01 lo 1.01 1.01 0.05 0.05 0.00 0.00 0.00 0.00 03:20:54 01:20:01 ens3 3.07 0.52 0.79 0.35 0.00 0.00 0.00 0.00 03:20:54 01:30:07 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 03:20:54 01:30:07 ens3 0.96 0.08 0.18 0.06 0.00 0.00 0.00 0.00 03:20:54 01:40:07 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 03:20:54 01:40:07 ens3 0.96 0.06 4.93 0.05 0.00 0.00 0.00 0.00 03:20:54 01:50:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 03:20:54 01:50:01 ens3 0.62 0.10 0.14 0.07 0.00 0.00 0.00 0.00 03:20:54 02:00:07 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 03:20:54 02:00:07 ens3 0.44 0.03 0.05 0.01 0.00 0.00 0.00 0.00 03:20:54 02:10:07 lo 1.16 1.16 0.07 0.07 0.00 0.00 0.00 0.00 03:20:54 02:10:07 ens3 8.54 7.07 27.18 3.92 0.00 0.00 0.00 0.00 03:20:54 02:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 03:20:54 02:20:01 ens3 0.37 0.06 0.24 0.02 0.00 0.00 0.00 0.00 03:20:54 02:30:07 lo 1.16 1.16 0.07 0.07 0.00 0.00 0.00 0.00 03:20:54 02:30:07 ens3 6.39 5.36 11.83 1.56 0.00 0.00 0.00 0.00 03:20:54 02:40:07 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 03:20:54 02:40:07 ens3 0.45 0.09 0.10 0.06 0.00 0.00 0.00 0.00 03:20:54 02:50:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 03:20:54 02:50:01 ens3 0.61 0.12 0.17 0.11 0.00 0.00 0.00 0.00 03:20:54 03:00:07 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 03:20:54 03:00:07 ens3 0.31 0.06 0.07 0.03 0.00 0.00 0.00 0.00 03:20:54 03:10:07 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 03:20:54 03:10:07 ens3 0.32 0.06 0.06 0.03 0.00 0.00 0.00 0.00 03:20:54 03:20:01 lo 1.22 1.22 0.07 0.07 0.00 0.00 0.00 0.00 03:20:54 03:20:01 ens3 8.23 6.95 16.28 3.14 0.00 0.00 0.00 0.00 03:20:54 Average: lo 1.04 1.04 0.05 0.05 0.00 0.00 0.00 0.00 03:20:54 Average: ens3 2.58 1.41 4.25 0.66 0.00 0.00 0.00 0.00 03:20:54 03:20:54 03:20:54 ---> sar -P ALL: 03:20:54 Linux 6.8.0-138-generic (prd-queue-disttest-2c-1g-61452) 10/03/26 _x86_64_ (2 CPU) 03:20:54 03:20:54 00:36:35 LINUX RESTART (2 CPU) 03:20:54 03:20:54 00:40:07 CPU %user %nice %system %iowait %steal %idle 03:20:54 00:50:01 all 0.41 0.00 0.12 0.05 0.00 99.41 03:20:54 00:50:01 0 0.33 0.00 0.17 0.02 0.00 99.48 03:20:54 00:50:01 1 0.49 0.00 0.08 0.08 0.00 99.35 03:20:54 01:00:07 all 1.06 0.00 0.27 0.03 0.00 98.64 03:20:54 01:00:07 0 1.58 0.00 0.29 0.02 0.00 98.10 03:20:54 01:00:07 1 0.53 0.00 0.24 0.04 0.00 99.18 03:20:54 01:10:03 all 1.06 0.00 0.21 0.03 0.00 98.70 03:20:54 01:10:03 0 0.63 0.00 0.18 0.01 0.00 99.18 03:20:54 01:10:03 1 1.48 0.00 0.24 0.05 0.01 98.22 03:20:54 01:20:01 all 0.94 0.00 0.13 0.05 0.00 98.88 03:20:54 01:20:01 0 0.45 0.00 0.08 0.02 0.00 99.46 03:20:54 01:20:01 1 1.43 0.00 0.18 0.09 0.00 98.30 03:20:54 01:30:07 all 0.27 0.00 0.16 0.01 0.00 99.55 03:20:54 01:30:07 0 0.46 0.00 0.12 0.01 0.00 99.40 03:20:54 01:30:07 1 0.08 0.00 0.20 0.02 0.01 99.69 03:20:54 01:40:07 all 0.24 0.00 0.06 0.01 0.00 99.68 03:20:54 01:40:07 0 0.44 0.00 0.05 0.01 0.00 99.51 03:20:54 01:40:07 1 0.04 0.00 0.08 0.02 0.00 99.86 03:20:54 01:50:01 all 0.25 0.00 0.07 0.01 0.00 99.67 03:20:54 01:50:01 0 0.44 0.00 0.05 0.01 0.00 99.50 03:20:54 01:50:01 1 0.05 0.00 0.09 0.01 0.01 99.84 03:20:54 02:00:07 all 0.27 0.00 0.16 0.01 0.00 99.56 03:20:54 02:00:07 0 0.47 0.00 0.13 0.01 0.00 99.38 03:20:54 02:00:07 1 0.06 0.00 0.18 0.01 0.00 99.74 03:20:54 02:10:07 all 4.03 0.00 0.57 0.15 0.01 95.23 03:20:54 02:10:07 0 3.22 0.00 0.54 0.24 0.01 95.99 03:20:54 02:10:07 1 4.85 0.00 0.59 0.07 0.01 94.48 03:20:54 02:20:01 all 0.24 0.00 0.07 0.01 0.00 99.68 03:20:54 02:20:01 0 0.05 0.00 0.07 0.02 0.00 99.86 03:20:54 02:20:01 1 0.43 0.00 0.06 0.00 0.00 99.50 03:20:54 02:30:07 all 3.66 0.00 0.59 0.12 0.00 95.63 03:20:54 02:30:07 0 1.89 0.00 0.51 0.04 0.00 97.55 03:20:54 02:30:07 1 5.42 0.00 0.67 0.21 0.00 93.70 03:20:54 03:20:54 02:30:07 CPU %user %nice %system %iowait %steal %idle 03:20:54 02:40:07 all 0.25 0.00 0.07 0.02 0.00 99.66 03:20:54 02:40:07 0 0.45 0.00 0.04 0.02 0.00 99.48 03:20:54 02:40:07 1 0.05 0.00 0.09 0.01 0.01 99.84 03:20:54 02:50:01 all 0.27 0.00 0.09 0.02 0.01 99.61 03:20:54 02:50:01 0 0.17 0.00 0.09 0.01 0.01 99.72 03:20:54 02:50:01 1 0.38 0.00 0.09 0.03 0.01 99.50 03:20:54 03:00:07 all 0.30 0.00 0.22 0.01 0.00 99.47 03:20:54 03:00:07 0 0.14 0.00 0.22 0.02 0.00 99.62 03:20:54 03:00:07 1 0.46 0.00 0.21 0.01 0.00 99.32 03:20:54 03:10:07 all 0.26 0.00 0.13 0.01 0.00 99.59 03:20:54 03:10:07 0 0.06 0.00 0.15 0.02 0.01 99.77 03:20:54 03:10:07 1 0.46 0.00 0.11 0.00 0.00 99.42 03:20:54 03:20:01 all 4.30 0.00 0.61 0.14 0.01 94.95 03:20:54 03:20:01 0 4.35 0.00 0.56 0.05 0.01 95.03 03:20:54 03:20:01 1 4.25 0.00 0.66 0.22 0.01 94.86 03:20:54 Average: all 1.11 0.00 0.22 0.04 0.00 98.62 03:20:54 Average: 0 0.95 0.00 0.21 0.03 0.00 98.81 03:20:54 Average: 1 1.28 0.00 0.24 0.05 0.00 98.42 03:20:54 03:20:54 03:20:54