01:09:42 Started by upstream project "autorelease-release-chromium-mvn39-openjdk21" build number 254 01:09:42 originally caused by: 01:09:42 Started by timer 01:09:42 Running as SYSTEM 01:09:42 [EnvInject] - Loading node environment variables. 01:09:42 Building remotely on prd-queue-disttest-2c-1g-61795 (queue-disttest-2c-1g) in workspace /w/workspace/integration-distribution-test-chromium 01:09:42 [ssh-agent] Looking for ssh-agent implementation... 01:09:42 [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) 01:09:42 $ ssh-agent 01:09:42 SSH_AUTH_SOCK=/tmp/ssh-c0fXRKUIzCho/agent.5896 01:09:42 SSH_AGENT_PID=5898 01:09:42 [ssh-agent] Started. 01:09:42 Running ssh-add (command line suppressed) 01:09:42 Identity added: /w/workspace/integration-distribution-test-chromium@tmp/private_key_9809499079022169718.key (/w/workspace/integration-distribution-test-chromium@tmp/private_key_9809499079022169718.key) 01:09:42 [ssh-agent] Using credentials jenkins (jenkins-ssh) 01:09:42 No emails were triggered. 01:09:42 provisioning config files... 01:09:42 copy managed file [npmrc] to file:/home/jenkins/.npmrc 01:09:42 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 01:09:42 [integration-distribution-test-chromium] $ /bin/bash /tmp/jenkins7681996617424421642.sh 01:09:43 ---> python-tools-install.sh 01:09:43 Setup pyenv: 01:09:43 * system (set by /opt/pyenv/version) 01:09:43 * 3.8.20 (set by /opt/pyenv/version) 01:09:43 * 3.9.20 (set by /opt/pyenv/version) 01:09:43 3.10.15 01:09:43 3.11.10 01:09:43 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-mUqW from file:/tmp/.os_lf_venv 01:09:43 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 01:09:45 lf-activate-venv(): INFO: Installing additional packages: lftools 01:09:54 lf-activate-venv(): INFO: Adding /tmp/venv-mUqW/bin to PATH 01:09:54 [integration-distribution-test-chromium] $ /bin/sh /tmp/jenkins5110235519973844780.sh 01:09:54 ---> uv-install.sh 01:09:54 uv 0.12.23 is already installed 01:09:54 uvx 0.12.23 (x86_64-unknown-linux-gnu) 01:09:55 Waiting for the completion of bgpcep-csit-1node-bgp-ingest-all-chromium 01:10:51 bgpcep-csit-1node-bgp-ingest-all-chromium #4 started. 03:21:47 bgpcep-csit-1node-bgp-ingest-all-chromium #4 completed. Result was UNSTABLE 03:21:47 Waiting for the completion of bgpcep-csit-1node-bgp-ingest-mixed-all-chromium 03:21:47 bgpcep-csit-1node-bgp-ingest-mixed-all-chromium #4 started. 03:21:47 bgpcep-csit-1node-bgp-ingest-mixed-all-chromium #4 completed. Result was SUCCESS 03:21:47 Waiting for the completion of bgpcep-csit-1node-throughpcep-all-chromium 03:21:47 bgpcep-csit-1node-throughpcep-all-chromium #4 started. 03:21:47 bgpcep-csit-1node-throughpcep-all-chromium #4 completed. Result was UNSTABLE 03:21:47 Waiting for the completion of bgpcep-csit-1node-userfeatures-all-chromium 03:21:47 bgpcep-csit-1node-userfeatures-all-chromium #4 started. 03:21:47 bgpcep-csit-1node-userfeatures-all-chromium #4 completed. Result was UNSTABLE 03:21:47 Waiting for the completion of daexim-csit-1node-basic-only-chromium 03:21:47 daexim-csit-1node-basic-only-chromium #103 started. 03:21:47 daexim-csit-1node-basic-only-chromium #103 completed. Result was UNSTABLE 03:21:47 Waiting for the completion of daexim-csit-3node-clustering-basic-only-chromium 03:21:47 daexim-csit-3node-clustering-basic-only-chromium #103 started. 03:21:47 daexim-csit-3node-clustering-basic-only-chromium #103 completed. Result was FAILURE 03:21:47 Waiting for the completion of distribution-csit-managed-chromium 03:21:47 distribution-csit-managed-chromium #103 started. 03:21:47 distribution-csit-managed-chromium #103 completed. Result was SUCCESS 03:21:47 Waiting for the completion of jsonrpc-csit-1node-basic-only-chromium 03:21:47 jsonrpc-csit-1node-basic-only-chromium #103 started. 03:21:47 jsonrpc-csit-1node-basic-only-chromium #103 completed. Result was SUCCESS 03:21:47 Waiting for the completion of openflowplugin-csit-1node-cbench-only-chromium 03:21:47 openflowplugin-csit-1node-cbench-only-chromium #103 started. 03:21:47 openflowplugin-csit-1node-cbench-only-chromium #103 completed. Result was UNSTABLE 03:21:47 Waiting for the completion of openflowplugin-csit-1node-flow-services-all-chromium 03:21:47 openflowplugin-csit-1node-flow-services-all-chromium #103 started. 03:21:47 openflowplugin-csit-1node-flow-services-all-chromium #103 completed. Result was UNSTABLE 03:21:47 Waiting for the completion of openflowplugin-csit-1node-perf-bulkomatic-only-chromium 03:21:47 openflowplugin-csit-1node-perf-bulkomatic-only-chromium #103 started. 03:21:47 openflowplugin-csit-1node-perf-bulkomatic-only-chromium #103 completed. Result was UNSTABLE 03:21:47 Waiting for the completion of openflowplugin-csit-1node-perf-stats-collection-only-chromium 03:21:47 openflowplugin-csit-1node-perf-stats-collection-only-chromium #103 started. 03:21:47 openflowplugin-csit-1node-perf-stats-collection-only-chromium #103 completed. Result was UNSTABLE 03:21:47 Waiting for the completion of openflowplugin-csit-1node-scale-link-only-chromium 03:21:47 openflowplugin-csit-1node-scale-link-only-chromium #103 started. 03:21:47 openflowplugin-csit-1node-scale-link-only-chromium #103 completed. Result was UNSTABLE 03:21:47 Waiting for the completion of openflowplugin-csit-1node-scale-only-chromium 03:21:47 openflowplugin-csit-1node-scale-only-chromium #103 started. 03:21:47 openflowplugin-csit-1node-scale-only-chromium #103 completed. Result was UNSTABLE 03:21:47 Waiting for the completion of openflowplugin-csit-1node-scale-switch-only-chromium 03:21:47 openflowplugin-csit-1node-scale-switch-only-chromium #103 started. 03:21:47 openflowplugin-csit-1node-scale-switch-only-chromium #103 completed. Result was UNSTABLE 03:21:47 Waiting for the completion of openflowplugin-csit-3node-clustering-bulkomatic-only-chromium 03:21:47 openflowplugin-csit-3node-clustering-bulkomatic-only-chromium #103 started. 03:21:47 openflowplugin-csit-3node-clustering-bulkomatic-only-chromium #103 completed. Result was FAILURE 03:21:47 Waiting for the completion of openflowplugin-csit-3node-clustering-only-chromium 03:21:47 openflowplugin-csit-3node-clustering-only-chromium #103 started. 03:21:47 openflowplugin-csit-3node-clustering-only-chromium #103 completed. Result was FAILURE 03:21:47 Waiting for the completion of openflowplugin-csit-3node-clustering-perf-bulkomatic-only-chromium 03:21:47 openflowplugin-csit-3node-clustering-perf-bulkomatic-only-chromium #103 started. 03:21:47 openflowplugin-csit-3node-clustering-perf-bulkomatic-only-chromium #103 completed. Result was FAILURE 03:21:47 Waiting for the completion of ovsdb-csit-1node-upstream-southbound-all-chromium 03:21:47 ovsdb-csit-1node-upstream-southbound-all-chromium #103 started. 03:21:47 ovsdb-csit-1node-upstream-southbound-all-chromium #103 completed. Result was UNSTABLE 03:21:47 Waiting for the completion of ovsdb-csit-3node-upstream-clustering-only-chromium 03:21:47 ovsdb-csit-3node-upstream-clustering-only-chromium #103 started. 03:21:47 ovsdb-csit-3node-upstream-clustering-only-chromium #103 completed. Result was FAILURE 03:21:47 Build step 'Trigger/call builds on other projects' changed build result to UNSTABLE 03:21:47 Build step 'Trigger/call builds on other projects' marked build as failure 03:21:47 $ ssh-agent -k 03:21:47 unset SSH_AUTH_SOCK; 03:21:47 unset SSH_AGENT_PID; 03:21:47 echo Agent pid 5898 killed; 03:21:47 [ssh-agent] Stopped. 03:21:47 [PostBuildScript] - [INFO] Executing post build scripts. 03:21:47 [integration-distribution-test-chromium] $ /bin/sh /tmp/jenkins7928559222302176347.sh 03:21:51 python /tmp/tmp.efdDLcFtvL https://jenkins.opendaylight.org/releng/job/integration-distribution-test-chromium/105/ 03:21:51 /tmp/tmp.efdDLcFtvL:26: DeprecationWarning: Call to deprecated method findAll. (Replaced by find_all) -- Deprecated since version 4.0.0. 03:21:51 links = soup.findAll("a", { "class" : "model-link" }) 03:21:51 [PostBuildScript] - [INFO] Executing post build scripts. 03:21:51 [integration-distribution-test-chromium] $ /bin/bash /tmp/jenkins16518930901209746297.sh 03:21:51 ---> sysstat.sh 03:21:52 [integration-distribution-test-chromium] $ /bin/bash /tmp/jenkins7372546544366151149.sh 03:21:52 ---> package-listing.sh 03:21:52 + '[' -f /etc/os-release ']' 03:21:52 + . /etc/os-release 03:21:52 ++ PRETTY_NAME='Ubuntu 24.04.4 LTS' 03:21:52 ++ NAME=Ubuntu 03:21:52 ++ VERSION_ID=24.04 03:21:52 ++ VERSION='24.04.4 LTS (Noble Numbat)' 03:21:52 ++ VERSION_CODENAME=noble 03:21:52 ++ ID=ubuntu 03:21:52 ++ ID_LIKE=debian 03:21:52 ++ HOME_URL=https://www.ubuntu.com/ 03:21:52 ++ SUPPORT_URL=https://help.ubuntu.com/ 03:21:52 ++ BUG_REPORT_URL=https://bugs.launchpad.net/ubuntu/ 03:21:52 ++ PRIVACY_POLICY_URL=https://www.ubuntu.com/legal/terms-and-policies/privacy-policy 03:21:52 ++ UBUNTU_CODENAME=noble 03:21:52 ++ LOGO=ubuntu-logo 03:21:52 + case " ${ID:-} ${ID_LIKE:-} " in 03:21:52 + OS_FAMILY=debian 03:21:52 + workspace=/w/workspace/integration-distribution-test-chromium 03:21:52 + START_PACKAGES=/tmp/packages_start.txt 03:21:52 + END_PACKAGES=/tmp/packages_end.txt 03:21:52 + DIFF_PACKAGES=/tmp/packages_diff.txt 03:21:52 + PACKAGES=/tmp/packages_start.txt 03:21:52 + '[' /w/workspace/integration-distribution-test-chromium ']' 03:21:52 + PACKAGES=/tmp/packages_end.txt 03:21:52 + case "${OS_FAMILY}" in 03:21:52 + grep '^ii' 03:21:52 + dpkg -l 03:21:52 + '[' -f /tmp/packages_start.txt ']' 03:21:52 + '[' -f /tmp/packages_end.txt ']' 03:21:52 + diff /tmp/packages_start.txt /tmp/packages_end.txt 03:21:52 + '[' /w/workspace/integration-distribution-test-chromium ']' 03:21:52 + mkdir -p /w/workspace/integration-distribution-test-chromium/archives/ 03:21:52 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/integration-distribution-test-chromium/archives/ 03:21:52 + exit 0 03:21:52 [integration-distribution-test-chromium] $ /bin/bash /tmp/jenkins734491998620770021.sh 03:21:52 ---> capture-instance-metadata.sh 03:21:52 Setup pyenv: 03:21:52 system 03:21:52 3.8.20 03:21:52 3.9.20 03:21:52 3.10.15 03:21:52 * 3.11.10 (set by /w/workspace/integration-distribution-test-chromium/.python-version) 03:21:52 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-mUqW from file:/tmp/.os_lf_venv 03:21:52 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 03:21:54 lf-activate-venv(): INFO: Installing additional packages: lftools 03:22:04 lf-activate-venv(): INFO: Adding /tmp/venv-mUqW/bin to PATH 03:22:04 INFO: Running in OpenStack, capturing instance metadata 03:22:04 [integration-distribution-test-chromium] $ /bin/bash /tmp/jenkins16100321553415900987.sh 03:22:04 provisioning config files... 03:22:04 Could not find credentials [logs] for integration-distribution-test-chromium #105 03:22:04 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/integration-distribution-test-chromium@tmp/config5138479889239356952tmp 03:22:04 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] 03:22:04 Run condition [Regular expression match] enabling perform for step [Provide Configuration files] 03:22:04 provisioning config files... 03:22:05 copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials 03:22:05 [EnvInject] - Injecting environment variables from a build step. 03:22:05 [EnvInject] - Injecting as environment variables the properties content 03:22:05 SERVER_ID=logs 03:22:05 03:22:05 [EnvInject] - Variables injected successfully. 03:22:05 [integration-distribution-test-chromium] $ /bin/bash /tmp/jenkins14836798175419934292.sh 03:22:05 ---> create-netrc.sh 03:22:05 WARN: Log server credential not found. 03:22:05 [integration-distribution-test-chromium] $ /bin/bash /tmp/jenkins4769836971483644441.sh 03:22:05 ---> python-tools-install.sh 03:22:05 Setup pyenv: 03:22:05 system 03:22:05 3.8.20 03:22:05 3.9.20 03:22:05 3.10.15 03:22:05 * 3.11.10 (set by /w/workspace/integration-distribution-test-chromium/.python-version) 03:22:05 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-mUqW from file:/tmp/.os_lf_venv 03:22:05 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 03:22:07 lf-activate-venv(): INFO: Installing additional packages: lftools 03:22:17 lf-activate-venv(): INFO: Adding /tmp/venv-mUqW/bin to PATH 03:22:17 [integration-distribution-test-chromium] $ /bin/sh /tmp/jenkins12653616836353942152.sh 03:22:17 ---> uv-install.sh 03:22:17 uv 0.12.23 is already installed 03:22:17 uvx 0.12.23 (x86_64-unknown-linux-gnu) 03:22:17 [integration-distribution-test-chromium] $ /bin/bash /tmp/jenkins1461163029914986429.sh 03:22:17 ---> sudo-logs.sh 03:22:17 Archiving 'sudo' log.. 03:22:17 [integration-distribution-test-chromium] $ /bin/bash /tmp/jenkins1681078742351874388.sh 03:22:17 ---> job-cost.sh 03:22:17 INFO: Activating Python virtual environment... 03:22:17 Setup pyenv: 03:22:17 system 03:22:17 3.8.20 03:22:17 3.9.20 03:22:17 3.10.15 03:22:17 * 3.11.10 (set by /w/workspace/integration-distribution-test-chromium/.python-version) 03:22:18 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-mUqW from file:/tmp/.os_lf_venv 03:22:18 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 03:22:19 lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 03:22:26 lf-activate-venv(): INFO: Adding /tmp/venv-mUqW/bin to PATH 03:22:26 INFO: No stack-cost file found 03:22:26 INFO: Instance uptime: 10114s 03:22:26 INFO: Fetching instance metadata (attempt 1 of 3)... 03:22:26 DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type 03:22:26 INFO: Successfully fetched instance metadata 03:22:26 INFO: Instance type: v3-standard-2 03:22:26 INFO: Retrieving pricing info for: v3-standard-2 03:22:26 INFO: Fetching Vexxhost pricing API (attempt 1 of 3)... 03:22:26 DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-standard-2/cost?seconds=10114 03:22:26 INFO: Successfully fetched Vexxhost pricing API 03:22:26 INFO: Retrieved cost: 0.17 03:22:26 INFO: Retrieved resource: v3-standard-2 03:22:26 INFO: Creating archive directory: /w/workspace/integration-distribution-test-chromium/archives/cost 03:22:26 INFO: Archiving costs to: /w/workspace/integration-distribution-test-chromium/archives/cost.csv 03:22:26 INFO: Successfully archived job cost data 03:22:26 DEBUG: Cost data: integration-distribution-test-chromium,105,2026-10-04 03:22:26,v3-standard-2,10114,0.17,0.00,FAILURE 03:22:26 [integration-distribution-test-chromium] $ /bin/bash -l /tmp/jenkins12037900059750591371.sh 03:22:26 ---> logs-deploy.sh 03:22:27 Setup pyenv: 03:22:27 system 03:22:27 3.8.20 03:22:27 3.9.20 03:22:27 3.10.15 03:22:27 * 3.11.10 (set by /w/workspace/integration-distribution-test-chromium/.python-version) 03:22:27 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-mUqW from file:/tmp/.os_lf_venv 03:22:27 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 03:22:29 lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 03:22:44 lf-activate-venv(): INFO: Adding /tmp/venv-mUqW/bin to PATH 03:22:44 WARNING: Nexus logging server not set 03:22:44 INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/integration-distribution-test-chromium/105/ 03:22:44 INFO: archiving logs to S3 03:22:45 ---> uname -a: 03:22:45 Linux prd-queue-disttest-2c-1g-61795 6.8.0-138-generic #138-Ubuntu SMP PREEMPT_DYNAMIC Fri Jul 31 22:41:49 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux 03:22:45 03:22:45 03:22:45 ---> lscpu: 03:22:45 Architecture: x86_64 03:22:45 CPU op-mode(s): 32-bit, 64-bit 03:22:45 Address sizes: 40 bits physical, 48 bits virtual 03:22:45 Byte Order: Little Endian 03:22:45 CPU(s): 2 03:22:45 On-line CPU(s) list: 0,1 03:22:45 Vendor ID: AuthenticAMD 03:22:45 Model name: AMD EPYC-Rome Processor 03:22:45 CPU family: 23 03:22:45 Model: 49 03:22:45 Thread(s) per core: 1 03:22:45 Core(s) per socket: 1 03:22:45 Socket(s): 2 03:22:45 Stepping: 0 03:22:45 BogoMIPS: 5599.99 03:22:45 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 clzero xsaveerptr wbnoinvd arat npt lbrv nrip_save tsc_scale vmcb_clean flushbyasid pausefilter pfthreshold v_vmsave_vmload vgif umip rdpid arch_capabilities 03:22:45 Virtualization: AMD-V 03:22:45 Hypervisor vendor: KVM 03:22:45 Virtualization type: full 03:22:45 L1d cache: 64 KiB (2 instances) 03:22:45 L1i cache: 64 KiB (2 instances) 03:22:45 L2 cache: 1 MiB (2 instances) 03:22:45 L3 cache: 32 MiB (2 instances) 03:22:45 NUMA node(s): 1 03:22:45 NUMA node0 CPU(s): 0,1 03:22:45 Vulnerability Gather data sampling: Not affected 03:22:45 Vulnerability Indirect target selection: Not affected 03:22:45 Vulnerability Itlb multihit: Not affected 03:22:45 Vulnerability L1tf: Not affected 03:22:45 Vulnerability Mds: Not affected 03:22:45 Vulnerability Meltdown: Not affected 03:22:45 Vulnerability Mmio stale data: Not affected 03:22:45 Vulnerability Reg file data sampling: Not affected 03:22:45 Vulnerability Retbleed: Mitigation; untrained return thunk; SMT disabled 03:22:45 Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode 03:22:45 Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl 03:22:45 Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization 03:22:45 Vulnerability Spectre v2: Mitigation; Retpolines; IBPB conditional; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected 03:22:45 Vulnerability Srbds: Not affected 03:22:45 Vulnerability Tsa: Not affected 03:22:45 Vulnerability Tsx async abort: Not affected 03:22:45 Vulnerability Vmscape: Not affected 03:22:45 03:22:45 03:22:45 ---> nproc: 03:22:45 2 03:22:45 03:22:45 03:22:45 ---> df -h: 03:22:45 Filesystem Size Used Avail Use% Mounted on 03:22:45 tmpfs 795M 1.1M 794M 1% /run 03:22:45 /dev/vda1 38G 7.9G 30G 21% / 03:22:45 tmpfs 3.9G 0 3.9G 0% /dev/shm 03:22:45 tmpfs 5.0M 0 5.0M 0% /run/lock 03:22:45 /dev/vda16 881M 117M 703M 15% /boot 03:22:45 /dev/vda15 105M 6.2M 99M 6% /boot/efi 03:22:45 tmpfs 795M 16K 795M 1% /run/user/1001 03:22:45 03:22:45 03:22:45 ---> free -m: 03:22:45 total used free shared buff/cache available 03:22:45 Mem: 7941 728 5383 4 2119 7213 03:22:45 Swap: 1023 0 1023 03:22:45 03:22:45 03:22:45 ---> ip addr: 03:22:45 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 03:22:45 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 03:22:45 inet 127.0.0.1/8 scope host lo 03:22:45 valid_lft forever preferred_lft forever 03:22:45 inet6 ::1/128 scope host noprefixroute 03:22:45 valid_lft forever preferred_lft forever 03:22:45 2: ens3: mtu 1458 qdisc mq state UP group default qlen 1000 03:22:45 link/ether fa:16:3e:2a:c9:28 brd ff:ff:ff:ff:ff:ff 03:22:45 altname enp0s3 03:22:45 inet 10.30.171.50/23 metric 100 brd 10.30.171.255 scope global dynamic ens3 03:22:45 valid_lft 76278sec preferred_lft 76278sec 03:22:45 inet6 fe80::f816:3eff:fe2a:c928/64 scope link 03:22:45 valid_lft forever preferred_lft forever 03:22:45 03:22:45 03:22:45 ---> sar -b -r -n DEV: 03:22:45 Linux 6.8.0-138-generic (prd-queue-disttest-2c-1g-61795) 10/04/26 _x86_64_ (2 CPU) 03:22:45 03:22:45 00:34:06 LINUX RESTART (2 CPU) 03:22:45 03:22:45 00:40:01 tps rtps wtps dtps bread/s bwrtn/s bdscd/s 03:22:45 00:50:44 1.20 0.01 1.19 0.00 0.05 15.41 0.02 03:22:45 01:00:34 17.15 0.33 2.79 14.03 43.97 239.85 110039.01 03:22:45 01:10:00 3.24 0.00 2.85 0.40 0.00 132.75 287.51 03:22:45 01:20:04 1.65 0.00 1.60 0.05 0.01 45.96 62.12 03:22:45 01:30:34 1.57 0.00 1.53 0.04 0.00 19.19 0.83 03:22:45 01:40:01 7.54 0.47 5.81 1.27 39.22 473.95 6212.92 03:22:45 01:50:44 4.61 0.00 3.77 0.84 0.00 181.41 1537.69 03:22:45 02:00:04 1.61 0.00 1.59 0.02 0.00 20.06 0.24 03:22:45 02:10:01 5.08 0.00 4.17 0.91 0.00 195.22 1857.67 03:22:45 02:20:04 1.18 0.00 1.18 0.00 0.00 14.93 0.00 03:22:45 02:30:34 1.54 0.00 1.53 0.02 0.00 19.20 0.23 03:22:45 02:40:01 1.45 0.01 1.45 0.00 0.11 17.91 0.04 03:22:45 02:50:24 1.37 0.00 1.37 0.00 0.00 16.47 0.00 03:22:45 03:00:04 1.61 0.00 1.59 0.02 0.00 20.08 0.25 03:22:45 03:10:01 1.41 0.00 1.41 0.00 0.00 16.92 0.00 03:22:45 03:20:44 1.50 0.00 1.50 0.00 0.00 17.79 0.00 03:22:45 Average: 3.32 0.05 2.19 1.08 5.01 88.58 7336.71 03:22:45 03:22:45 00:40:01 kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 03:22:45 00:50:44 5685752 7497460 288096 3.54 63208 1925692 529744 5.77 463808 1704404 124 03:22:45 01:00:34 5626460 7487424 296948 3.65 65492 1971964 724864 7.90 483040 1742844 208 03:22:45 01:10:00 5615264 7478664 305520 3.76 67448 1972268 727344 7.92 485748 1745108 8404 03:22:45 01:20:04 5628960 7493040 291132 3.58 67692 1972720 727400 7.92 485812 1745668 244 03:22:45 01:30:34 5622088 7486760 297428 3.66 67928 1973080 727400 7.92 485820 1746260 164 03:22:45 01:40:01 5593704 7461896 319592 3.93 77196 1965024 744436 8.11 505148 1740900 124 03:22:45 01:50:44 5591188 7454332 326952 4.02 80492 1956436 743700 8.10 504764 1735608 180 03:22:45 02:00:04 5594340 7457888 323376 3.98 80628 1956728 743700 8.10 504884 1736020 132 03:22:45 02:10:01 5568076 7435332 345768 4.25 83496 1957368 743176 8.09 505308 1739408 248 03:22:45 02:20:04 5575828 7443548 337568 4.15 83628 1957692 743188 8.09 505400 1739872 220 03:22:45 02:30:34 5582296 7450508 330576 4.06 83752 1958052 743188 8.09 505332 1740356 156 03:22:45 02:40:01 5584656 7453316 327768 4.03 83868 1958384 743188 8.09 505304 1740804 240 03:22:45 02:50:24 5584416 7453544 327540 4.03 83972 1958748 743252 8.10 505308 1741272 244 03:22:45 03:00:04 5589992 7459680 321364 3.95 84112 1959168 743252 8.10 505584 1741704 216 03:22:45 03:10:01 5589040 7459152 321868 3.96 84212 1959496 743252 8.10 505636 1742128 328 03:22:45 03:20:44 5588540 7459124 321916 3.96 84320 1959856 743396 8.10 505800 1742600 148 03:22:45 Average: 5601288 7464479 317713 3.91 77590 1960167 725905 7.91 497668 1739060 711 03:22:45 03:22:45 00:40:01 IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 03:22:45 00:50:44 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 03:22:45 00:50:44 ens3 2.89 0.14 0.42 0.11 0.00 0.00 0.00 0.00 03:22:45 01:00:34 lo 1.04 1.04 0.05 0.05 0.00 0.00 0.00 0.00 03:22:45 01:00:34 ens3 2.26 0.94 4.12 0.40 0.00 0.00 0.00 0.00 03:22:45 01:10:00 lo 1.03 1.03 0.05 0.05 0.00 0.00 0.00 0.00 03:22:45 01:10:00 ens3 3.67 1.36 1.62 0.85 0.00 0.00 0.00 0.00 03:22:45 01:20:04 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 03:22:45 01:20:04 ens3 2.80 0.23 0.55 0.22 0.00 0.00 0.00 0.00 03:22:45 01:30:34 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 03:22:45 01:30:34 ens3 0.69 0.07 0.11 0.06 0.00 0.00 0.00 0.00 03:22:45 01:40:01 lo 1.17 1.17 0.07 0.07 0.00 0.00 0.00 0.00 03:22:45 01:40:01 ens3 9.73 7.89 28.90 4.13 0.00 0.00 0.00 0.00 03:22:45 01:50:44 lo 1.15 1.15 0.07 0.07 0.00 0.00 0.00 0.00 03:22:45 01:50:44 ens3 7.64 5.22 11.50 1.48 0.00 0.00 0.00 0.00 03:22:45 02:00:04 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 03:22:45 02:00:04 ens3 0.46 0.04 0.04 0.02 0.00 0.00 0.00 0.00 03:22:45 02:10:01 lo 1.16 1.16 0.07 0.07 0.00 0.00 0.00 0.00 03:22:45 02:10:01 ens3 6.87 6.07 11.86 2.85 0.00 0.00 0.00 0.00 03:22:45 02:20:04 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 03:22:45 02:20:04 ens3 0.41 0.05 0.20 0.02 0.00 0.00 0.00 0.00 03:22:45 02:30:34 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 03:22:45 02:30:34 ens3 0.33 0.04 0.04 0.01 0.00 0.00 0.00 0.00 03:22:45 02:40:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 03:22:45 02:40:01 ens3 0.44 0.08 0.09 0.05 0.00 0.00 0.00 0.00 03:22:45 02:50:24 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 03:22:45 02:50:24 ens3 0.32 0.03 0.03 0.01 0.00 0.00 0.00 0.00 03:22:45 03:00:04 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 03:22:45 03:00:04 ens3 0.41 0.06 0.08 0.04 0.00 0.00 0.00 0.00 03:22:45 03:10:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 03:22:45 03:10:01 ens3 0.41 0.06 0.09 0.05 0.00 0.00 0.00 0.00 03:22:45 03:20:44 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 03:22:45 03:20:44 ens3 0.99 0.05 0.12 0.03 0.00 0.00 0.00 0.00 03:22:45 Average: lo 1.03 1.03 0.05 0.05 0.00 0.00 0.00 0.00 03:22:45 Average: ens3 2.51 1.38 3.66 0.63 0.00 0.00 0.00 0.00 03:22:45 03:22:45 03:22:45 ---> sar -P ALL: 03:22:45 Linux 6.8.0-138-generic (prd-queue-disttest-2c-1g-61795) 10/04/26 _x86_64_ (2 CPU) 03:22:45 03:22:45 00:34:06 LINUX RESTART (2 CPU) 03:22:45 03:22:45 00:40:01 CPU %user %nice %system %iowait %steal %idle 03:22:45 00:50:44 all 0.26 0.00 0.08 0.01 0.00 99.65 03:22:45 00:50:44 0 0.05 0.00 0.09 0.01 0.00 99.84 03:22:45 00:50:44 1 0.47 0.00 0.07 0.01 0.00 99.45 03:22:45 01:00:34 all 1.29 0.00 0.32 0.11 0.00 98.28 03:22:45 01:00:34 0 1.95 0.00 0.38 0.09 0.01 97.58 03:22:45 01:00:34 1 0.63 0.00 0.26 0.14 0.00 98.97 03:22:45 01:10:00 all 1.88 0.00 0.28 0.10 0.00 97.73 03:22:45 01:10:00 0 3.18 0.00 0.32 0.14 0.01 96.36 03:22:45 01:10:00 1 0.59 0.00 0.23 0.07 0.00 99.11 03:22:45 01:20:04 all 0.26 0.00 0.08 0.01 0.00 99.64 03:22:45 01:20:04 0 0.06 0.00 0.09 0.02 0.00 99.82 03:22:45 01:20:04 1 0.45 0.00 0.07 0.01 0.00 99.47 03:22:45 01:30:34 all 0.29 0.00 0.19 0.03 0.00 99.49 03:22:45 01:30:34 0 0.19 0.00 0.19 0.04 0.00 99.57 03:22:45 01:30:34 1 0.39 0.00 0.18 0.02 0.00 99.41 03:22:45 01:40:01 all 4.12 0.00 0.63 0.21 0.00 95.04 03:22:45 01:40:01 0 5.35 0.00 0.64 0.28 0.00 93.73 03:22:45 01:40:01 1 2.89 0.00 0.61 0.14 0.00 96.35 03:22:45 01:50:44 all 3.37 0.00 0.48 0.16 0.01 95.98 03:22:45 01:50:44 0 2.74 0.00 0.44 0.16 0.00 96.65 03:22:45 01:50:44 1 4.01 0.00 0.53 0.15 0.01 95.31 03:22:45 02:00:04 all 0.29 0.00 0.17 0.01 0.00 99.52 03:22:45 02:00:04 0 0.30 0.00 0.18 0.00 0.00 99.51 03:22:45 02:00:04 1 0.27 0.00 0.16 0.02 0.00 99.53 03:22:45 02:10:01 all 3.66 0.00 0.49 0.30 0.01 95.55 03:22:45 02:10:01 0 2.82 0.00 0.47 0.53 0.01 96.17 03:22:45 02:10:01 1 4.50 0.00 0.50 0.06 0.00 94.94 03:22:45 02:20:04 all 0.24 0.00 0.09 0.03 0.00 99.64 03:22:45 02:20:04 0 0.44 0.00 0.08 0.06 0.00 99.42 03:22:45 02:20:04 1 0.04 0.00 0.10 0.01 0.00 99.85 03:22:45 02:30:34 all 0.27 0.00 0.17 0.05 0.00 99.51 03:22:45 02:30:34 0 0.47 0.00 0.14 0.04 0.00 99.34 03:22:45 02:30:34 1 0.06 0.00 0.21 0.06 0.00 99.67 03:22:45 03:22:45 02:30:34 CPU %user %nice %system %iowait %steal %idle 03:22:45 02:40:01 all 0.27 0.00 0.11 0.03 0.00 99.58 03:22:45 02:40:01 0 0.49 0.00 0.08 0.02 0.00 99.40 03:22:45 02:40:01 1 0.06 0.00 0.14 0.04 0.00 99.76 03:22:45 02:50:24 all 0.26 0.00 0.08 0.03 0.00 99.62 03:22:45 02:50:24 0 0.47 0.00 0.05 0.00 0.00 99.47 03:22:45 02:50:24 1 0.05 0.00 0.11 0.06 0.00 99.77 03:22:45 03:00:04 all 0.28 0.00 0.19 0.02 0.00 99.50 03:22:45 03:00:04 0 0.49 0.00 0.13 0.01 0.00 99.37 03:22:45 03:00:04 1 0.08 0.00 0.25 0.03 0.01 99.64 03:22:45 03:10:01 all 0.25 0.00 0.09 0.01 0.01 99.65 03:22:45 03:10:01 0 0.45 0.00 0.06 0.01 0.00 99.49 03:22:45 03:10:01 1 0.06 0.00 0.12 0.01 0.01 99.80 03:22:45 03:20:44 all 0.25 0.00 0.08 0.01 0.00 99.66 03:22:45 03:20:44 0 0.46 0.00 0.05 0.01 0.00 99.48 03:22:45 03:20:44 1 0.04 0.00 0.11 0.01 0.00 99.83 03:22:45 Average: all 1.07 0.00 0.22 0.07 0.00 98.64 03:22:45 Average: 0 1.22 0.00 0.21 0.09 0.00 98.48 03:22:45 Average: 1 0.91 0.00 0.23 0.05 0.00 98.80 03:22:45 03:22:45 03:22:45