00:34:51 Started by upstream project "autorelease-release-vanadium-mvn39-openjdk21" build number 436 00:34:51 originally caused by: 00:34:51 Started by timer 00:34:51 Running as SYSTEM 00:34:51 [EnvInject] - Loading node environment variables. 00:34:51 Building remotely on prd-queue-disttest-2c-1g-63147 (queue-disttest-2c-1g) in workspace /w/workspace/integration-distribution-test-vanadium 00:34:52 [ssh-agent] Looking for ssh-agent implementation... 00:34:52 [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) 00:34:52 $ ssh-agent 00:34:52 SSH_AUTH_SOCK=/tmp/ssh-CBQ3OFCXCEe4/agent.3136 00:34:52 SSH_AGENT_PID=3138 00:34:52 [ssh-agent] Started. 00:34:52 Running ssh-add (command line suppressed) 00:34:52 Identity added: /w/workspace/integration-distribution-test-vanadium@tmp/private_key_12866807689675370446.key (/w/workspace/integration-distribution-test-vanadium@tmp/private_key_12866807689675370446.key) 00:34:52 [ssh-agent] Using credentials jenkins (jenkins-ssh) 00:34:52 No emails were triggered. 00:34:52 provisioning config files... 00:34:52 copy managed file [npmrc] to file:/home/jenkins/.npmrc 00:34:52 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 00:34:52 [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins178890678934893437.sh 00:34:52 ---> python-tools-install.sh 00:34:52 Setup pyenv: 00:34:52 * system (set by /opt/pyenv/version) 00:34:52 * 3.8.20 (set by /opt/pyenv/version) 00:34:52 * 3.9.20 (set by /opt/pyenv/version) 00:34:52 3.10.15 00:34:52 3.11.10 00:34:57 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-nlq1 00:34:57 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 00:34:57 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 00:35:01 lf-activate-venv(): INFO: Installing additional packages: lftools 00:35:27 lf-activate-venv(): INFO: Adding /tmp/venv-nlq1/bin to PATH 00:35:27 Generating Requirements File 00:35:57 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 00:35:57 httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible. 00:35:57 Python 3.11.10 00:35:57 pip 26.2.1 from /tmp/venv-nlq1/lib/python3.11/site-packages/pip (python 3.11) 00:35:57 aiohappyeyeballs==2.7.1 00:35:57 aiohttp==3.14.4 00:35:57 aiosignal==1.4.0 00:35:57 appdirs==1.4.4 00:35:57 argcomplete==3.7.2 00:35:57 aspy.yaml==1.3.0 00:35:57 attrs==26.1.0 00:35:57 autopage==0.6.0 00:35:57 beautifulsoup4==4.15.0 00:35:57 boto3==1.43.111 00:35:57 botocore==1.43.111 00:35:57 bs4==0.0.2 00:35:57 certifi==2026.7.22 00:35:57 cffi==2.1.1 00:35:57 cfgv==3.5.0 00:35:57 chardet==7.6.0 00:35:57 charset-normalizer==3.5.2 00:35:57 click==8.5.0 00:35:57 cliff==4.16.0 00:35:57 cmd2==4.2.4 00:35:57 cryptography==3.3.2 00:35:57 debtcollector==3.1.0 00:35:57 decorator==5.3.1 00:35:57 defusedxml==0.7.1 00:35:57 Deprecated==1.3.1 00:35:57 distlib==0.4.3 00:35:57 dnspython==2.9.0 00:35:57 docker==7.2.0 00:35:57 dogpile.cache==1.5.0 00:35:57 durationpy==0.11 00:35:57 email-validator==2.3.0 00:35:57 filelock==4.1.0 00:35:57 frozenlist==1.8.0 00:35:57 future==1.0.0 00:35:57 gitdb==4.0.12 00:35:57 GitPython==3.2.0 00:35:57 httplib2==0.30.2 00:35:57 identify==2.6.20 00:35:57 idna==3.20 00:35:57 importlib-resources==1.5.0 00:35:57 iso8601==2.1.0 00:35:57 Jinja2==3.1.6 00:35:57 jmespath==1.1.0 00:35:57 jsonpatch==1.34 00:35:57 jsonpointer==3.2.0 00:35:57 jsonschema==4.26.0 00:35:57 jsonschema-specifications==2025.9.1 00:35:57 keystoneauth1==5.18.0 00:35:57 kubernetes==36.0.3 00:35:57 lftools==0.37.23 00:35:57 lxml==6.1.3 00:35:57 markdown-it-py==4.2.0 00:35:57 MarkupSafe==3.0.4 00:35:57 mdurl==0.1.2 00:35:57 msgpack==1.2.3 00:35:57 multi_key_dict==2.0.3 00:35:57 multidict==6.9.1 00:35:57 munch==4.0.0 00:35:57 netaddr==1.3.0 00:35:57 niet==1.4.2 00:35:57 nodeenv==1.11.0 00:35:57 oauth2client==4.1.3 00:35:57 oauthlib==4.0.0 00:35:57 openstacksdk==4.21.0 00:35:57 os-service-types==1.9.0 00:35:57 osc-lib==4.7.0 00:35:57 oslo.config==10.7.0 00:35:57 oslo.context==6.5.0 00:35:57 oslo.i18n==6.9.0 00:35:57 oslo.log==8.3.2 00:35:57 oslo.serialization==5.11.0 00:35:57 oslo.utils==10.2.0 00:35:57 packaging==26.3 00:35:57 pbr==7.1.3 00:35:57 platformdirs==4.12.4 00:35:57 prettytable==3.18.0 00:35:57 prompt_toolkit==3.0.53 00:35:57 propcache==0.5.4 00:35:57 psutil==7.2.2 00:35:57 pyasn1==0.6.4 00:35:57 pyasn1_modules==0.4.2 00:35:57 pycparser==3.11 00:35:57 pygerrit2==2.0.15 00:35:57 PyGithub==2.10.0 00:35:57 Pygments==2.21.0 00:35:57 PyJWT==2.15.1 00:35:57 PyNaCl==1.6.2 00:35:57 pyparsing==2.4.7 00:35:57 pyperclip==1.11.0 00:35:57 pyrsistent==0.20.0 00:35:57 python-dateutil==2.9.0.post0 00:35:57 python-discovery==1.6.1 00:35:57 python-heatclient==5.3.0 00:35:57 python-jenkins==1.8.3 00:35:57 python-keystoneclient==6.0.0 00:35:57 python-magnumclient==5.0.0 00:35:57 python-manilaclient==6.3.0 00:35:57 python-openstackclient==10.4.0 00:35:57 python-swiftclient==4.11.0 00:35:57 PyYAML==6.0.3 00:35:57 referencing==0.37.0 00:35:57 requests==2.34.2 00:35:57 requests-oauthlib==2.0.0 00:35:57 rfc3986==2.0.0 00:35:57 rich==15.0.0 00:35:57 rich-argparse==1.8.0 00:35:57 rpds-py==2026.9.1 00:35:57 rsa==4.9.1 00:35:57 ruamel.yaml==0.19.1 00:35:57 ruamel.yaml.clib==0.2.15 00:35:57 s3transfer==0.19.2 00:35:57 simplejson==4.2.0 00:35:57 six==1.17.0 00:35:57 smmap==5.0.3 00:35:57 soupsieve==2.10 00:35:57 stevedore==5.9.1 00:35:57 tabulate==0.10.0 00:35:57 toml==0.10.2 00:35:57 tomlkit==0.15.1 00:35:57 tqdm==4.70.1 00:35:57 typing_extensions==4.16.0 00:35:57 urllib3==1.26.20 00:35:57 virtualenv==21.14.6 00:35:57 wcwidth==0.9.2 00:35:57 websocket-client==1.9.2 00:35:57 wrapt==2.5.0 00:35:57 xdg==6.0.0 00:35:57 xmltodict==1.0.4 00:35:57 yarl==1.25.1 00:35:57 yq==4.4.0 00:35:57 [integration-distribution-test-vanadium] $ /bin/sh /tmp/jenkins11137617709684702632.sh 00:35:57 ---> uv-install.sh 00:35:57 Installing uv/uvx (latest) using shell installer 00:35:58 2026-10-10 00:35:58 URL:https://releases.astral.sh/installers/uv/latest/uv-installer.sh [71300/71300] -> "/tmp/uv-install-jfOtT7.sh" [1] 00:35:58 downloading uv 0.13.0 x86_64-unknown-linux-gnu 00:35:58 installing to /home/jenkins/.local/bin 00:35:58 uv 00:35:58 uvx 00:35:58 everything's installed! 00:35:58 00:35:58 To add $HOME/.local/bin to your PATH, either restart your shell or run: 00:35:58 00:35:58 source $HOME/.local/bin/env (sh, bash, zsh) 00:35:58 source $HOME/.local/bin/env.fish (fish) 00:35:58 Adding install location to PATH 00:35:58 ---> Validating uv/uvx install 00:35:58 uvx 0.13.0 (x86_64-unknown-linux-gnu) 00:35:59 Waiting for the completion of bgpcep-csit-1node-bgp-ingest-all-vanadium 00:35:59 bgpcep-csit-1node-bgp-ingest-all-vanadium #422 started. 02:16:26 bgpcep-csit-1node-bgp-ingest-all-vanadium #422 completed. Result was UNSTABLE 02:16:26 Waiting for the completion of bgpcep-csit-1node-bgp-ingest-mixed-all-vanadium 02:16:26 bgpcep-csit-1node-bgp-ingest-mixed-all-vanadium #422 started. 02:16:26 bgpcep-csit-1node-bgp-ingest-mixed-all-vanadium #422 completed. Result was SUCCESS 02:16:26 Waiting for the completion of bgpcep-csit-1node-throughpcep-all-vanadium 02:16:26 bgpcep-csit-1node-throughpcep-all-vanadium #422 started. 02:16:26 bgpcep-csit-1node-throughpcep-all-vanadium #422 completed. Result was UNSTABLE 02:16:26 Waiting for the completion of bgpcep-csit-1node-userfeatures-all-vanadium 02:16:26 bgpcep-csit-1node-userfeatures-all-vanadium #422 started. 02:16:26 bgpcep-csit-1node-userfeatures-all-vanadium #422 completed. Result was UNSTABLE 02:16:26 Waiting for the completion of daexim-csit-1node-basic-only-vanadium 02:16:26 daexim-csit-1node-basic-only-vanadium #422 started. 02:16:26 daexim-csit-1node-basic-only-vanadium #422 completed. Result was SUCCESS 02:16:26 Waiting for the completion of daexim-csit-3node-clustering-basic-only-vanadium 02:16:26 daexim-csit-3node-clustering-basic-only-vanadium #422 started. 02:16:26 daexim-csit-3node-clustering-basic-only-vanadium #422 completed. Result was SUCCESS 02:16:26 Waiting for the completion of distribution-csit-managed-vanadium 02:16:26 distribution-csit-managed-vanadium #422 started. 02:16:26 distribution-csit-managed-vanadium #422 completed. Result was SUCCESS 02:16:26 Waiting for the completion of jsonrpc-csit-1node-basic-only-vanadium 02:16:26 jsonrpc-csit-1node-basic-only-vanadium #423 started. 02:16:26 jsonrpc-csit-1node-basic-only-vanadium #423 completed. Result was SUCCESS 02:16:26 Waiting for the completion of openflowplugin-csit-1node-cbench-only-vanadium 02:16:26 openflowplugin-csit-1node-cbench-only-vanadium #422 started. 02:16:26 openflowplugin-csit-1node-cbench-only-vanadium #422 completed. Result was SUCCESS 02:16:26 Waiting for the completion of openflowplugin-csit-1node-flow-services-all-vanadium 02:16:26 openflowplugin-csit-1node-flow-services-all-vanadium #422 started. 02:16:26 openflowplugin-csit-1node-flow-services-all-vanadium #422 completed. Result was UNSTABLE 02:16:26 Waiting for the completion of openflowplugin-csit-1node-perf-bulkomatic-only-vanadium 02:16:26 openflowplugin-csit-1node-perf-bulkomatic-only-vanadium #422 started. 02:16:26 openflowplugin-csit-1node-perf-bulkomatic-only-vanadium #422 completed. Result was SUCCESS 02:16:26 Waiting for the completion of openflowplugin-csit-1node-perf-stats-collection-only-vanadium 02:16:26 openflowplugin-csit-1node-perf-stats-collection-only-vanadium #422 started. 02:16:26 openflowplugin-csit-1node-perf-stats-collection-only-vanadium #422 completed. Result was SUCCESS 02:16:26 Waiting for the completion of openflowplugin-csit-1node-scale-link-only-vanadium 02:16:26 openflowplugin-csit-1node-scale-link-only-vanadium #422 started. 02:16:26 openflowplugin-csit-1node-scale-link-only-vanadium #422 completed. Result was SUCCESS 02:16:26 Waiting for the completion of openflowplugin-csit-1node-scale-only-vanadium 02:16:26 openflowplugin-csit-1node-scale-only-vanadium #422 started. 02:16:26 openflowplugin-csit-1node-scale-only-vanadium #422 completed. Result was UNSTABLE 02:16:26 Waiting for the completion of openflowplugin-csit-1node-scale-switch-only-vanadium 02:16:26 openflowplugin-csit-1node-scale-switch-only-vanadium #422 started. 02:16:26 openflowplugin-csit-1node-scale-switch-only-vanadium #422 completed. Result was SUCCESS 02:16:26 Waiting for the completion of openflowplugin-csit-3node-clustering-bulkomatic-only-vanadium 02:16:26 openflowplugin-csit-3node-clustering-bulkomatic-only-vanadium #422 started. 02:16:26 openflowplugin-csit-3node-clustering-bulkomatic-only-vanadium #422 completed. Result was FAILURE 02:16:26 Waiting for the completion of openflowplugin-csit-3node-clustering-only-vanadium 02:16:26 openflowplugin-csit-3node-clustering-only-vanadium #422 started. 02:16:26 openflowplugin-csit-3node-clustering-only-vanadium #422 completed. Result was FAILURE 02:16:26 Waiting for the completion of openflowplugin-csit-3node-clustering-perf-bulkomatic-only-vanadium 02:16:26 openflowplugin-csit-3node-clustering-perf-bulkomatic-only-vanadium #422 started. 02:16:26 openflowplugin-csit-3node-clustering-perf-bulkomatic-only-vanadium #422 completed. Result was FAILURE 02:16:26 Waiting for the completion of ovsdb-csit-1node-upstream-southbound-all-vanadium 02:16:26 ovsdb-csit-1node-upstream-southbound-all-vanadium #423 started. 02:16:26 ovsdb-csit-1node-upstream-southbound-all-vanadium #423 completed. Result was UNSTABLE 02:16:26 Waiting for the completion of ovsdb-csit-3node-upstream-clustering-only-vanadium 02:16:26 ovsdb-csit-3node-upstream-clustering-only-vanadium #422 started. 02:16:26 ovsdb-csit-3node-upstream-clustering-only-vanadium #422 completed. Result was FAILURE 02:16:26 Build step 'Trigger/call builds on other projects' changed build result to UNSTABLE 02:16:26 Build step 'Trigger/call builds on other projects' marked build as failure 02:16:26 $ ssh-agent -k 02:16:26 unset SSH_AUTH_SOCK; 02:16:26 unset SSH_AGENT_PID; 02:16:26 echo Agent pid 3138 killed; 02:16:26 [ssh-agent] Stopped. 02:16:26 [PostBuildScript] - [INFO] Executing post build scripts. 02:16:26 [integration-distribution-test-vanadium] $ /bin/sh /tmp/jenkins7799609196627673095.sh 02:16:30 python /tmp/tmp.StbPiWrQDT https://jenkins.opendaylight.org/releng/job/integration-distribution-test-vanadium/427/ 02:16:31 /tmp/tmp.StbPiWrQDT:26: DeprecationWarning: Call to deprecated method findAll. (Replaced by find_all) -- Deprecated since version 4.0.0. 02:16:31 links = soup.findAll("a", { "class" : "model-link" }) 02:16:31 [PostBuildScript] - [INFO] Executing post build scripts. 02:16:31 [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins12194954435428967596.sh 02:16:31 ---> sysstat.sh 02:16:31 [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins12426020705659578858.sh 02:16:31 ---> package-listing.sh 02:16:31 + '[' -f /etc/os-release ']' 02:16:31 + . /etc/os-release 02:16:31 ++ PRETTY_NAME='Ubuntu 24.04.5 LTS' 02:16:31 ++ NAME=Ubuntu 02:16:31 ++ VERSION_ID=24.04 02:16:31 ++ VERSION='24.04.5 LTS (Noble Numbat)' 02:16:31 ++ VERSION_CODENAME=noble 02:16:31 ++ ID=ubuntu 02:16:31 ++ ID_LIKE=debian 02:16:31 ++ HOME_URL=https://www.ubuntu.com/ 02:16:31 ++ SUPPORT_URL=https://help.ubuntu.com/ 02:16:31 ++ BUG_REPORT_URL=https://bugs.launchpad.net/ubuntu/ 02:16:31 ++ PRIVACY_POLICY_URL=https://www.ubuntu.com/legal/terms-and-policies/privacy-policy 02:16:31 ++ UBUNTU_CODENAME=noble 02:16:31 ++ LOGO=ubuntu-logo 02:16:31 + case " ${ID:-} ${ID_LIKE:-} " in 02:16:31 + OS_FAMILY=debian 02:16:31 + workspace=/w/workspace/integration-distribution-test-vanadium 02:16:31 + START_PACKAGES=/tmp/packages_start.txt 02:16:31 + END_PACKAGES=/tmp/packages_end.txt 02:16:31 + DIFF_PACKAGES=/tmp/packages_diff.txt 02:16:31 + PACKAGES=/tmp/packages_start.txt 02:16:31 + '[' /w/workspace/integration-distribution-test-vanadium ']' 02:16:31 + PACKAGES=/tmp/packages_end.txt 02:16:31 + case "${OS_FAMILY}" in 02:16:31 + dpkg -l 02:16:31 + grep '^ii' 02:16:31 + '[' -f /tmp/packages_start.txt ']' 02:16:31 + '[' -f /tmp/packages_end.txt ']' 02:16:31 + diff /tmp/packages_start.txt /tmp/packages_end.txt 02:16:31 + '[' /w/workspace/integration-distribution-test-vanadium ']' 02:16:31 + mkdir -p /w/workspace/integration-distribution-test-vanadium/archives/ 02:16:31 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/integration-distribution-test-vanadium/archives/ 02:16:31 + exit 0 02:16:31 [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins9410889694721924111.sh 02:16:31 ---> capture-instance-metadata.sh 02:16:31 Setup pyenv: 02:16:31 system 02:16:31 3.8.20 02:16:31 3.9.20 02:16:31 3.10.15 02:16:31 * 3.11.10 (set by /w/workspace/integration-distribution-test-vanadium/.python-version) 02:16:31 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-nlq1 from file:/tmp/.os_lf_venv 02:16:31 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 02:16:33 lf-activate-venv(): INFO: Installing additional packages: lftools 02:16:43 lf-activate-venv(): INFO: Adding /tmp/venv-nlq1/bin to PATH 02:16:43 INFO: Running in OpenStack, capturing instance metadata 02:16:44 [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins4526172579195472444.sh 02:16:44 provisioning config files... 02:16:44 Could not find credentials [logs] for integration-distribution-test-vanadium #427 02:16:44 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/integration-distribution-test-vanadium@tmp/config16751179705899807444tmp 02:16:44 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] 02:16:44 Run condition [Regular expression match] enabling perform for step [Provide Configuration files] 02:16:44 provisioning config files... 02:16:45 copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials 02:16:45 [EnvInject] - Injecting environment variables from a build step. 02:16:45 [EnvInject] - Injecting as environment variables the properties content 02:16:45 SERVER_ID=logs 02:16:45 02:16:45 [EnvInject] - Variables injected successfully. 02:16:45 [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins9925529928957321047.sh 02:16:45 ---> create-netrc.sh 02:16:45 WARN: Log server credential not found. 02:16:45 [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins18298308643030151394.sh 02:16:45 ---> python-tools-install.sh 02:16:45 Setup pyenv: 02:16:45 system 02:16:45 3.8.20 02:16:45 3.9.20 02:16:45 3.10.15 02:16:45 * 3.11.10 (set by /w/workspace/integration-distribution-test-vanadium/.python-version) 02:16:45 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-nlq1 from file:/tmp/.os_lf_venv 02:16:45 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 02:16:47 lf-activate-venv(): INFO: Installing additional packages: lftools 02:16:58 lf-activate-venv(): INFO: Adding /tmp/venv-nlq1/bin to PATH 02:16:58 [integration-distribution-test-vanadium] $ /bin/sh /tmp/jenkins6109297945960569665.sh 02:16:58 ---> uv-install.sh 02:16:58 uv 0.13.0 is already installed 02:16:58 uvx 0.13.0 (x86_64-unknown-linux-gnu) 02:16:58 [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins3849376889727268576.sh 02:16:58 ---> sudo-logs.sh 02:16:58 Archiving 'sudo' log.. 02:16:58 [integration-distribution-test-vanadium] $ /bin/bash /tmp/jenkins13462987421724174480.sh 02:16:58 ---> job-cost.sh 02:16:58 INFO: Activating Python virtual environment... 02:16:58 Setup pyenv: 02:16:58 system 02:16:58 3.8.20 02:16:58 3.9.20 02:16:58 3.10.15 02:16:59 * 3.11.10 (set by /w/workspace/integration-distribution-test-vanadium/.python-version) 02:16:59 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-nlq1 from file:/tmp/.os_lf_venv 02:16:59 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 02:17:00 lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 02:17:11 lf-activate-venv(): INFO: Adding /tmp/venv-nlq1/bin to PATH 02:17:11 INFO: No stack-cost file found 02:17:11 INFO: Instance uptime: 6168s 02:17:11 INFO: Fetching instance metadata (attempt 1 of 3)... 02:17:11 DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type 02:17:11 INFO: Successfully fetched instance metadata 02:17:11 INFO: Instance type: v3-standard-2 02:17:11 INFO: Retrieving pricing info for: v3-standard-2 02:17:11 INFO: Fetching Vexxhost pricing API (attempt 1 of 3)... 02:17:11 DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-standard-2/cost?seconds=6168 02:17:11 INFO: Successfully fetched Vexxhost pricing API 02:17:11 INFO: Retrieved cost: 0.11 02:17:11 INFO: Retrieved resource: v3-standard-2 02:17:11 INFO: Creating archive directory: /w/workspace/integration-distribution-test-vanadium/archives/cost 02:17:11 INFO: Archiving costs to: /w/workspace/integration-distribution-test-vanadium/archives/cost.csv 02:17:11 INFO: Successfully archived job cost data 02:17:11 DEBUG: Cost data: integration-distribution-test-vanadium,427,2026-10-10 02:17:11,v3-standard-2,6168,0.11,0.00,FAILURE 02:17:11 [integration-distribution-test-vanadium] $ /bin/bash -l /tmp/jenkins11609364505436807612.sh 02:17:11 ---> logs-deploy.sh 02:17:11 Setup pyenv: 02:17:11 system 02:17:11 3.8.20 02:17:11 3.9.20 02:17:11 3.10.15 02:17:11 * 3.11.10 (set by /w/workspace/integration-distribution-test-vanadium/.python-version) 02:17:12 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-nlq1 from file:/tmp/.os_lf_venv 02:17:12 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 02:17:13 lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 02:17:27 lf-activate-venv(): INFO: Adding /tmp/venv-nlq1/bin to PATH 02:17:27 WARNING: Nexus logging server not set 02:17:27 INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/integration-distribution-test-vanadium/427/ 02:17:27 INFO: archiving logs to S3 02:17:28 ---> uname -a: 02:17:28 Linux prd-queue-disttest-2c-1g-63147 6.8.0-146-generic #146-Ubuntu SMP PREEMPT_DYNAMIC Thu Sep 3 16:12:30 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux 02:17:28 02:17:28 02:17:28 ---> lscpu: 02:17:28 Architecture: x86_64 02:17:28 CPU op-mode(s): 32-bit, 64-bit 02:17:28 Address sizes: 40 bits physical, 48 bits virtual 02:17:28 Byte Order: Little Endian 02:17:28 CPU(s): 2 02:17:28 On-line CPU(s) list: 0,1 02:17:28 Vendor ID: AuthenticAMD 02:17:28 Model name: AMD EPYC-Rome Processor 02:17:28 CPU family: 23 02:17:28 Model: 49 02:17:28 Thread(s) per core: 1 02:17:28 Core(s) per socket: 1 02:17:28 Socket(s): 2 02:17:28 Stepping: 0 02:17:28 BogoMIPS: 5600.00 02:17:28 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 clzero xsaveerptr wbnoinvd arat npt lbrv nrip_save tsc_scale vmcb_clean flushbyasid pausefilter pfthreshold v_vmsave_vmload vgif umip rdpid arch_capabilities 02:17:28 Virtualization: AMD-V 02:17:28 Hypervisor vendor: KVM 02:17:28 Virtualization type: full 02:17:28 L1d cache: 64 KiB (2 instances) 02:17:28 L1i cache: 64 KiB (2 instances) 02:17:28 L2 cache: 1 MiB (2 instances) 02:17:28 L3 cache: 32 MiB (2 instances) 02:17:28 NUMA node(s): 1 02:17:28 NUMA node0 CPU(s): 0,1 02:17:28 Vulnerability Gather data sampling: Not affected 02:17:28 Vulnerability Indirect target selection: Not affected 02:17:28 Vulnerability Itlb multihit: Not affected 02:17:28 Vulnerability L1tf: Not affected 02:17:28 Vulnerability Mds: Not affected 02:17:28 Vulnerability Meltdown: Not affected 02:17:28 Vulnerability Mmio stale data: Not affected 02:17:28 Vulnerability Reg file data sampling: Not affected 02:17:28 Vulnerability Retbleed: Mitigation; untrained return thunk; SMT disabled 02:17:28 Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode 02:17:28 Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl 02:17:28 Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization 02:17:28 Vulnerability Spectre v2: Mitigation; Retpolines; IBPB conditional; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected 02:17:28 Vulnerability Srbds: Not affected 02:17:28 Vulnerability Tsa: Not affected 02:17:28 Vulnerability Tsx async abort: Not affected 02:17:28 Vulnerability Vmscape: Not affected 02:17:28 02:17:28 02:17:28 ---> nproc: 02:17:28 2 02:17:28 02:17:28 02:17:28 ---> df -h: 02:17:28 Filesystem Size Used Avail Use% Mounted on 02:17:28 tmpfs 795M 1.1M 794M 1% /run 02:17:28 /dev/vda1 38G 8.0G 30G 22% / 02:17:28 tmpfs 3.9G 0 3.9G 0% /dev/shm 02:17:28 tmpfs 5.0M 0 5.0M 0% /run/lock 02:17:28 /dev/vda16 881M 117M 703M 15% /boot 02:17:28 /dev/vda15 105M 6.2M 99M 6% /boot/efi 02:17:28 tmpfs 795M 16K 795M 1% /run/user/1001 02:17:28 02:17:28 02:17:28 ---> free -m: 02:17:28 total used free shared buff/cache available 02:17:28 Mem: 7941 793 5290 4 2152 7148 02:17:28 Swap: 1023 0 1023 02:17:28 02:17:28 02:17:28 ---> ip addr: 02:17:28 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 02:17:28 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 02:17:28 inet 127.0.0.1/8 scope host lo 02:17:28 valid_lft forever preferred_lft forever 02:17:28 inet6 ::1/128 scope host noprefixroute 02:17:28 valid_lft forever preferred_lft forever 02:17:28 2: ens3: mtu 1458 qdisc mq state UP group default qlen 1000 02:17:28 link/ether fa:16:3e:7a:8d:65 brd ff:ff:ff:ff:ff:ff 02:17:28 altname enp0s3 02:17:28 inet 10.30.171.241/23 metric 100 brd 10.30.171.255 scope global dynamic ens3 02:17:28 valid_lft 80226sec preferred_lft 80226sec 02:17:28 inet6 fe80::f816:3eff:fe7a:8d65/64 scope link 02:17:28 valid_lft forever preferred_lft forever 02:17:28 02:17:28 02:17:28 ---> sar -b -r -n DEV: 02:17:28 Linux 6.8.0-146-generic (prd-queue-disttest-2c-1g-63147) 10/10/26 _x86_64_ (2 CPU) 02:17:28 02:17:28 00:34:36 LINUX RESTART (2 CPU) 02:17:28 02:17:28 00:40:28 tps rtps wtps dtps bread/s bwrtn/s bdscd/s 02:17:28 00:50:02 1.57 0.01 1.56 0.00 0.06 18.99 0.03 02:17:28 01:00:01 3.03 0.00 2.72 0.30 0.00 149.20 206.70 02:17:28 01:10:12 16.15 0.00 2.20 13.95 0.14 69.32 104939.96 02:17:28 01:20:22 3.33 0.31 2.79 0.22 42.01 163.35 35.46 02:17:28 01:30:01 1.77 0.00 1.75 0.02 0.00 20.63 0.25 02:17:28 01:40:12 1.63 0.00 1.63 0.00 0.00 19.37 0.01 02:17:28 01:50:28 5.91 0.20 4.75 0.96 23.82 376.75 7295.46 02:17:28 02:00:01 3.34 0.23 2.82 0.29 12.67 103.08 799.29 02:17:28 02:10:28 1.45 0.00 1.45 0.00 0.00 17.79 0.00 02:17:28 Average: 4.28 0.08 2.41 1.78 8.83 105.28 12834.47 02:17:28 02:17:28 00:40:28 kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 02:17:28 00:50:02 5548876 7419744 359528 4.42 91268 1950936 677044 7.37 549272 1748100 292 02:17:28 01:00:01 5546284 7426300 352744 4.34 92460 1958740 678156 7.39 550344 1756968 188 02:17:28 01:10:12 5512748 7394164 384724 4.73 93300 1959248 714072 7.78 584448 1758164 200 02:17:28 01:20:22 5477420 7399148 379008 4.66 94356 1998192 883556 9.62 571360 1788084 132 02:17:28 01:30:01 5480736 7402980 375036 4.61 94508 1998524 883556 9.62 571216 1788568 284 02:17:28 01:40:12 5486404 7409160 368872 4.54 94684 1998852 883556 9.62 571324 1789072 172 02:17:28 01:50:28 5437836 7343100 432904 5.32 99100 1975188 955444 10.41 647648 1764956 12632 02:17:28 02:00:01 5489904 7397424 377944 4.65 100128 1975972 884200 9.63 579784 1764876 324 02:17:28 02:10:28 5489600 7397648 377768 4.65 100280 1976300 884200 9.63 579888 1765400 128 02:17:28 Average: 5496645 7398852 378725 4.66 95565 1976884 827087 9.01 578365 1769354 1595 02:17:28 02:17:28 00:40:28 IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 02:17:28 00:50:02 lo 1.10 1.10 0.06 0.06 0.00 0.00 0.00 0.00 02:17:28 00:50:02 ens3 3.06 0.25 0.52 0.16 0.00 0.00 0.00 0.00 02:17:28 01:00:01 lo 1.11 1.11 0.06 0.06 0.00 0.00 0.00 0.00 02:17:28 01:00:01 ens3 1.55 0.67 0.63 0.37 0.00 0.00 0.00 0.00 02:17:28 01:10:12 lo 1.12 1.12 0.06 0.06 0.00 0.00 0.00 0.00 02:17:28 01:10:12 ens3 4.37 1.02 1.49 0.66 0.00 0.00 0.00 0.00 02:17:28 01:20:22 lo 1.14 1.14 0.06 0.06 0.00 0.00 0.00 0.00 02:17:28 01:20:22 ens3 2.78 0.70 3.91 0.32 0.00 0.00 0.00 0.00 02:17:28 01:30:01 lo 1.10 1.10 0.06 0.06 0.00 0.00 0.00 0.00 02:17:28 01:30:01 ens3 2.14 0.18 0.30 0.09 0.00 0.00 0.00 0.00 02:17:28 01:40:12 lo 1.10 1.10 0.06 0.06 0.00 0.00 0.00 0.00 02:17:28 01:40:12 ens3 1.04 0.07 4.94 0.03 0.00 0.00 0.00 0.00 02:17:28 01:50:28 lo 1.21 1.21 0.07 0.07 0.00 0.00 0.00 0.00 02:17:28 01:50:28 ens3 7.66 5.88 30.89 3.16 0.00 0.00 0.00 0.00 02:17:28 02:00:01 lo 1.16 1.16 0.06 0.06 0.00 0.00 0.00 0.00 02:17:28 02:00:01 ens3 1.91 1.24 1.05 0.70 0.00 0.00 0.00 0.00 02:17:28 02:10:28 lo 1.10 1.10 0.06 0.06 0.00 0.00 0.00 0.00 02:17:28 02:10:28 ens3 0.66 0.10 0.28 0.04 0.00 0.00 0.00 0.00 02:17:28 Average: lo 1.13 1.13 0.06 0.06 0.00 0.00 0.00 0.00 02:17:28 Average: ens3 2.81 1.14 5.00 0.62 0.00 0.00 0.00 0.00 02:17:28 02:17:28 02:17:28 ---> sar -P ALL: 02:17:28 Linux 6.8.0-146-generic (prd-queue-disttest-2c-1g-63147) 10/10/26 _x86_64_ (2 CPU) 02:17:28 02:17:28 00:34:36 LINUX RESTART (2 CPU) 02:17:28 02:17:28 00:40:28 CPU %user %nice %system %iowait %steal %idle 02:17:28 00:50:02 all 0.30 0.00 0.08 0.02 0.00 99.60 02:17:28 00:50:02 0 0.50 0.00 0.05 0.01 0.00 99.43 02:17:28 00:50:02 1 0.09 0.00 0.11 0.04 0.01 99.76 02:17:28 01:00:01 all 1.08 0.00 0.28 0.03 0.00 98.61 02:17:28 01:00:01 0 1.84 0.00 0.30 0.01 0.00 97.85 02:17:28 01:00:01 1 0.31 0.00 0.25 0.06 0.00 99.37 02:17:28 01:10:12 all 1.07 0.00 0.19 0.06 0.00 98.67 02:17:28 01:10:12 0 1.56 0.00 0.24 0.07 0.00 98.13 02:17:28 01:10:12 1 0.58 0.00 0.15 0.05 0.00 99.21 02:17:28 01:20:22 all 1.14 0.00 0.18 0.05 0.00 98.63 02:17:28 01:20:22 0 1.84 0.00 0.18 0.03 0.00 97.95 02:17:28 01:20:22 1 0.44 0.00 0.18 0.06 0.00 99.31 02:17:28 01:30:01 all 0.25 0.00 0.18 0.01 0.00 99.56 02:17:28 01:30:01 0 0.43 0.00 0.14 0.00 0.00 99.43 02:17:28 01:30:01 1 0.07 0.00 0.22 0.02 0.01 99.68 02:17:28 01:40:12 all 0.25 0.00 0.07 0.01 0.00 99.66 02:17:28 01:40:12 0 0.45 0.00 0.04 0.01 0.00 99.49 02:17:28 01:40:12 1 0.05 0.00 0.10 0.01 0.00 99.83 02:17:28 01:50:28 all 2.78 0.00 0.46 0.12 0.00 96.64 02:17:28 01:50:28 0 1.80 0.00 0.37 0.04 0.00 97.79 02:17:28 01:50:28 1 3.77 0.00 0.54 0.21 0.00 95.48 02:17:28 02:00:01 all 1.47 0.00 0.29 0.05 0.00 98.19 02:17:28 02:00:01 0 2.56 0.00 0.29 0.04 0.00 97.11 02:17:28 02:00:01 1 0.38 0.00 0.29 0.06 0.00 99.27 02:17:28 02:10:28 all 0.26 0.00 0.07 0.01 0.00 99.66 02:17:28 02:10:28 0 0.45 0.00 0.05 0.02 0.00 99.48 02:17:28 02:10:28 1 0.06 0.00 0.09 0.01 0.00 99.84 02:17:28 Average: all 0.96 0.00 0.20 0.04 0.00 98.80 02:17:28 Average: 0 1.27 0.00 0.18 0.03 0.00 98.52 02:17:28 Average: 1 0.65 0.00 0.21 0.06 0.00 99.07 02:17:28 02:17:28 02:17:28