04:24:35 Started by upstream project "autorelease-release-titanium-mvn39-openjdk21" build number 572 04:24:35 originally caused by: 04:24:35 Started by timer 04:24:35 Running as SYSTEM 04:24:35 [EnvInject] - Loading node environment variables. 04:24:35 Building remotely on prd-queue-disttest-2c-1g-6224 (queue-disttest-2c-1g) in workspace /w/workspace/integration-distribution-test-titanium 04:24:35 [ssh-agent] Looking for ssh-agent implementation... 04:24:35 [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) 04:24:35 $ ssh-agent 04:24:35 SSH_AUTH_SOCK=/tmp/ssh-SwPNgT44uEYq/agent.3128 04:24:35 SSH_AGENT_PID=3130 04:24:35 [ssh-agent] Started. 04:24:35 Running ssh-add (command line suppressed) 04:24:35 Identity added: /w/workspace/integration-distribution-test-titanium@tmp/private_key_11749481895357361472.key (/w/workspace/integration-distribution-test-titanium@tmp/private_key_11749481895357361472.key) 04:24:35 [ssh-agent] Using credentials jenkins (jenkins-ssh) 04:24:35 No emails were triggered. 04:24:35 provisioning config files... 04:24:35 copy managed file [npmrc] to file:/home/jenkins/.npmrc 04:24:35 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 04:24:35 [integration-distribution-test-titanium] $ /bin/bash /tmp/jenkins3759781792170166902.sh 04:24:35 ---> python-tools-install.sh 04:24:35 Setup pyenv: 04:24:36 * system (set by /opt/pyenv/version) 04:24:36 * 3.8.20 (set by /opt/pyenv/version) 04:24:36 * 3.9.20 (set by /opt/pyenv/version) 04:24:36 3.10.15 04:24:36 3.11.10 04:24:40 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-kXXJ 04:24:40 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 04:24:40 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 04:24:40 lf-activate-venv(): INFO: Attempting to install with network-safe options... 04:24:45 lf-activate-venv(): INFO: Base packages installed successfully 04:24:45 lf-activate-venv(): INFO: Installing additional packages: lftools 04:25:12 lf-activate-venv(): INFO: Adding /tmp/venv-kXXJ/bin to PATH 04:25:12 Generating Requirements File 04:25:32 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 04:25:32 httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible. 04:25:32 Python 3.11.10 04:25:32 pip 26.0.1 from /tmp/venv-kXXJ/lib/python3.11/site-packages/pip (python 3.11) 04:25:33 appdirs==1.4.4 04:25:33 argcomplete==3.6.3 04:25:33 aspy.yaml==1.3.0 04:25:33 attrs==26.1.0 04:25:33 autopage==0.6.0 04:25:33 beautifulsoup4==4.14.3 04:25:33 boto3==1.42.72 04:25:33 botocore==1.42.72 04:25:33 bs4==0.0.2 04:25:33 certifi==2026.2.25 04:25:33 cffi==2.0.0 04:25:33 cfgv==3.5.0 04:25:33 chardet==7.2.0 04:25:33 charset-normalizer==3.4.6 04:25:33 click==8.3.1 04:25:33 cliff==4.13.2 04:25:33 cmd2==3.4.0 04:25:33 cryptography==3.3.2 04:25:33 debtcollector==3.0.0 04:25:33 decorator==5.2.1 04:25:33 defusedxml==0.7.1 04:25:33 Deprecated==1.3.1 04:25:33 distlib==0.4.0 04:25:33 dnspython==2.8.0 04:25:33 docker==7.1.0 04:25:33 dogpile.cache==1.5.0 04:25:33 durationpy==0.10 04:25:33 email-validator==2.3.0 04:25:33 filelock==3.25.2 04:25:33 future==1.0.0 04:25:33 gitdb==4.0.12 04:25:33 GitPython==3.1.46 04:25:33 httplib2==0.30.2 04:25:33 identify==2.6.18 04:25:33 idna==3.11 04:25:33 importlib-resources==1.5.0 04:25:33 iso8601==2.1.0 04:25:33 Jinja2==3.1.6 04:25:33 jmespath==1.1.0 04:25:33 jsonpatch==1.33 04:25:33 jsonpointer==3.0.0 04:25:33 jsonschema==4.26.0 04:25:33 jsonschema-specifications==2025.9.1 04:25:33 keystoneauth1==5.13.1 04:25:33 kubernetes==35.0.0 04:25:33 lftools==0.37.22 04:25:33 lxml==6.0.2 04:25:33 markdown-it-py==4.0.0 04:25:33 MarkupSafe==3.0.3 04:25:33 mdurl==0.1.2 04:25:33 msgpack==1.1.2 04:25:33 multi_key_dict==2.0.3 04:25:33 munch==4.0.0 04:25:33 netaddr==1.3.0 04:25:33 niet==1.4.2 04:25:33 nodeenv==1.10.0 04:25:33 oauth2client==4.1.3 04:25:33 oauthlib==3.3.1 04:25:33 openstacksdk==4.10.0 04:25:33 os-service-types==1.8.2 04:25:33 osc-lib==4.4.0 04:25:33 oslo.config==10.3.0 04:25:33 oslo.context==6.3.0 04:25:33 oslo.i18n==6.7.2 04:25:33 oslo.log==8.1.0 04:25:33 oslo.serialization==5.9.1 04:25:33 oslo.utils==10.0.0 04:25:33 packaging==26.0 04:25:33 pbr==7.0.3 04:25:33 platformdirs==4.9.4 04:25:33 prettytable==3.17.0 04:25:33 psutil==7.2.2 04:25:33 pyasn1==0.6.3 04:25:33 pyasn1_modules==0.4.2 04:25:33 pycparser==3.0 04:25:33 pygerrit2==2.0.15 04:25:33 PyGithub==2.8.1 04:25:33 Pygments==2.19.2 04:25:33 PyJWT==2.12.1 04:25:33 PyNaCl==1.6.2 04:25:33 pyparsing==2.4.7 04:25:33 pyperclip==1.11.0 04:25:33 pyrsistent==0.20.0 04:25:33 python-cinderclient==9.9.0 04:25:33 python-dateutil==2.9.0.post0 04:25:33 python-discovery==1.2.0 04:25:33 python-heatclient==5.1.0 04:25:33 python-jenkins==1.8.3 04:25:33 python-keystoneclient==5.8.0 04:25:33 python-magnumclient==4.10.0 04:25:33 python-openstackclient==9.0.0 04:25:33 python-swiftclient==4.10.0 04:25:33 PyYAML==6.0.3 04:25:33 referencing==0.37.0 04:25:33 requests==2.32.5 04:25:33 requests-oauthlib==2.0.0 04:25:33 requestsexceptions==1.4.0 04:25:33 rfc3986==2.0.0 04:25:33 rich==14.3.3 04:25:33 rich-argparse==1.7.2 04:25:33 rpds-py==0.30.0 04:25:33 rsa==4.9.1 04:25:33 ruamel.yaml==0.19.1 04:25:33 ruamel.yaml.clib==0.2.15 04:25:33 s3transfer==0.16.0 04:25:33 simplejson==3.20.2 04:25:33 six==1.17.0 04:25:33 smmap==5.0.3 04:25:33 soupsieve==2.8.3 04:25:33 stevedore==5.7.0 04:25:33 tabulate==0.10.0 04:25:33 toml==0.10.2 04:25:33 tomlkit==0.14.0 04:25:33 tqdm==4.67.3 04:25:33 typing_extensions==4.15.0 04:25:33 urllib3==1.26.20 04:25:33 virtualenv==21.2.0 04:25:33 wcwidth==0.6.0 04:25:33 websocket-client==1.9.0 04:25:33 wrapt==2.1.2 04:25:33 xdg==6.0.0 04:25:33 xmltodict==1.0.4 04:25:33 yq==3.4.3 04:25:33 [integration-distribution-test-titanium] $ /bin/sh /tmp/jenkins6073309847472976174.sh 04:25:33 ---> uv-install.sh 04:25:33 Installing uv/uvx (latest) using shell installer 04:25:33 2026-03-20 04:25:33 URL:https://release-assets.githubusercontent.com/github-production-release-asset/699532645/a8cf105a-0f51-4ec6-8013-26a6c9ea2ca7?sp=r&sv=2018-11-09&sr=b&spr=https&se=2026-03-20T05%3A23%3A51Z&rscd=attachment%3B+filename%3Duv-installer.sh&rsct=application%2Foctet-stream&skoid=96c2d410-5711-43a1-aedd-ab1947aa7ab0&sktid=398a6654-997b-47e9-b12b-9515b896b4de&skt=2026-03-20T04%3A23%3A21Z&ske=2026-03-20T05%3A23%3A51Z&sks=b&skv=2018-11-09&sig=eWpbme4gLhcvA5XPhgXhosBIrHnST2tgBfKkpYoqLek%3D&jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmVsZWFzZS1hc3NldHMuZ2l0aHVidXNlcmNvbnRlbnQuY29tIiwia2V5Ijoia2V5MSIsImV4cCI6MTc3Mzk4MDk5MywibmJmIjoxNzczOTgwNjkzLCJwYXRoIjoicmVsZWFzZWFzc2V0cHJvZHVjdGlvbi5ibG9iLmNvcmUud2luZG93cy5uZXQifQ.QDgm0H6vT4lb0644Gw98X-RsY5mdLxIhko4QIwW8gxc&response-content-disposition=attachment%3B%20filename%3Duv-installer.sh&response-content-type=application%2Foctet-stream [68286/68286] -> "/tmp/uv-install-qVciXY.sh" [1] 04:25:33 downloading uv 0.10.12 x86_64-unknown-linux-gnu 04:25:34 no checksums to verify 04:25:34 installing to /home/jenkins/.local/bin 04:25:34 uv 04:25:34 uvx 04:25:34 everything's installed! 04:25:34 04:25:34 To add $HOME/.local/bin to your PATH, either restart your shell or run: 04:25:34 04:25:34 source $HOME/.local/bin/env (sh, bash, zsh) 04:25:34 source $HOME/.local/bin/env.fish (fish) 04:25:34 Adding install location to PATH 04:25:34 ---> Validating uv/uvx install 04:25:34 uvx 0.10.12 (x86_64-unknown-linux-gnu) 04:25:34 Waiting for the completion of bgpcep-csit-1node-bgp-ingest-all-titanium 04:25:34 bgpcep-csit-1node-bgp-ingest-all-titanium #663 started. 06:59:11 bgpcep-csit-1node-bgp-ingest-all-titanium #663 completed. Result was UNSTABLE 06:59:11 Waiting for the completion of bgpcep-csit-1node-bgp-ingest-mixed-all-titanium 06:59:11 bgpcep-csit-1node-bgp-ingest-mixed-all-titanium #664 started. 06:59:11 bgpcep-csit-1node-bgp-ingest-mixed-all-titanium #664 completed. Result was UNSTABLE 06:59:11 Waiting for the completion of bgpcep-csit-1node-throughpcep-all-titanium 06:59:11 bgpcep-csit-1node-throughpcep-all-titanium #664 started. 06:59:11 bgpcep-csit-1node-throughpcep-all-titanium #664 completed. Result was UNSTABLE 06:59:11 Waiting for the completion of bgpcep-csit-1node-userfeatures-all-titanium 06:59:11 bgpcep-csit-1node-userfeatures-all-titanium #664 started. 06:59:11 bgpcep-csit-1node-userfeatures-all-titanium #664 completed. Result was UNSTABLE 06:59:11 Waiting for the completion of daexim-csit-1node-basic-only-titanium 06:59:11 daexim-csit-1node-basic-only-titanium #664 started. 06:59:11 daexim-csit-1node-basic-only-titanium #664 completed. Result was UNSTABLE 06:59:11 Waiting for the completion of daexim-csit-3node-clustering-basic-only-titanium 06:59:11 daexim-csit-3node-clustering-basic-only-titanium #664 started. 06:59:11 daexim-csit-3node-clustering-basic-only-titanium #664 completed. Result was UNSTABLE 06:59:11 Waiting for the completion of distribution-csit-managed-titanium 06:59:11 distribution-csit-managed-titanium #638 started. 06:59:11 distribution-csit-managed-titanium #638 completed. Result was SUCCESS 06:59:11 Waiting for the completion of jsonrpc-csit-1node-basic-only-titanium 06:59:11 jsonrpc-csit-1node-basic-only-titanium #664 started. 06:59:11 jsonrpc-csit-1node-basic-only-titanium #664 completed. Result was UNSTABLE 06:59:11 Waiting for the completion of openflowplugin-csit-1node-cbench-only-titanium 06:59:11 openflowplugin-csit-1node-cbench-only-titanium #664 started. 06:59:11 openflowplugin-csit-1node-cbench-only-titanium #664 completed. Result was UNSTABLE 06:59:11 Waiting for the completion of openflowplugin-csit-1node-flow-services-all-titanium 06:59:11 openflowplugin-csit-1node-flow-services-all-titanium #664 started. 06:59:11 openflowplugin-csit-1node-flow-services-all-titanium #664 completed. Result was UNSTABLE 06:59:11 Waiting for the completion of openflowplugin-csit-1node-perf-bulkomatic-only-titanium 06:59:11 openflowplugin-csit-1node-perf-bulkomatic-only-titanium #664 started. 06:59:11 openflowplugin-csit-1node-perf-bulkomatic-only-titanium #664 completed. Result was UNSTABLE 06:59:11 Waiting for the completion of openflowplugin-csit-1node-perf-stats-collection-only-titanium 06:59:11 openflowplugin-csit-1node-perf-stats-collection-only-titanium #665 started. 06:59:11 openflowplugin-csit-1node-perf-stats-collection-only-titanium #665 completed. Result was UNSTABLE 06:59:11 Waiting for the completion of openflowplugin-csit-1node-scale-link-only-titanium 06:59:11 openflowplugin-csit-1node-scale-link-only-titanium #664 started. 06:59:11 openflowplugin-csit-1node-scale-link-only-titanium #664 completed. Result was UNSTABLE 06:59:11 Waiting for the completion of openflowplugin-csit-1node-scale-only-titanium 06:59:11 openflowplugin-csit-1node-scale-only-titanium #664 started. 06:59:11 openflowplugin-csit-1node-scale-only-titanium #664 completed. Result was UNSTABLE 06:59:11 Waiting for the completion of openflowplugin-csit-1node-scale-switch-only-titanium 06:59:11 openflowplugin-csit-1node-scale-switch-only-titanium #664 started. 06:59:11 openflowplugin-csit-1node-scale-switch-only-titanium #664 completed. Result was UNSTABLE 06:59:11 Waiting for the completion of openflowplugin-csit-3node-clustering-bulkomatic-only-titanium 06:59:11 openflowplugin-csit-3node-clustering-bulkomatic-only-titanium #664 started. 06:59:11 openflowplugin-csit-3node-clustering-bulkomatic-only-titanium #664 completed. Result was UNSTABLE 06:59:11 Waiting for the completion of openflowplugin-csit-3node-clustering-only-titanium 06:59:11 openflowplugin-csit-3node-clustering-only-titanium #664 started. 06:59:11 openflowplugin-csit-3node-clustering-only-titanium #664 completed. Result was UNSTABLE 06:59:11 Waiting for the completion of openflowplugin-csit-3node-clustering-perf-bulkomatic-only-titanium 06:59:11 openflowplugin-csit-3node-clustering-perf-bulkomatic-only-titanium #664 started. 06:59:11 openflowplugin-csit-3node-clustering-perf-bulkomatic-only-titanium #664 completed. Result was UNSTABLE 06:59:11 Waiting for the completion of ovsdb-csit-1node-upstream-southbound-all-titanium 06:59:11 ovsdb-csit-1node-upstream-southbound-all-titanium #664 started. 06:59:11 ovsdb-csit-1node-upstream-southbound-all-titanium #664 completed. Result was UNSTABLE 06:59:11 Waiting for the completion of ovsdb-csit-3node-upstream-clustering-only-titanium 06:59:11 ovsdb-csit-3node-upstream-clustering-only-titanium #664 started. 06:59:11 ovsdb-csit-3node-upstream-clustering-only-titanium #664 completed. Result was UNSTABLE 06:59:11 Build step 'Trigger/call builds on other projects' changed build result to UNSTABLE 06:59:11 $ ssh-agent -k 06:59:11 unset SSH_AUTH_SOCK; 06:59:11 unset SSH_AGENT_PID; 06:59:11 echo Agent pid 3130 killed; 06:59:11 [ssh-agent] Stopped. 06:59:11 [PostBuildScript] - [INFO] Executing post build scripts. 06:59:11 [integration-distribution-test-titanium] $ /bin/sh /tmp/jenkins9600755342988907122.sh 06:59:22 python /tmp/tmp.JvybBPy4l5 https://jenkins.opendaylight.org/releng/job/integration-distribution-test-titanium/677/ 06:59:22 /tmp/tmp.JvybBPy4l5:26: DeprecationWarning: Call to deprecated method findAll. (Replaced by find_all) -- Deprecated since version 4.0.0. 06:59:22 links = soup.findAll("a", { "class" : "model-link" }) 06:59:22 [PostBuildScript] - [INFO] Executing post build scripts. 06:59:22 [integration-distribution-test-titanium] $ /bin/bash /tmp/jenkins9063787704680968667.sh 06:59:22 ---> sysstat.sh 06:59:22 /tmp/jenkins9063787704680968667.sh: line 19: facter: command not found 06:59:22 [integration-distribution-test-titanium] $ /bin/bash /tmp/jenkins4379372927091835454.sh 06:59:22 ---> package-listing.sh 06:59:22 ++ tr '[:upper:]' '[:lower:]' 06:59:22 ++ facter osfamily 06:59:22 /tmp/jenkins4379372927091835454.sh: line 19: facter: command not found 06:59:22 + OS_FAMILY= 06:59:22 [integration-distribution-test-titanium] $ /bin/bash /tmp/jenkins11687518695124812461.sh 06:59:22 ---> capture-instance-metadata.sh 06:59:22 Setup pyenv: 06:59:22 system 06:59:22 3.8.20 06:59:22 3.9.20 06:59:22 3.10.15 06:59:22 * 3.11.10 (set by /w/workspace/integration-distribution-test-titanium/.python-version) 06:59:22 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-kXXJ from file:/tmp/.os_lf_venv 06:59:22 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 06:59:22 lf-activate-venv(): INFO: Attempting to install with network-safe options... 06:59:24 lf-activate-venv(): INFO: Base packages installed successfully 06:59:24 lf-activate-venv(): INFO: Installing additional packages: lftools 06:59:35 lf-activate-venv(): INFO: Adding /tmp/venv-kXXJ/bin to PATH 06:59:35 INFO: Running in OpenStack, capturing instance metadata 06:59:35 [integration-distribution-test-titanium] $ /bin/bash /tmp/jenkins15268269846372160411.sh 06:59:35 provisioning config files... 06:59:36 Could not find credentials [logs] for integration-distribution-test-titanium #677 06:59:36 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/integration-distribution-test-titanium@tmp/config1844819281303745612tmp 06:59:36 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] 06:59:36 Run condition [Regular expression match] enabling perform for step [Provide Configuration files] 06:59:36 provisioning config files... 06:59:36 copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials 06:59:36 [EnvInject] - Injecting environment variables from a build step. 06:59:36 [EnvInject] - Injecting as environment variables the properties content 06:59:36 SERVER_ID=logs 06:59:36 06:59:36 [EnvInject] - Variables injected successfully. 06:59:36 [integration-distribution-test-titanium] $ /bin/bash /tmp/jenkins8905538278950181908.sh 06:59:36 ---> create-netrc.sh 06:59:36 WARN: Log server credential not found. 06:59:36 [integration-distribution-test-titanium] $ /bin/bash /tmp/jenkins7387935858784965678.sh 06:59:36 ---> python-tools-install.sh 06:59:36 Setup pyenv: 06:59:36 system 06:59:36 3.8.20 06:59:36 3.9.20 06:59:36 3.10.15 06:59:36 * 3.11.10 (set by /w/workspace/integration-distribution-test-titanium/.python-version) 06:59:37 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-kXXJ from file:/tmp/.os_lf_venv 06:59:37 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 06:59:37 lf-activate-venv(): INFO: Attempting to install with network-safe options... 06:59:39 lf-activate-venv(): INFO: Base packages installed successfully 06:59:39 lf-activate-venv(): INFO: Installing additional packages: lftools 06:59:48 lf-activate-venv(): INFO: Adding /tmp/venv-kXXJ/bin to PATH 06:59:48 [integration-distribution-test-titanium] $ /bin/sh /tmp/jenkins18351986243901674342.sh 06:59:48 ---> uv-install.sh 06:59:48 uv 0.10.12 is already installed 06:59:48 uvx 0.10.12 (x86_64-unknown-linux-gnu) 06:59:48 [integration-distribution-test-titanium] $ /bin/bash /tmp/jenkins2710315096776311754.sh 06:59:48 ---> sudo-logs.sh 06:59:48 Archiving 'sudo' log.. 06:59:48 /tmp/jenkins2710315096776311754.sh: line 41: facter: command not found 06:59:48 [integration-distribution-test-titanium] $ /bin/bash /tmp/jenkins13186429607510645167.sh 06:59:48 ---> job-cost.sh 06:59:48 INFO: Activating Python virtual environment... 06:59:48 Setup pyenv: 06:59:48 system 06:59:48 3.8.20 06:59:48 3.9.20 06:59:48 3.10.15 06:59:48 * 3.11.10 (set by /w/workspace/integration-distribution-test-titanium/.python-version) 06:59:48 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-kXXJ from file:/tmp/.os_lf_venv 06:59:48 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 06:59:48 lf-activate-venv(): INFO: Attempting to install with network-safe options... 06:59:50 lf-activate-venv(): INFO: Base packages installed successfully 06:59:50 lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 06:59:57 lf-activate-venv(): INFO: Adding /tmp/venv-kXXJ/bin to PATH 06:59:57 INFO: No stack-cost file found 06:59:57 INFO: Instance uptime: 9349s 06:59:57 INFO: Fetching instance metadata (attempt 1 of 3)... 06:59:57 DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type 06:59:58 INFO: Successfully fetched instance metadata 06:59:58 INFO: Instance type: v3-standard-2 06:59:58 INFO: Retrieving pricing info for: v3-standard-2 06:59:58 INFO: Fetching Vexxhost pricing API (attempt 1 of 3)... 06:59:58 DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-standard-2/cost?seconds=9349 06:59:58 INFO: Successfully fetched Vexxhost pricing API 06:59:58 INFO: Retrieved cost: 0.17 06:59:58 INFO: Retrieved resource: v3-standard-2 06:59:58 INFO: Creating archive directory: /w/workspace/integration-distribution-test-titanium/archives/cost 06:59:58 INFO: Archiving costs to: /w/workspace/integration-distribution-test-titanium/archives/cost.csv 06:59:58 INFO: Successfully archived job cost data 06:59:58 DEBUG: Cost data: integration-distribution-test-titanium,677,2026-03-20 06:59:58,v3-standard-2,9349,0.17,0.00,UNSTABLE 06:59:58 [integration-distribution-test-titanium] $ /bin/bash -l /tmp/jenkins15619701154103972736.sh 06:59:58 ---> logs-deploy.sh 06:59:58 Setup pyenv: 06:59:58 system 06:59:58 3.8.20 06:59:58 3.9.20 06:59:58 3.10.15 06:59:58 * 3.11.10 (set by /w/workspace/integration-distribution-test-titanium/.python-version) 06:59:58 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-kXXJ from file:/tmp/.os_lf_venv 06:59:58 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 06:59:58 lf-activate-venv(): INFO: Attempting to install with network-safe options... 07:00:00 lf-activate-venv(): INFO: Base packages installed successfully 07:00:00 lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 07:00:09 lf-activate-venv(): INFO: Adding /tmp/venv-kXXJ/bin to PATH 07:00:09 WARNING: Nexus logging server not set 07:00:09 INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/integration-distribution-test-titanium/677/ 07:00:09 INFO: archiving logs to S3 07:00:10 /tmp/venv-kXXJ/lib/python3.11/site-packages/requests/__init__.py:113: RequestsDependencyWarning: urllib3 (1.26.20) or chardet (7.2.0)/charset_normalizer (3.4.6) doesn't match a supported version! 07:00:10 warnings.warn( 07:00:11 ---> uname -a: 07:00:11 Linux prd-queue-disttest-2c-1g-6224 6.8.0-90-generic #91-Ubuntu SMP PREEMPT_DYNAMIC Tue Nov 18 14:14:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux 07:00:11 07:00:11 07:00:11 ---> lscpu: 07:00:11 Architecture: x86_64 07:00:11 CPU op-mode(s): 32-bit, 64-bit 07:00:11 Address sizes: 40 bits physical, 48 bits virtual 07:00:11 Byte Order: Little Endian 07:00:11 CPU(s): 2 07:00:11 On-line CPU(s) list: 0,1 07:00:11 Vendor ID: AuthenticAMD 07:00:11 Model name: AMD EPYC-Rome Processor 07:00:11 CPU family: 23 07:00:11 Model: 49 07:00:11 Thread(s) per core: 1 07:00:11 Core(s) per socket: 1 07:00:11 Socket(s): 2 07:00:11 Stepping: 0 07:00:11 BogoMIPS: 5599.99 07:00:11 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities 07:00:11 Virtualization: AMD-V 07:00:11 Hypervisor vendor: KVM 07:00:11 Virtualization type: full 07:00:11 L1d cache: 64 KiB (2 instances) 07:00:11 L1i cache: 64 KiB (2 instances) 07:00:11 L2 cache: 1 MiB (2 instances) 07:00:11 L3 cache: 32 MiB (2 instances) 07:00:11 NUMA node(s): 1 07:00:11 NUMA node0 CPU(s): 0,1 07:00:11 Vulnerability Gather data sampling: Not affected 07:00:11 Vulnerability Itlb multihit: Not affected 07:00:11 Vulnerability L1tf: Not affected 07:00:11 Vulnerability Mds: Not affected 07:00:11 Vulnerability Meltdown: Not affected 07:00:11 Vulnerability Mmio stale data: Not affected 07:00:11 Vulnerability Reg file data sampling: Not affected 07:00:11 Vulnerability Retbleed: Mitigation; untrained return thunk; SMT disabled 07:00:11 Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode 07:00:11 Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl 07:00:11 Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization 07:00:11 Vulnerability Spectre v2: Mitigation; Retpolines; IBPB conditional; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected 07:00:11 Vulnerability Srbds: Not affected 07:00:11 Vulnerability Tsx async abort: Not affected 07:00:11 Vulnerability Vmscape: Not affected 07:00:11 07:00:11 07:00:11 ---> nproc: 07:00:11 2 07:00:11 07:00:11 07:00:11 ---> df -h: 07:00:11 Filesystem Size Used Avail Use% Mounted on 07:00:11 tmpfs 795M 1.1M 794M 1% /run 07:00:11 /dev/vda1 38G 7.8G 30G 21% / 07:00:11 tmpfs 3.9G 0 3.9G 0% /dev/shm 07:00:11 tmpfs 5.0M 0 5.0M 0% /run/lock 07:00:11 /dev/vda16 881M 117M 703M 15% /boot 07:00:11 /dev/vda15 105M 6.2M 99M 6% /boot/efi 07:00:11 tmpfs 795M 16K 795M 1% /run/user/1001 07:00:11 07:00:11 07:00:11 ---> free -m: 07:00:11 total used free shared buff/cache available 07:00:11 Mem: 7941 700 5511 4 2014 7241 07:00:11 Swap: 1023 0 1023 07:00:11 07:00:11 07:00:11 ---> ip addr: 07:00:11 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 07:00:11 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 07:00:11 inet 127.0.0.1/8 scope host lo 07:00:11 valid_lft forever preferred_lft forever 07:00:11 inet6 ::1/128 scope host noprefixroute 07:00:11 valid_lft forever preferred_lft forever 07:00:11 2: ens3: mtu 1458 qdisc mq state UP group default qlen 1000 07:00:11 link/ether fa:16:3e:e1:54:1d brd ff:ff:ff:ff:ff:ff 07:00:11 altname enp0s3 07:00:11 inet 10.30.170.47/23 metric 100 brd 10.30.171.255 scope global dynamic ens3 07:00:11 valid_lft 77046sec preferred_lft 77046sec 07:00:11 inet6 fe80::f816:3eff:fee1:541d/64 scope link 07:00:11 valid_lft forever preferred_lft forever 07:00:11 07:00:11 07:00:11 ---> sar -b -r -n DEV: 07:00:11 Linux 6.8.0-90-generic (prd-queue-disttest-2c-1g-6224) 03/20/26 _x86_64_ (2 CPU) 07:00:11 07:00:11 04:24:21 LINUX RESTART (2 CPU) 07:00:11 07:00:11 04:30:07 tps rtps wtps dtps bread/s bwrtn/s bdscd/s 07:00:11 04:40:06 1.36 0.01 1.35 0.00 0.05 16.01 0.24 07:00:11 04:50:01 1.31 0.00 1.31 0.00 0.00 15.63 0.00 07:00:11 05:00:07 1.62 0.00 1.59 0.02 0.00 19.07 0.71 07:00:11 05:10:07 2.06 0.32 1.71 0.03 40.08 74.12 1.45 07:00:11 05:20:01 1.17 0.00 1.16 0.02 0.01 14.32 1.09 07:00:11 05:30:07 14.32 0.00 1.51 12.81 0.15 18.71 106691.26 07:00:11 05:40:07 1.24 0.00 1.24 0.00 0.00 15.17 0.00 07:00:11 05:50:02 1.14 0.00 1.14 0.00 0.00 14.08 0.00 07:00:11 06:00:07 1.44 0.00 1.43 0.02 0.00 17.93 0.22 07:00:11 06:10:06 1.25 0.00 1.25 0.00 0.00 15.20 0.00 07:00:11 06:20:01 1.16 0.00 1.16 0.00 0.00 14.32 0.00 07:00:11 06:30:07 1.49 0.01 1.46 0.02 0.09 19.31 0.25 07:00:11 06:40:07 1.27 0.00 1.26 0.01 0.00 15.76 0.05 07:00:11 06:50:01 1.19 0.00 1.19 0.00 0.00 14.61 0.00 07:00:11 07:00:00 5.92 0.35 4.66 0.90 23.34 376.34 3094.37 07:00:11 Average: 2.54 0.05 1.56 0.93 4.25 44.04 7397.92 07:00:11 07:00:11 04:30:07 kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 07:00:11 04:40:06 5777716 7493888 296492 3.65 61756 1835012 530884 5.78 466112 1614056 236 07:00:11 04:50:01 5777716 7494372 296016 3.64 61912 1835340 530964 5.78 466224 1614544 124 07:00:11 05:00:07 5773696 7490900 299428 3.68 62108 1835672 530964 5.78 466248 1615072 148 07:00:11 05:10:07 5732084 7478044 311912 3.84 62420 1863840 531136 5.79 477796 1632168 188 07:00:11 05:20:01 5731844 7478428 311528 3.83 62588 1864284 531240 5.79 477880 1632672 240 07:00:11 05:30:07 5728928 7476084 313808 3.86 62748 1864668 531272 5.79 478192 1633176 188 07:00:11 05:40:07 5744804 7492420 297472 3.66 62880 1864992 531192 5.79 478184 1633632 68 07:00:11 05:50:02 5751928 7500008 289880 3.56 63008 1865320 531192 5.79 478196 1634088 148 07:00:11 06:00:07 5743616 7492180 297724 3.66 63160 1865648 531256 5.79 478336 1634568 180 07:00:11 06:10:06 5743616 7492644 297252 3.66 63296 1865976 531256 5.79 478204 1635028 196 07:00:11 06:20:01 5758792 7508428 281468 3.46 63440 1866428 531264 5.79 478396 1635500 240 07:00:11 06:30:07 5743420 7493588 296200 3.64 63612 1866784 586332 6.39 483588 1636024 256 07:00:11 06:40:07 5748556 7499192 290604 3.57 63740 1867112 531316 5.79 478464 1636484 224 07:00:11 06:50:01 5748052 7499156 290636 3.57 63884 1867432 531316 5.79 478484 1636948 152 07:00:11 07:00:00 5710580 7477648 309088 3.80 69620 1875124 564620 6.15 514352 1646660 28328 07:00:11 Average: 5747690 7491132 298634 3.67 63345 1860242 537080 5.85 478577 1631375 2061 07:00:11 07:00:11 04:30:07 IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 07:00:11 04:40:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 07:00:11 04:40:06 ens3 3.31 0.14 0.49 0.11 0.00 0.00 0.00 0.00 07:00:11 04:50:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 07:00:11 04:50:01 ens3 0.72 0.06 0.09 0.03 0.00 0.00 0.00 0.00 07:00:11 05:00:07 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 07:00:11 05:00:07 ens3 0.45 0.06 0.08 0.03 0.00 0.00 0.00 0.00 07:00:11 05:10:07 lo 1.02 1.02 0.05 0.05 0.00 0.00 0.00 0.00 07:00:11 05:10:07 ens3 0.54 0.21 3.05 0.03 0.00 0.00 0.00 0.00 07:00:11 05:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 07:00:11 05:20:01 ens3 0.24 0.05 0.07 0.03 0.00 0.00 0.00 0.00 07:00:11 05:30:07 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 07:00:11 05:30:07 ens3 0.25 0.04 0.07 0.03 0.00 0.00 0.00 0.00 07:00:11 05:40:07 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 07:00:11 05:40:07 ens3 0.26 0.06 0.07 0.03 0.00 0.00 0.00 0.00 07:00:11 05:50:02 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 07:00:11 05:50:02 ens3 0.17 0.04 0.04 0.01 0.00 0.00 0.00 0.00 07:00:11 06:00:07 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 07:00:11 06:00:07 ens3 0.30 0.08 0.11 0.06 0.00 0.00 0.00 0.00 07:00:11 06:10:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 07:00:11 06:10:06 ens3 0.18 0.05 0.04 0.02 0.00 0.00 0.00 0.00 07:00:11 06:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 07:00:11 06:20:01 ens3 0.18 0.04 0.04 0.01 0.00 0.00 0.00 0.00 07:00:11 06:30:07 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 07:00:11 06:30:07 ens3 0.26 0.06 0.08 0.04 0.00 0.00 0.00 0.00 07:00:11 06:40:07 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 07:00:11 06:40:07 ens3 0.47 0.13 0.15 0.09 0.00 0.00 0.00 0.00 07:00:11 06:50:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 07:00:11 06:50:01 ens3 0.23 0.04 0.05 0.01 0.00 0.00 0.00 0.00 07:00:11 07:00:00 lo 1.11 1.11 0.07 0.07 0.00 0.00 0.00 0.00 07:00:11 07:00:00 ens3 6.73 5.28 33.84 1.28 0.00 0.00 0.00 0.00 07:00:11 Average: lo 1.01 1.01 0.05 0.05 0.00 0.00 0.00 0.00 07:00:11 Average: ens3 0.95 0.42 2.55 0.12 0.00 0.00 0.00 0.00 07:00:11 07:00:11 07:00:11 ---> sar -P ALL: 07:00:11 Linux 6.8.0-90-generic (prd-queue-disttest-2c-1g-6224) 03/20/26 _x86_64_ (2 CPU) 07:00:11 07:00:11 04:24:21 LINUX RESTART (2 CPU) 07:00:11 07:00:11 04:30:07 CPU %user %nice %system %iowait %steal %idle 07:00:11 04:40:06 all 0.29 0.00 0.08 0.01 0.04 99.59 07:00:11 04:40:06 0 0.51 0.00 0.07 0.02 0.03 99.38 07:00:11 04:40:06 1 0.07 0.00 0.09 0.01 0.05 99.80 07:00:11 04:50:01 all 0.23 0.00 0.08 0.16 0.03 99.51 07:00:11 04:50:01 0 0.36 0.00 0.05 0.22 0.02 99.34 07:00:11 04:50:01 1 0.10 0.00 0.10 0.09 0.03 99.67 07:00:11 05:00:07 all 0.28 0.00 0.18 0.02 0.03 99.49 07:00:11 05:00:07 0 0.16 0.00 0.20 0.01 0.03 99.60 07:00:11 05:00:07 1 0.40 0.00 0.16 0.03 0.02 99.38 07:00:11 05:10:07 all 0.36 0.00 0.13 0.07 0.03 99.40 07:00:11 05:10:07 0 0.22 0.00 0.17 0.13 0.03 99.45 07:00:11 05:10:07 1 0.50 0.00 0.10 0.02 0.02 99.35 07:00:11 05:20:01 all 0.28 0.00 0.07 0.01 0.04 99.60 07:00:11 05:20:01 0 0.05 0.00 0.09 0.01 0.05 99.80 07:00:11 05:20:01 1 0.51 0.00 0.05 0.01 0.02 99.40 07:00:11 05:30:07 all 0.23 0.00 0.17 0.03 0.04 99.53 07:00:11 05:30:07 0 0.07 0.00 0.19 0.04 0.05 99.65 07:00:11 05:30:07 1 0.39 0.00 0.15 0.02 0.03 99.41 07:00:11 05:40:07 all 0.24 0.00 0.07 0.01 0.04 99.63 07:00:11 05:40:07 0 0.05 0.00 0.09 0.01 0.05 99.80 07:00:11 05:40:07 1 0.44 0.00 0.05 0.02 0.03 99.47 07:00:11 05:50:02 all 0.22 0.00 0.07 0.02 0.04 99.66 07:00:11 05:50:02 0 0.26 0.00 0.07 0.01 0.04 99.62 07:00:11 05:50:02 1 0.17 0.00 0.07 0.02 0.04 99.70 07:00:11 06:00:07 all 0.27 0.00 0.16 0.02 0.04 99.51 07:00:11 06:00:07 0 0.48 0.00 0.14 0.02 0.03 99.33 07:00:11 06:00:07 1 0.07 0.00 0.17 0.02 0.05 99.70 07:00:11 06:10:06 all 0.19 0.00 0.07 0.02 0.03 99.69 07:00:11 06:10:06 0 0.34 0.00 0.06 0.03 0.02 99.55 07:00:11 06:10:06 1 0.04 0.00 0.08 0.01 0.05 99.82 07:00:11 06:20:01 all 0.22 0.00 0.07 0.14 0.03 99.53 07:00:11 06:20:01 0 0.30 0.00 0.06 0.05 0.02 99.57 07:00:11 06:20:01 1 0.15 0.00 0.08 0.24 0.04 99.48 07:00:11 07:00:11 06:20:01 CPU %user %nice %system %iowait %steal %idle 07:00:11 06:30:07 all 0.27 0.00 0.18 0.12 0.03 99.40 07:00:11 06:30:07 0 0.26 0.00 0.16 0.03 0.02 99.52 07:00:11 06:30:07 1 0.28 0.00 0.20 0.21 0.04 99.27 07:00:11 06:40:07 all 0.23 0.00 0.08 0.09 0.03 99.57 07:00:11 06:40:07 0 0.39 0.00 0.07 0.03 0.02 99.49 07:00:11 06:40:07 1 0.08 0.00 0.09 0.16 0.03 99.64 07:00:11 06:50:01 all 0.19 0.00 0.08 0.04 0.03 99.66 07:00:11 06:50:01 0 0.14 0.00 0.08 0.02 0.04 99.72 07:00:11 06:50:01 1 0.24 0.00 0.08 0.06 0.03 99.59 07:00:11 07:00:00 all 3.30 0.00 0.57 0.15 0.05 95.94 07:00:11 07:00:00 0 1.89 0.00 0.52 0.23 0.04 97.31 07:00:11 07:00:00 1 4.71 0.00 0.61 0.07 0.05 94.57 07:00:11 Average: all 0.45 0.00 0.14 0.06 0.03 99.31 07:00:11 Average: 0 0.37 0.00 0.14 0.06 0.03 99.41 07:00:11 Average: 1 0.54 0.00 0.14 0.07 0.03 99.22 07:00:11 07:00:11 07:00:11