02:18:48 Started by upstream project "autorelease-release-titanium-mvn39-openjdk21" build number 27 02:18:48 originally caused by: 02:18:48 Started by timer 02:18:48 Running as SYSTEM 02:18:48 [EnvInject] - Loading node environment variables. 02:18:48 Building remotely on prd-queue-disttest-2c-1g-25682 (queue-disttest-2c-1g) in workspace /w/workspace/integration-distribution-test-titanium 02:18:48 [ssh-agent] Looking for ssh-agent implementation... 02:18:49 [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) 02:18:49 $ ssh-agent 02:18:49 SSH_AUTH_SOCK=/tmp/ssh-oVmUHpKNQgyu/agent.9213 02:18:49 SSH_AGENT_PID=9214 02:18:49 [ssh-agent] Started. 02:18:49 Running ssh-add (command line suppressed) 02:18:49 Identity added: /w/workspace/integration-distribution-test-titanium@tmp/private_key_6684777075299435450.key (/w/workspace/integration-distribution-test-titanium@tmp/private_key_6684777075299435450.key) 02:18:49 [ssh-agent] Using credentials jenkins (jenkins-ssh) 02:18:49 No emails were triggered. 02:18:49 provisioning config files... 02:18:49 copy managed file [npmrc] to file:/home/jenkins/.npmrc 02:18:49 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 02:18:49 [integration-distribution-test-titanium] $ /bin/bash /tmp/jenkins6737797728997277458.sh 02:18:49 ---> python-tools-install.sh 02:18:49 Setup pyenv: 02:18:49 system 02:18:49 * 3.8.13 (set by /opt/pyenv/version) 02:18:49 * 3.9.13 (set by /opt/pyenv/version) 02:18:49 3.10.13 02:18:54 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-Mqxl 02:18:54 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 02:18:57 lf-activate-venv(): INFO: Installing: lftools 02:19:31 lf-activate-venv(): INFO: Adding /tmp/venv-Mqxl/bin to PATH 02:19:31 Generating Requirements File 02:19:58 Python 3.10.13 02:19:58 pip 24.2 from /tmp/venv-Mqxl/lib/python3.10/site-packages/pip (python 3.10) 02:19:58 appdirs==1.4.4 02:19:58 argcomplete==3.5.0 02:19:58 aspy.yaml==1.3.0 02:19:58 attrs==24.2.0 02:19:58 autopage==0.5.2 02:19:58 beautifulsoup4==4.12.3 02:19:58 boto3==1.35.24 02:19:58 botocore==1.35.24 02:19:58 bs4==0.0.2 02:19:58 cachetools==5.5.0 02:19:58 certifi==2024.8.30 02:19:58 cffi==1.17.1 02:19:58 cfgv==3.4.0 02:19:58 chardet==5.2.0 02:19:58 charset-normalizer==3.3.2 02:19:58 click==8.1.7 02:19:58 cliff==4.7.0 02:19:58 cmd2==2.4.3 02:19:58 cryptography==3.3.2 02:19:58 debtcollector==3.0.0 02:19:58 decorator==5.1.1 02:19:58 defusedxml==0.7.1 02:19:58 Deprecated==1.2.14 02:19:58 distlib==0.3.8 02:19:58 dnspython==2.6.1 02:19:58 docker==4.2.2 02:19:58 dogpile.cache==1.3.3 02:19:58 durationpy==0.7 02:19:58 email_validator==2.2.0 02:19:58 filelock==3.16.1 02:19:58 future==1.0.0 02:19:58 gitdb==4.0.11 02:19:58 GitPython==3.1.43 02:19:58 google-auth==2.35.0 02:19:58 httplib2==0.22.0 02:19:58 identify==2.6.1 02:19:58 idna==3.10 02:19:58 importlib-resources==1.5.0 02:19:58 iso8601==2.1.0 02:19:58 Jinja2==3.1.4 02:19:58 jmespath==1.0.1 02:19:58 jsonpatch==1.33 02:19:58 jsonpointer==3.0.0 02:19:58 jsonschema==4.23.0 02:19:58 jsonschema-specifications==2023.12.1 02:19:58 keystoneauth1==5.8.0 02:19:58 kubernetes==31.0.0 02:19:58 lftools==0.37.10 02:19:58 lxml==5.3.0 02:19:58 MarkupSafe==2.1.5 02:19:58 msgpack==1.1.0 02:19:58 multi_key_dict==2.0.3 02:19:58 munch==4.0.0 02:19:58 netaddr==1.3.0 02:19:58 netifaces==0.11.0 02:19:58 niet==1.4.2 02:19:58 nodeenv==1.9.1 02:19:58 oauth2client==4.1.3 02:19:58 oauthlib==3.2.2 02:19:58 openstacksdk==4.0.0 02:19:58 os-client-config==2.1.0 02:19:58 os-service-types==1.7.0 02:19:58 osc-lib==3.1.0 02:19:58 oslo.config==9.6.0 02:19:58 oslo.context==5.6.0 02:19:58 oslo.i18n==6.4.0 02:19:58 oslo.log==6.1.2 02:19:58 oslo.serialization==5.5.0 02:19:58 oslo.utils==7.3.0 02:19:58 packaging==24.1 02:19:58 pbr==6.1.0 02:19:58 platformdirs==4.3.6 02:19:58 prettytable==3.11.0 02:19:58 pyasn1==0.6.1 02:19:58 pyasn1_modules==0.4.1 02:19:58 pycparser==2.22 02:19:58 pygerrit2==2.0.15 02:19:58 PyGithub==2.4.0 02:19:58 PyJWT==2.9.0 02:19:58 PyNaCl==1.5.0 02:19:58 pyparsing==2.4.7 02:19:58 pyperclip==1.9.0 02:19:58 pyrsistent==0.20.0 02:19:58 python-cinderclient==9.6.0 02:19:58 python-dateutil==2.9.0.post0 02:19:58 python-heatclient==4.0.0 02:19:58 python-jenkins==1.8.2 02:19:58 python-keystoneclient==5.5.0 02:19:58 python-magnumclient==4.7.0 02:19:58 python-openstackclient==7.1.2 02:19:58 python-swiftclient==4.6.0 02:19:58 PyYAML==6.0.2 02:19:58 referencing==0.35.1 02:19:58 requests==2.32.3 02:19:58 requests-oauthlib==2.0.0 02:19:58 requestsexceptions==1.4.0 02:19:58 rfc3986==2.0.0 02:19:58 rpds-py==0.20.0 02:19:58 rsa==4.9 02:19:58 ruamel.yaml==0.18.6 02:19:58 ruamel.yaml.clib==0.2.8 02:19:58 s3transfer==0.10.2 02:19:58 simplejson==3.19.3 02:19:58 six==1.16.0 02:19:58 smmap==5.0.1 02:19:58 soupsieve==2.6 02:19:58 stevedore==5.3.0 02:19:58 tabulate==0.9.0 02:19:58 toml==0.10.2 02:19:58 tomlkit==0.13.2 02:19:58 tqdm==4.66.5 02:19:58 typing_extensions==4.12.2 02:19:58 tzdata==2024.1 02:19:58 urllib3==1.26.20 02:19:58 virtualenv==20.26.5 02:19:58 wcwidth==0.2.13 02:19:58 websocket-client==1.8.0 02:19:58 wrapt==1.16.0 02:19:58 xdg==6.0.0 02:19:58 xmltodict==0.13.0 02:19:58 yq==3.4.3 02:19:59 $ ssh-agent -k 02:19:59 unset SSH_AUTH_SOCK; 02:19:59 unset SSH_AGENT_PID; 02:19:59 echo Agent pid 9214 killed; 02:19:59 [ssh-agent] Stopped. 02:19:59 ERROR: Build aborted. Can't trigger undefined projects. 1 of the below project(s) can't be resolved: 02:19:59 > distribution-csit-managed-titanium 02:19:59 Check your configuration! 02:19:59 [PostBuildScript] - [INFO] Executing post build scripts. 02:19:59 [integration-distribution-test-titanium] $ /bin/sh /tmp/jenkins4143451167312276675.sh 02:20:17 python /tmp/tmp.RVLGQ7WFCu https://jenkins.opendaylight.org/releng/job/integration-distribution-test-titanium/27/ 02:20:17 [PostBuildScript] - [INFO] Executing post build scripts. 02:20:17 [integration-distribution-test-titanium] $ /bin/bash /tmp/jenkins1777172088875690862.sh 02:20:17 ---> sysstat.sh 02:20:17 [integration-distribution-test-titanium] $ /bin/bash /tmp/jenkins7312564746910987778.sh 02:20:17 ---> package-listing.sh 02:20:17 ++ facter osfamily 02:20:17 ++ tr '[:upper:]' '[:lower:]' 02:20:18 + OS_FAMILY=redhat 02:20:18 + workspace=/w/workspace/integration-distribution-test-titanium 02:20:18 + START_PACKAGES=/tmp/packages_start.txt 02:20:18 + END_PACKAGES=/tmp/packages_end.txt 02:20:18 + DIFF_PACKAGES=/tmp/packages_diff.txt 02:20:18 + PACKAGES=/tmp/packages_start.txt 02:20:18 + '[' /w/workspace/integration-distribution-test-titanium ']' 02:20:18 + PACKAGES=/tmp/packages_end.txt 02:20:18 + case "${OS_FAMILY}" in 02:20:18 + rpm -qa 02:20:18 + sort 02:20:18 + '[' -f /tmp/packages_start.txt ']' 02:20:18 + '[' -f /tmp/packages_end.txt ']' 02:20:18 + diff /tmp/packages_start.txt /tmp/packages_end.txt 02:20:18 + '[' /w/workspace/integration-distribution-test-titanium ']' 02:20:18 + mkdir -p /w/workspace/integration-distribution-test-titanium/archives/ 02:20:18 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/integration-distribution-test-titanium/archives/ 02:20:18 [integration-distribution-test-titanium] $ /bin/bash /tmp/jenkins14559639495275158935.sh 02:20:18 ---> capture-instance-metadata.sh 02:20:18 Setup pyenv: 02:20:18 system 02:20:18 3.8.13 02:20:18 3.9.13 02:20:18 * 3.10.13 (set by /w/workspace/integration-distribution-test-titanium/.python-version) 02:20:19 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Mqxl from file:/tmp/.os_lf_venv 02:20:20 lf-activate-venv(): INFO: Installing: lftools 02:20:34 lf-activate-venv(): INFO: Adding /tmp/venv-Mqxl/bin to PATH 02:20:34 INFO: Running in OpenStack, capturing instance metadata 02:20:34 [integration-distribution-test-titanium] $ /bin/bash /tmp/jenkins10073122369729317617.sh 02:20:34 provisioning config files... 02:20:35 Could not find credentials [logs] for integration-distribution-test-titanium #27 02:20:35 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/integration-distribution-test-titanium@tmp/config9181977160123724164tmp 02:20:35 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] 02:20:35 Run condition [Regular expression match] enabling perform for step [Provide Configuration files] 02:20:35 provisioning config files... 02:20:35 copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials 02:20:35 [EnvInject] - Injecting environment variables from a build step. 02:20:35 [EnvInject] - Injecting as environment variables the properties content 02:20:35 SERVER_ID=logs 02:20:35 02:20:35 [EnvInject] - Variables injected successfully. 02:20:35 [integration-distribution-test-titanium] $ /bin/bash /tmp/jenkins10635327605594608594.sh 02:20:35 ---> create-netrc.sh 02:20:35 WARN: Log server credential not found. 02:20:35 [integration-distribution-test-titanium] $ /bin/bash /tmp/jenkins12046762340752053021.sh 02:20:35 ---> python-tools-install.sh 02:20:35 Setup pyenv: 02:20:35 system 02:20:35 3.8.13 02:20:35 3.9.13 02:20:35 * 3.10.13 (set by /w/workspace/integration-distribution-test-titanium/.python-version) 02:20:36 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Mqxl from file:/tmp/.os_lf_venv 02:20:37 lf-activate-venv(): INFO: Installing: lftools 02:20:49 lf-activate-venv(): INFO: Adding /tmp/venv-Mqxl/bin to PATH 02:20:49 [integration-distribution-test-titanium] $ /bin/bash /tmp/jenkins13347654735021977235.sh 02:20:49 ---> sudo-logs.sh 02:20:49 Archiving 'sudo' log.. 02:20:49 [integration-distribution-test-titanium] $ /bin/bash /tmp/jenkins17144229571177066090.sh 02:20:50 ---> job-cost.sh 02:20:50 Setup pyenv: 02:20:50 system 02:20:50 3.8.13 02:20:50 3.9.13 02:20:50 * 3.10.13 (set by /w/workspace/integration-distribution-test-titanium/.python-version) 02:20:50 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Mqxl from file:/tmp/.os_lf_venv 02:20:51 lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 02:20:56 lf-activate-venv(): INFO: Adding /tmp/venv-Mqxl/bin to PATH 02:20:56 INFO: No Stack... 02:20:57 INFO: Retrieving Pricing Info for: v3-standard-2 02:20:57 INFO: Archiving Costs 02:20:57 [integration-distribution-test-titanium] $ /bin/bash -l /tmp/jenkins9556847861706045479.sh 02:20:57 ---> logs-deploy.sh 02:20:57 Setup pyenv: 02:20:57 system 02:20:57 3.8.13 02:20:57 3.9.13 02:20:57 * 3.10.13 (set by /w/workspace/integration-distribution-test-titanium/.python-version) 02:20:58 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Mqxl from file:/tmp/.os_lf_venv 02:20:59 lf-activate-venv(): INFO: Installing: lftools 02:21:15 lf-activate-venv(): INFO: Adding /tmp/venv-Mqxl/bin to PATH 02:21:15 WARNING: Nexus logging server not set 02:21:15 INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/integration-distribution-test-titanium/27/ 02:21:15 INFO: archiving logs to S3 02:21:16 ---> uname -a: 02:21:16 Linux prd-queue-disttest-2c-1g-25682.novalocal 3.10.0-1160.118.1.el7.x86_64 #1 SMP Wed Apr 24 16:01:50 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux 02:21:16 02:21:16 02:21:16 ---> lscpu: 02:21:16 Architecture: x86_64 02:21:16 CPU op-mode(s): 32-bit, 64-bit 02:21:16 Byte Order: Little Endian 02:21:16 CPU(s): 2 02:21:16 On-line CPU(s) list: 0,1 02:21:16 Thread(s) per core: 1 02:21:16 Core(s) per socket: 1 02:21:16 Socket(s): 2 02:21:16 NUMA node(s): 1 02:21:16 Vendor ID: AuthenticAMD 02:21:16 CPU family: 23 02:21:16 Model: 49 02:21:16 Model name: AMD EPYC-Rome Processor 02:21:16 Stepping: 0 02:21:16 CPU MHz: 2799.998 02:21:16 BogoMIPS: 5599.99 02:21:16 Virtualization: AMD-V 02:21:16 Hypervisor vendor: KVM 02:21:16 Virtualization type: full 02:21:16 L1d cache: 32K 02:21:16 L1i cache: 32K 02:21:16 L2 cache: 512K 02:21:16 L3 cache: 16384K 02:21:16 NUMA node0 CPU(s): 0,1 02:21:16 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm art rep_good nopl extd_apicid eagerfpu pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd rsb_ctxsw ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 clzero xsaveerptr arat npt nrip_save umip spec_ctrl intel_stibp arch_capabilities 02:21:16 02:21:16 02:21:16 ---> nproc: 02:21:16 2 02:21:16 02:21:16 02:21:16 ---> df -h: 02:21:16 Filesystem Size Used Avail Use% Mounted on 02:21:16 devtmpfs 3.8G 0 3.8G 0% /dev 02:21:16 tmpfs 3.9G 0 3.9G 0% /dev/shm 02:21:16 tmpfs 3.9G 17M 3.9G 1% /run 02:21:16 tmpfs 3.9G 0 3.9G 0% /sys/fs/cgroup 02:21:16 /dev/vda1 40G 5.8G 35G 15% / 02:21:16 tmpfs 783M 0 783M 0% /run/user/1001 02:21:16 02:21:16 02:21:16 ---> free -m: 02:21:16 total used free shared buff/cache available 02:21:16 Mem: 7821 504 5423 16 1893 7030 02:21:16 Swap: 1023 0 1023 02:21:16 02:21:16 02:21:16 ---> ip addr: 02:21:16 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 02:21:16 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 02:21:16 inet 127.0.0.1/8 scope host lo 02:21:16 valid_lft forever preferred_lft forever 02:21:16 inet6 ::1/128 scope host 02:21:16 valid_lft forever preferred_lft forever 02:21:16 2: eth0: mtu 1458 qdisc mq state UP group default qlen 1000 02:21:16 link/ether fa:16:3e:40:a5:a7 brd ff:ff:ff:ff:ff:ff 02:21:16 inet 10.30.170.32/23 brd 10.30.171.255 scope global dynamic eth0 02:21:16 valid_lft 86218sec preferred_lft 86218sec 02:21:16 inet6 fe80::f816:3eff:fe40:a5a7/64 scope link 02:21:16 valid_lft forever preferred_lft forever 02:21:16 02:21:16 02:21:16 ---> sar -b -r -n DEV: 02:21:16 Linux 3.10.0-1160.118.1.el7.x86_64 (centos-7-robot-05cc0f9b-716b-4844-b983-0ce161c05ab8.novalocal) 09/22/2024 _x86_64_ (2 CPU) 02:21:16 02:21:16 02:18:09 AM LINUX RESTART 02:21:16 02:21:16 02:19:01 AM tps rtps wtps bread/s bwrtn/s 02:21:16 02:20:01 AM 152.72 19.56 133.17 1267.50 6745.46 02:21:16 02:21:01 AM 269.37 1.68 267.69 143.64 8052.75 02:21:16 Average: 211.05 10.62 200.43 705.52 7399.16 02:21:16 02:21:16 02:19:01 AM kbmemfree kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 02:21:16 02:20:01 AM 5616216 2392512 29.87 2620 1832000 590972 6.52 490216 1602352 157424 02:21:16 02:21:01 AM 5602640 2406088 30.04 2620 1824836 597316 6.59 620324 1472868 13576 02:21:16 Average: 5609428 2399300 29.96 2620 1828418 594144 6.56 555270 1537610 85500 02:21:16 02:21:16 02:19:01 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s 02:21:16 02:20:01 AM eth0 80.03 71.63 802.79 8.83 0.00 0.00 0.00 02:21:16 02:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:21:16 02:21:01 AM eth0 57.06 51.53 342.59 10.13 0.00 0.00 0.00 02:21:16 02:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:21:16 Average: eth0 68.54 61.58 572.67 9.48 0.00 0.00 0.00 02:21:16 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:21:16 02:21:16 02:21:16 ---> sar -P ALL: 02:21:16 Linux 3.10.0-1160.118.1.el7.x86_64 (centos-7-robot-05cc0f9b-716b-4844-b983-0ce161c05ab8.novalocal) 09/22/2024 _x86_64_ (2 CPU) 02:21:16 02:21:16 02:18:09 AM LINUX RESTART 02:21:16 02:21:16 02:19:01 AM CPU %user %nice %system %iowait %steal %idle 02:21:16 02:20:01 AM all 36.15 0.00 3.32 3.36 0.12 57.05 02:21:16 02:20:01 AM 0 64.23 0.00 4.97 4.74 0.13 25.94 02:21:16 02:20:01 AM 1 9.81 0.00 1.78 2.07 0.12 86.22 02:21:16 02:21:01 AM all 30.96 0.00 2.27 8.47 0.11 58.19 02:21:16 02:21:01 AM 0 48.58 0.00 2.68 9.19 0.11 39.45 02:21:16 02:21:01 AM 1 13.98 0.00 1.87 7.81 0.10 76.24 02:21:16 Average: all 33.55 0.00 2.79 5.92 0.12 57.62 02:21:16 Average: 0 56.34 0.00 3.82 6.98 0.12 32.75 02:21:16 Average: 1 11.89 0.00 1.82 4.93 0.11 81.25 02:21:16 02:21:16 02:21:16