02:19:12 Started by upstream project "autorelease-release-titanium-mvn39-openjdk21" build number 29 02:19:12 originally caused by: 02:19:12 Started by timer 02:19:12 Running as SYSTEM 02:19:12 [EnvInject] - Loading node environment variables. 02:19:12 Building remotely on prd-queue-disttest-2c-1g-26764 (queue-disttest-2c-1g) in workspace /w/workspace/integration-distribution-test-titanium 02:19:12 [ssh-agent] Looking for ssh-agent implementation... 02:19:13 [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) 02:19:13 $ ssh-agent 02:19:13 SSH_AUTH_SOCK=/tmp/ssh-O1yWwpyRYzhN/agent.9169 02:19:13 SSH_AGENT_PID=9170 02:19:13 [ssh-agent] Started. 02:19:13 Running ssh-add (command line suppressed) 02:19:13 Identity added: /w/workspace/integration-distribution-test-titanium@tmp/private_key_13169329116916378457.key (/w/workspace/integration-distribution-test-titanium@tmp/private_key_13169329116916378457.key) 02:19:13 [ssh-agent] Using credentials jenkins (jenkins-ssh) 02:19:13 No emails were triggered. 02:19:13 provisioning config files... 02:19:13 copy managed file [npmrc] to file:/home/jenkins/.npmrc 02:19:13 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 02:19:13 [integration-distribution-test-titanium] $ /bin/bash /tmp/jenkins16123295780747377878.sh 02:19:13 ---> python-tools-install.sh 02:19:13 Setup pyenv: 02:19:13 system 02:19:13 * 3.8.13 (set by /opt/pyenv/version) 02:19:13 * 3.9.13 (set by /opt/pyenv/version) 02:19:13 3.10.13 02:19:18 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-lOlV 02:19:18 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 02:19:24 lf-activate-venv(): INFO: Installing: lftools 02:19:57 lf-activate-venv(): INFO: Adding /tmp/venv-lOlV/bin to PATH 02:19:57 Generating Requirements File 02:20:23 Python 3.10.13 02:20:24 pip 24.2 from /tmp/venv-lOlV/lib/python3.10/site-packages/pip (python 3.10) 02:20:24 appdirs==1.4.4 02:20:24 argcomplete==3.5.0 02:20:24 aspy.yaml==1.3.0 02:20:24 attrs==24.2.0 02:20:24 autopage==0.5.2 02:20:24 beautifulsoup4==4.12.3 02:20:24 boto3==1.35.25 02:20:24 botocore==1.35.25 02:20:24 bs4==0.0.2 02:20:24 cachetools==5.5.0 02:20:24 certifi==2024.8.30 02:20:24 cffi==1.17.1 02:20:24 cfgv==3.4.0 02:20:24 chardet==5.2.0 02:20:24 charset-normalizer==3.3.2 02:20:24 click==8.1.7 02:20:24 cliff==4.7.0 02:20:24 cmd2==2.4.3 02:20:24 cryptography==3.3.2 02:20:24 debtcollector==3.0.0 02:20:24 decorator==5.1.1 02:20:24 defusedxml==0.7.1 02:20:24 Deprecated==1.2.14 02:20:24 distlib==0.3.8 02:20:24 dnspython==2.6.1 02:20:24 docker==4.2.2 02:20:24 dogpile.cache==1.3.3 02:20:24 durationpy==0.7 02:20:24 email_validator==2.2.0 02:20:24 filelock==3.16.1 02:20:24 future==1.0.0 02:20:24 gitdb==4.0.11 02:20:24 GitPython==3.1.43 02:20:24 google-auth==2.35.0 02:20:24 httplib2==0.22.0 02:20:24 identify==2.6.1 02:20:24 idna==3.10 02:20:24 importlib-resources==1.5.0 02:20:24 iso8601==2.1.0 02:20:24 Jinja2==3.1.4 02:20:24 jmespath==1.0.1 02:20:24 jsonpatch==1.33 02:20:24 jsonpointer==3.0.0 02:20:24 jsonschema==4.23.0 02:20:24 jsonschema-specifications==2023.12.1 02:20:24 keystoneauth1==5.8.0 02:20:24 kubernetes==31.0.0 02:20:24 lftools==0.37.10 02:20:24 lxml==5.3.0 02:20:24 MarkupSafe==2.1.5 02:20:24 msgpack==1.1.0 02:20:24 multi_key_dict==2.0.3 02:20:24 munch==4.0.0 02:20:24 netaddr==1.3.0 02:20:24 netifaces==0.11.0 02:20:24 niet==1.4.2 02:20:24 nodeenv==1.9.1 02:20:24 oauth2client==4.1.3 02:20:24 oauthlib==3.2.2 02:20:24 openstacksdk==4.0.0 02:20:24 os-client-config==2.1.0 02:20:24 os-service-types==1.7.0 02:20:24 osc-lib==3.1.0 02:20:24 oslo.config==9.6.0 02:20:24 oslo.context==5.6.0 02:20:24 oslo.i18n==6.4.0 02:20:24 oslo.log==6.1.2 02:20:24 oslo.serialization==5.5.0 02:20:24 oslo.utils==7.3.0 02:20:24 packaging==24.1 02:20:24 pbr==6.1.0 02:20:24 platformdirs==4.3.6 02:20:24 prettytable==3.11.0 02:20:24 pyasn1==0.6.1 02:20:24 pyasn1_modules==0.4.1 02:20:24 pycparser==2.22 02:20:24 pygerrit2==2.0.15 02:20:24 PyGithub==2.4.0 02:20:24 PyJWT==2.9.0 02:20:24 PyNaCl==1.5.0 02:20:24 pyparsing==2.4.7 02:20:24 pyperclip==1.9.0 02:20:24 pyrsistent==0.20.0 02:20:24 python-cinderclient==9.6.0 02:20:24 python-dateutil==2.9.0.post0 02:20:24 python-heatclient==4.0.0 02:20:24 python-jenkins==1.8.2 02:20:24 python-keystoneclient==5.5.0 02:20:24 python-magnumclient==4.7.0 02:20:24 python-openstackclient==7.1.2 02:20:24 python-swiftclient==4.6.0 02:20:24 PyYAML==6.0.2 02:20:24 referencing==0.35.1 02:20:24 requests==2.32.3 02:20:24 requests-oauthlib==2.0.0 02:20:24 requestsexceptions==1.4.0 02:20:24 rfc3986==2.0.0 02:20:24 rpds-py==0.20.0 02:20:24 rsa==4.9 02:20:24 ruamel.yaml==0.18.6 02:20:24 ruamel.yaml.clib==0.2.8 02:20:24 s3transfer==0.10.2 02:20:24 simplejson==3.19.3 02:20:24 six==1.16.0 02:20:24 smmap==5.0.1 02:20:24 soupsieve==2.6 02:20:24 stevedore==5.3.0 02:20:24 tabulate==0.9.0 02:20:24 toml==0.10.2 02:20:24 tomlkit==0.13.2 02:20:24 tqdm==4.66.5 02:20:24 typing_extensions==4.12.2 02:20:24 tzdata==2024.2 02:20:24 urllib3==1.26.20 02:20:24 virtualenv==20.26.5 02:20:24 wcwidth==0.2.13 02:20:24 websocket-client==1.8.0 02:20:24 wrapt==1.16.0 02:20:24 xdg==6.0.0 02:20:24 xmltodict==0.13.0 02:20:24 yq==3.4.3 02:20:24 $ ssh-agent -k 02:20:24 unset SSH_AUTH_SOCK; 02:20:24 unset SSH_AGENT_PID; 02:20:24 echo Agent pid 9170 killed; 02:20:24 [ssh-agent] Stopped. 02:20:24 ERROR: Build aborted. Can't trigger undefined projects. 1 of the below project(s) can't be resolved: 02:20:24 > distribution-csit-managed-titanium 02:20:24 Check your configuration! 02:20:24 [PostBuildScript] - [INFO] Executing post build scripts. 02:20:24 [integration-distribution-test-titanium] $ /bin/sh /tmp/jenkins1826737043101526491.sh 02:20:44 python /tmp/tmp.RTQlocnpZ6 https://jenkins.opendaylight.org/releng/job/integration-distribution-test-titanium/29/ 02:20:44 [PostBuildScript] - [INFO] Executing post build scripts. 02:20:44 [integration-distribution-test-titanium] $ /bin/bash /tmp/jenkins6786741133587194664.sh 02:20:44 ---> sysstat.sh 02:20:45 [integration-distribution-test-titanium] $ /bin/bash /tmp/jenkins5910036976435749471.sh 02:20:45 ---> package-listing.sh 02:20:45 ++ facter osfamily 02:20:45 ++ tr '[:upper:]' '[:lower:]' 02:20:45 + OS_FAMILY=redhat 02:20:45 + workspace=/w/workspace/integration-distribution-test-titanium 02:20:45 + START_PACKAGES=/tmp/packages_start.txt 02:20:45 + END_PACKAGES=/tmp/packages_end.txt 02:20:45 + DIFF_PACKAGES=/tmp/packages_diff.txt 02:20:45 + PACKAGES=/tmp/packages_start.txt 02:20:45 + '[' /w/workspace/integration-distribution-test-titanium ']' 02:20:45 + PACKAGES=/tmp/packages_end.txt 02:20:45 + case "${OS_FAMILY}" in 02:20:45 + rpm -qa 02:20:45 + sort 02:20:46 + '[' -f /tmp/packages_start.txt ']' 02:20:46 + '[' -f /tmp/packages_end.txt ']' 02:20:46 + diff /tmp/packages_start.txt /tmp/packages_end.txt 02:20:46 + '[' /w/workspace/integration-distribution-test-titanium ']' 02:20:46 + mkdir -p /w/workspace/integration-distribution-test-titanium/archives/ 02:20:46 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/integration-distribution-test-titanium/archives/ 02:20:46 [integration-distribution-test-titanium] $ /bin/bash /tmp/jenkins10266542387437402494.sh 02:20:46 ---> capture-instance-metadata.sh 02:20:46 Setup pyenv: 02:20:46 system 02:20:46 3.8.13 02:20:46 3.9.13 02:20:46 * 3.10.13 (set by /w/workspace/integration-distribution-test-titanium/.python-version) 02:20:46 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-lOlV from file:/tmp/.os_lf_venv 02:20:47 lf-activate-venv(): INFO: Installing: lftools 02:21:02 lf-activate-venv(): INFO: Adding /tmp/venv-lOlV/bin to PATH 02:21:02 INFO: Running in OpenStack, capturing instance metadata 02:21:03 [integration-distribution-test-titanium] $ /bin/bash /tmp/jenkins8000615272922181551.sh 02:21:03 provisioning config files... 02:21:03 Could not find credentials [logs] for integration-distribution-test-titanium #29 02:21:03 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/integration-distribution-test-titanium@tmp/config1886052807139818769tmp 02:21:03 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] 02:21:03 Run condition [Regular expression match] enabling perform for step [Provide Configuration files] 02:21:03 provisioning config files... 02:21:03 copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials 02:21:03 [EnvInject] - Injecting environment variables from a build step. 02:21:03 [EnvInject] - Injecting as environment variables the properties content 02:21:03 SERVER_ID=logs 02:21:03 02:21:03 [EnvInject] - Variables injected successfully. 02:21:04 [integration-distribution-test-titanium] $ /bin/bash /tmp/jenkins14116151094631875527.sh 02:21:04 ---> create-netrc.sh 02:21:04 WARN: Log server credential not found. 02:21:04 [integration-distribution-test-titanium] $ /bin/bash /tmp/jenkins4644423820201939456.sh 02:21:04 ---> python-tools-install.sh 02:21:04 Setup pyenv: 02:21:04 system 02:21:04 3.8.13 02:21:04 3.9.13 02:21:04 * 3.10.13 (set by /w/workspace/integration-distribution-test-titanium/.python-version) 02:21:04 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-lOlV from file:/tmp/.os_lf_venv 02:21:05 lf-activate-venv(): INFO: Installing: lftools 02:21:16 lf-activate-venv(): INFO: Adding /tmp/venv-lOlV/bin to PATH 02:21:16 [integration-distribution-test-titanium] $ /bin/bash /tmp/jenkins8606662990531246382.sh 02:21:16 ---> sudo-logs.sh 02:21:16 Archiving 'sudo' log.. 02:21:17 [integration-distribution-test-titanium] $ /bin/bash /tmp/jenkins4264007688058622015.sh 02:21:17 ---> job-cost.sh 02:21:17 Setup pyenv: 02:21:17 system 02:21:17 3.8.13 02:21:17 3.9.13 02:21:17 * 3.10.13 (set by /w/workspace/integration-distribution-test-titanium/.python-version) 02:21:17 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-lOlV from file:/tmp/.os_lf_venv 02:21:18 lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 02:21:24 lf-activate-venv(): INFO: Adding /tmp/venv-lOlV/bin to PATH 02:21:24 INFO: No Stack... 02:21:24 INFO: Retrieving Pricing Info for: v3-standard-2 02:21:25 INFO: Archiving Costs 02:21:25 [integration-distribution-test-titanium] $ /bin/bash -l /tmp/jenkins10774876988369081230.sh 02:21:25 ---> logs-deploy.sh 02:21:25 Setup pyenv: 02:21:25 system 02:21:25 3.8.13 02:21:25 3.9.13 02:21:25 * 3.10.13 (set by /w/workspace/integration-distribution-test-titanium/.python-version) 02:21:25 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-lOlV from file:/tmp/.os_lf_venv 02:21:26 lf-activate-venv(): INFO: Installing: lftools 02:21:36 lf-activate-venv(): INFO: Adding /tmp/venv-lOlV/bin to PATH 02:21:36 WARNING: Nexus logging server not set 02:21:36 INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/integration-distribution-test-titanium/29/ 02:21:36 INFO: archiving logs to S3 02:21:37 ---> uname -a: 02:21:37 Linux prd-queue-disttest-2c-1g-26764.novalocal 3.10.0-1160.118.1.el7.x86_64 #1 SMP Wed Apr 24 16:01:50 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux 02:21:37 02:21:37 02:21:37 ---> lscpu: 02:21:37 Architecture: x86_64 02:21:37 CPU op-mode(s): 32-bit, 64-bit 02:21:37 Byte Order: Little Endian 02:21:37 CPU(s): 2 02:21:37 On-line CPU(s) list: 0,1 02:21:37 Thread(s) per core: 1 02:21:37 Core(s) per socket: 1 02:21:37 Socket(s): 2 02:21:37 NUMA node(s): 1 02:21:37 Vendor ID: AuthenticAMD 02:21:37 CPU family: 23 02:21:37 Model: 49 02:21:37 Model name: AMD EPYC-Rome Processor 02:21:37 Stepping: 0 02:21:37 CPU MHz: 2799.998 02:21:37 BogoMIPS: 5599.99 02:21:37 Virtualization: AMD-V 02:21:37 Hypervisor vendor: KVM 02:21:37 Virtualization type: full 02:21:37 L1d cache: 32K 02:21:37 L1i cache: 32K 02:21:37 L2 cache: 512K 02:21:37 L3 cache: 16384K 02:21:37 NUMA node0 CPU(s): 0,1 02:21:37 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm art rep_good nopl extd_apicid eagerfpu pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd rsb_ctxsw ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 clzero xsaveerptr arat npt nrip_save umip spec_ctrl intel_stibp arch_capabilities 02:21:37 02:21:37 02:21:37 ---> nproc: 02:21:37 2 02:21:37 02:21:37 02:21:37 ---> df -h: 02:21:37 Filesystem Size Used Avail Use% Mounted on 02:21:37 devtmpfs 3.8G 0 3.8G 0% /dev 02:21:37 tmpfs 3.9G 0 3.9G 0% /dev/shm 02:21:37 tmpfs 3.9G 17M 3.9G 1% /run 02:21:37 tmpfs 3.9G 0 3.9G 0% /sys/fs/cgroup 02:21:37 /dev/vda1 40G 5.8G 35G 15% / 02:21:37 tmpfs 783M 0 783M 0% /run/user/1001 02:21:37 02:21:37 02:21:37 ---> free -m: 02:21:37 total used free shared buff/cache available 02:21:37 Mem: 7821 489 5440 16 1890 7044 02:21:37 Swap: 1023 0 1023 02:21:37 02:21:37 02:21:37 ---> ip addr: 02:21:37 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 02:21:37 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 02:21:37 inet 127.0.0.1/8 scope host lo 02:21:37 valid_lft forever preferred_lft forever 02:21:37 inet6 ::1/128 scope host 02:21:37 valid_lft forever preferred_lft forever 02:21:37 2: eth0: mtu 1458 qdisc mq state UP group default qlen 1000 02:21:37 link/ether fa:16:3e:ec:85:9b brd ff:ff:ff:ff:ff:ff 02:21:37 inet 10.30.170.205/23 brd 10.30.171.255 scope global dynamic eth0 02:21:37 valid_lft 86219sec preferred_lft 86219sec 02:21:37 inet6 fe80::f816:3eff:feec:859b/64 scope link 02:21:37 valid_lft forever preferred_lft forever 02:21:37 02:21:37 02:21:37 ---> sar -b -r -n DEV: 02:21:37 Linux 3.10.0-1160.118.1.el7.x86_64 (centos-7-robot-05cc0f9b-716b-4844-b983-0ce161c05ab8.novalocal) 09/24/2024 _x86_64_ (2 CPU) 02:21:37 02:21:37 02:18:30 AM LINUX RESTART 02:21:37 02:21:37 02:19:04 AM tps rtps wtps bread/s bwrtn/s 02:21:37 02:20:01 AM 113.53 25.89 87.64 5259.39 7267.38 02:21:37 02:21:01 AM 306.89 14.32 292.57 577.79 9361.62 02:21:37 Average: 212.69 19.96 192.73 2858.62 8341.32 02:21:37 02:21:37 02:19:04 AM kbmemfree kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 02:21:37 02:20:01 AM 5770524 2238212 27.95 2620 1708988 582476 6.43 432616 1525652 120900 02:21:37 02:21:01 AM 5569408 2439328 30.46 2620 1818836 642532 7.09 661416 1465560 42288 02:21:37 Average: 5669966 2338770 29.20 2620 1763912 612504 6.76 547016 1495606 81594 02:21:37 02:21:37 02:19:04 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s 02:21:37 02:20:01 AM eth0 242.30 160.61 1171.92 28.32 0.00 0.00 0.00 02:21:37 02:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:21:37 02:21:01 AM eth0 61.92 56.07 527.49 8.22 0.00 0.00 0.00 02:21:37 02:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:21:37 Average: eth0 149.80 107.00 841.45 18.01 0.00 0.00 0.00 02:21:37 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:21:37 02:21:37 02:21:37 ---> sar -P ALL: 02:21:37 Linux 3.10.0-1160.118.1.el7.x86_64 (centos-7-robot-05cc0f9b-716b-4844-b983-0ce161c05ab8.novalocal) 09/24/2024 _x86_64_ (2 CPU) 02:21:37 02:21:37 02:18:30 AM LINUX RESTART 02:21:37 02:21:37 02:19:04 AM CPU %user %nice %system %iowait %steal %idle 02:21:37 02:20:01 AM all 38.12 0.00 5.42 3.71 0.10 52.65 02:21:37 02:20:01 AM 0 28.22 0.00 4.80 3.47 0.09 63.42 02:21:37 02:20:01 AM 1 48.28 0.00 6.03 3.95 0.11 41.63 02:21:37 02:21:01 AM all 31.35 0.00 2.62 9.97 0.10 55.96 02:21:37 02:21:01 AM 0 16.66 0.00 1.73 8.26 0.12 73.23 02:21:37 02:21:01 AM 1 46.50 0.00 3.55 11.73 0.11 38.11 02:21:37 Average: all 34.63 0.00 3.98 6.93 0.10 54.36 02:21:37 Average: 0 22.25 0.00 3.21 5.94 0.11 68.49 02:21:37 Average: 1 47.36 0.00 4.75 7.95 0.11 39.82 02:21:37 02:21:37 02:21:37