Started by upstream project "builder-packer-merge-centos-7-devstack" build number 120 originally caused by: Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on prd-centos8-builder-2c-1g-17244 (centos8-builder-2c-1g) in workspace /w/workspace/builder-openstack-update-cloud-image [ssh-agent] Looking for ssh-agent implementation... [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) $ ssh-agent SSH_AUTH_SOCK=/tmp/ssh-uA5IKtfZHFNS/agent.5445 SSH_AGENT_PID=5446 [ssh-agent] Started. Running ssh-add (command line suppressed) Identity added: /w/workspace/builder-openstack-update-cloud-image@tmp/private_key_3136583347835521078.key (/w/workspace/builder-openstack-update-cloud-image@tmp/private_key_3136583347835521078.key) [ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key) The recommended git tool is: NONE using credential opendaylight-jenkins-ssh Wiping out workspace first. Cloning the remote Git repository Cloning repository git://devvexx.opendaylight.org/mirror/releng/builder > git init /w/workspace/builder-openstack-update-cloud-image # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/releng/builder > git --version # timeout=10 > git --version # 'git version 2.43.0' using GIT_SSH to set credentials Release Engineering Jenkins Key [INFO] Currently running in a labeled security context [INFO] Currently SELinux is 'enforcing' on the host > /usr/bin/chcon --type=ssh_home_t /w/workspace/builder-openstack-update-cloud-image@tmp/jenkins-gitclient-ssh9766536247428434487.key Verifying host key using known hosts file You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/releng/builder +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/releng/builder # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 Avoid second fetch > git rev-parse FETCH_HEAD^{commit} # timeout=10 Checking out Revision 6bf4f3ec4c29c6b9e213df211a77234ab98070f5 (refs/heads/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 6bf4f3ec4c29c6b9e213df211a77234ab98070f5 # timeout=10 Commit message: "Merge "Update cloud image CentOS7 builder x86_64"" > git rev-parse FETCH_HEAD^{commit} # timeout=10 > git rev-list --no-walk be598a9d8b1356cb37b30e7b81ed17abfa30f1fb # timeout=10 provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml copy managed file [npmrc] to file:/home/jenkins/.npmrc copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf [builder-openstack-update-cloud-image] $ /bin/bash /tmp/jenkins2019314796406230793.sh ---> python-tools-install.sh Setup pyenv: system * 3.8.13 (set by /opt/pyenv/version) * 3.9.13 (set by /opt/pyenv/version) * 3.10.13 (set by /opt/pyenv/version) * 3.11.7 (set by /opt/pyenv/version) lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-HqLA lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-HqLA/bin to PATH Generating Requirements File Python 3.11.7 pip 24.0 from /tmp/venv-HqLA/lib/python3.11/site-packages/pip (python 3.11) appdirs==1.4.4 argcomplete==3.3.0 aspy.yaml==1.3.0 attrs==23.2.0 autopage==0.5.2 beautifulsoup4==4.12.3 boto3==1.34.96 botocore==1.34.96 bs4==0.0.2 cachetools==5.3.3 certifi==2024.2.2 cffi==1.16.0 cfgv==3.4.0 chardet==5.2.0 charset-normalizer==3.3.2 click==8.1.7 cliff==4.6.0 cmd2==2.4.3 cryptography==3.3.2 debtcollector==3.0.0 decorator==5.1.1 defusedxml==0.7.1 Deprecated==1.2.14 distlib==0.3.8 dnspython==2.6.1 docker==4.2.2 dogpile.cache==1.3.2 email_validator==2.1.1 filelock==3.14.0 future==1.0.0 gitdb==4.0.11 GitPython==3.1.43 google-auth==2.29.0 httplib2==0.22.0 identify==2.5.36 idna==3.7 importlib-resources==1.5.0 iso8601==2.1.0 Jinja2==3.1.3 jmespath==1.0.1 jsonpatch==1.33 jsonpointer==2.4 jsonschema==4.22.0 jsonschema-specifications==2023.12.1 keystoneauth1==5.6.0 kubernetes==29.0.0 lftools==0.37.10 lxml==5.2.1 MarkupSafe==2.1.5 msgpack==1.0.8 multi_key_dict==2.0.3 munch==4.0.0 netaddr==1.2.1 netifaces==0.11.0 niet==1.4.2 nodeenv==1.8.0 oauth2client==4.1.3 oauthlib==3.2.2 openstacksdk==3.1.0 os-client-config==2.1.0 os-service-types==1.7.0 osc-lib==3.0.1 oslo.config==9.4.0 oslo.context==5.5.0 oslo.i18n==6.3.0 oslo.log==5.5.1 oslo.serialization==5.4.0 oslo.utils==7.1.0 packaging==24.0 pbr==6.0.0 platformdirs==4.2.1 prettytable==3.10.0 pyasn1==0.6.0 pyasn1_modules==0.4.0 pycparser==2.22 pygerrit2==2.0.15 PyGithub==2.3.0 pyinotify==0.9.6 PyJWT==2.8.0 PyNaCl==1.5.0 pyparsing==2.4.7 pyperclip==1.8.2 pyrsistent==0.20.0 python-cinderclient==9.5.0 python-dateutil==2.9.0.post0 python-heatclient==3.5.0 python-jenkins==1.8.2 python-keystoneclient==5.4.0 python-magnumclient==4.4.0 python-novaclient==18.6.0 python-openstackclient==6.6.0 python-swiftclient==4.5.0 PyYAML==6.0.1 referencing==0.35.1 requests==2.31.0 requests-oauthlib==2.0.0 requestsexceptions==1.4.0 rfc3986==2.0.0 rpds-py==0.18.0 rsa==4.9 ruamel.yaml==0.18.6 ruamel.yaml.clib==0.2.8 s3transfer==0.10.1 simplejson==3.19.2 six==1.16.0 smmap==5.0.1 soupsieve==2.5 stevedore==5.2.0 tabulate==0.9.0 toml==0.10.2 tomlkit==0.12.4 tqdm==4.66.2 typing_extensions==4.11.0 tzdata==2024.1 urllib3==1.26.18 virtualenv==20.26.1 wcwidth==0.2.13 websocket-client==1.8.0 wrapt==1.16.0 xdg==6.0.0 xmltodict==0.13.0 yq==3.4.3 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_CLOUD=vex [EnvInject] - Variables injected successfully. [builder-openstack-update-cloud-image] $ /bin/bash /tmp/jenkins10525711241341675653.sh Extract the image type for commit message IMAGE_TYPE=CentOS7 devstack x86_64 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'image-type.txt' [EnvInject] - Variables injected successfully. [builder-openstack-update-cloud-image] $ /bin/bash /tmp/jenkins14636631720718463721.sh ---> update-cloud-images.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/builder-openstack-update-cloud-image/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-HqLA from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: python-openstackclient ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. lftools 0.37.10 requires urllib3<2.1.0, but you have urllib3 2.2.1 which is incompatible. lf-activate-venv(): INFO: Adding /tmp/venv-HqLA/bin to PATH INFO: List of images in use on the source repository: ZZCI - CentOS 7 - builder - x86_64 - 20240501-060129.055 ZZCI - CentOS 7 - devstack-rocky - x86_64 - 20221101-000109.537 ZZCI - CentOS 7 - devstack-stein - x86_64 - 20221101-010107.368 ZZCI - CentOS 7 - devstack - x86_64 - 20240401-230144.262 ZZCI - CentOS 7 - docker - x86_64 - 20240401-220152.097 ZZCI - CentOS 7 - helm - x86_64 - 20230301-000133.034 ZZCI - CentOS 7 - robot - x86_64 - 20240401-220244.081 ZZCI - CentOS Stream 8 - builder - x86_64 - 20240401-160147.446 ZZCI - CentOS Stream 8 - robot - x86_64 - 20240501-010211.041 ZZCI - Ubuntu 18.04 - docker - x86_64 - 20240501-040132.905 ZZCI - Ubuntu 18.04 - helm - x86_64 - 20230301-140059.950 ZZCI - Ubuntu 18.04 - mininet-ovs-28 - x86_64 - 20230601-180106.003 ZZCI - Ubuntu 20.04 - docker - x86_64 - 20240401-160246.269 INFO: Image type does not match, continue ... INFO: Image type does not match, continue ... INFO: Image type does not match, continue ... INFO: Found image type match, compare timestamps. INFO: Update old image: ZZCI - CentOS 7 - devstack - x86_64 - 20240401-230144.262 with new image: ZZCI - CentOS 7 - devstack - x86_64 - 20240501-230129.155 HEAD detached at 6bf4f3ec4 Changes to be committed: (use "git restore --staged ..." to unstage) modified: jjb/defaults.yaml Untracked files: (use "git add ..." to include in what will be committed) .python-version archives/ image-type.txt [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content GERRIT_HOST=git.opendaylight.org PROJECT=releng/builder REVIEWERS_EMAIL=jenkins-releng@opendaylight.org GERRIT_COMMIT_MESSAGE=Update cloud image CentOS7 devstack x86_64 GERRIT_TOPIC=update-cloud-image GERRIT_USER=jenkins-releng [EnvInject] - Variables injected successfully. [builder-openstack-update-cloud-image] $ /bin/bash /tmp/jenkins6181228896815045709.sh ---> gerrit-push-patch.sh INFO: Staged for commit: jjb/defaults.yaml Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/builder-openstack-update-cloud-image/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-HqLA from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: git-review==2.3.1 lf-activate-venv(): INFO: Adding /tmp/venv-HqLA/bin to PATH Warning: Permanently added the RSA host key for IP address '[52.47.161.242]:29418' to the list of known hosts. NOTE: No gerrit review found [detached HEAD 1d9a4acc2] Update cloud image CentOS7 devstack x86_64 1 file changed, 2 insertions(+), 2 deletions(-) HEAD detached from 6bf4f3ec4 Untracked files: (use "git add ..." to include in what will be committed) .python-version archives/ image-type.txt nothing added to commit but untracked files present (use "git add" to track) Your change was committed before the commit hook was installed. Amending the commit to add a gerrit change id. Warning: Permanently added the RSA host key for IP address '[13.39.230.180]:29418' to the list of known hosts. remote: remote: Processing changes: refs: 1, new: 1 remote: Processing changes: refs: 1, new: 1, done remote: remote: SUCCESS remote: remote: https://git.opendaylight.org/gerrit/c/releng/builder/+/111569 Update cloud image CentOS7 devstack x86_64 [NEW] remote: To ssh://git.opendaylight.org:29418/releng/builder.git * [new reference] HEAD -> refs/for/master%topic=update-cloud-image,r=jenkins-releng@opendaylight.org $ ssh-agent -k unset SSH_AUTH_SOCK; unset SSH_AGENT_PID; echo Agent pid 5446 killed; [ssh-agent] Stopped. [PostBuildScript] - [INFO] Executing post build scripts. [builder-openstack-update-cloud-image] $ /bin/bash /tmp/jenkins4401945716916895805.sh ---> sysstat.sh [builder-openstack-update-cloud-image] $ /bin/bash /tmp/jenkins239702718231423005.sh ---> package-listing.sh ++ facter osfamily ++ tr '[:upper:]' '[:lower:]' + OS_FAMILY=redhat + workspace=/w/workspace/builder-openstack-update-cloud-image + START_PACKAGES=/tmp/packages_start.txt + END_PACKAGES=/tmp/packages_end.txt + DIFF_PACKAGES=/tmp/packages_diff.txt + PACKAGES=/tmp/packages_start.txt + '[' /w/workspace/builder-openstack-update-cloud-image ']' + PACKAGES=/tmp/packages_end.txt + case "${OS_FAMILY}" in + rpm -qa + sort + '[' -f /tmp/packages_start.txt ']' + '[' -f /tmp/packages_end.txt ']' + diff /tmp/packages_start.txt /tmp/packages_end.txt + '[' /w/workspace/builder-openstack-update-cloud-image ']' + mkdir -p /w/workspace/builder-openstack-update-cloud-image/archives/ + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/builder-openstack-update-cloud-image/archives/ [builder-openstack-update-cloud-image] $ /bin/bash /tmp/jenkins16184902870727614268.sh ---> capture-instance-metadata.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/builder-openstack-update-cloud-image/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-HqLA from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-HqLA/bin to PATH INFO: Running in OpenStack, capturing instance metadata [builder-openstack-update-cloud-image] $ /bin/bash /tmp/jenkins10235691420279176912.sh provisioning config files... Could not find credentials [logs] for builder-openstack-update-cloud-image #636 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/builder-openstack-update-cloud-image@tmp/config14363663452758295069tmp Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] Run condition [Regular expression match] enabling perform for step [Provide Configuration files] provisioning config files... copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content SERVER_ID=logs [EnvInject] - Variables injected successfully. [builder-openstack-update-cloud-image] $ /bin/bash /tmp/jenkins16974500382177192917.sh ---> create-netrc.sh WARN: Log server credential not found. [builder-openstack-update-cloud-image] $ /bin/bash /tmp/jenkins15939663936267708499.sh ---> python-tools-install.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/builder-openstack-update-cloud-image/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-HqLA from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-HqLA/bin to PATH [builder-openstack-update-cloud-image] $ /bin/bash /tmp/jenkins2967972180481378177.sh ---> sudo-logs.sh Archiving 'sudo' log.. [builder-openstack-update-cloud-image] $ /bin/bash /tmp/jenkins5410645958007478719.sh ---> job-cost.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/builder-openstack-update-cloud-image/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-HqLA from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 lf-activate-venv(): INFO: Adding /tmp/venv-HqLA/bin to PATH INFO: No Stack... INFO: Retrieving Pricing Info for: v3-standard-2 INFO: Archiving Costs [builder-openstack-update-cloud-image] $ /bin/bash -l /tmp/jenkins5294994611251537341.sh ---> logs-deploy.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/builder-openstack-update-cloud-image/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-HqLA from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-HqLA/bin to PATH WARNING: Nexus logging server not set INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/builder-openstack-update-cloud-image/636/ INFO: archiving logs to S3 ---> uname -a: Linux prd-centos8-builder-2c-1g-17244.novalocal 4.18.0-547.el8.x86_64 #1 SMP Wed Mar 20 00:35:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux ---> lscpu: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 1 Socket(s): 2 NUMA node(s): 1 Vendor ID: AuthenticAMD CPU family: 23 Model: 49 Model name: AMD EPYC-Rome Processor Stepping: 0 CPU MHz: 2800.000 BogoMIPS: 5600.00 Virtualization: AMD-V Hypervisor vendor: KVM Virtualization type: full L1d cache: 32K L1i cache: 32K L2 cache: 512K L3 cache: 16384K NUMA node0 CPU(s): 0,1 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities ---> nproc: 2 ---> df -h: Filesystem Size Used Avail Use% Mounted on devtmpfs 3.8G 0 3.8G 0% /dev tmpfs 3.8G 0 3.8G 0% /dev/shm tmpfs 3.8G 17M 3.8G 1% /run tmpfs 3.8G 0 3.8G 0% /sys/fs/cgroup /dev/vda1 40G 8.3G 32G 21% / tmpfs 770M 0 770M 0% /run/user/1001 ---> free -m: total used free shared buff/cache available Mem: 7697 601 4877 19 2218 6802 Swap: 1023 0 1023 ---> ip addr: 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: mtu 1458 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:3a:09:c6 brd ff:ff:ff:ff:ff:ff altname enp0s3 altname ens3 inet 10.30.171.196/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0 valid_lft 86204sec preferred_lft 86204sec inet6 fe80::f816:3eff:fe3a:9c6/64 scope link valid_lft forever preferred_lft forever 3: docker0: mtu 1458 qdisc noqueue state DOWN group default link/ether 02:42:72:eb:92:0e brd ff:ff:ff:ff:ff:ff inet 10.250.0.254/24 brd 10.250.0.255 scope global docker0 valid_lft forever preferred_lft forever ---> sar -b -r -n DEV: Linux 4.18.0-547.el8.x86_64 (centos-stream-8-builder-140785a5-b754-4c0c-b31b-2b4ade92ecf9.nov) 05/01/2024 _x86_64_ (2 CPU) 23:31:20 LINUX RESTART (2 CPU) 11:32:01 PM tps rtps wtps bread/s bwrtn/s 11:33:01 PM 136.94 16.54 120.39 2877.71 5984.76 11:34:01 PM 87.69 0.22 87.47 46.66 9464.99 Average: 112.31 8.38 103.93 1462.30 7724.73 11:32:01 PM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 11:33:01 PM 5172684 7027508 2709752 34.38 2688 2038504 947288 10.61 220924 2170952 138132 11:34:01 PM 4998124 6965824 2884312 36.59 2688 2146020 986380 11.04 385004 2158312 17912 Average: 5085404 6996666 2797032 35.48 2688 2092262 966834 10.83 302964 2164632 78022 11:32:01 PM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 11:33:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 11:33:01 PM eth0 182.89 120.78 1252.19 45.51 0.00 0.00 0.00 0.00 11:33:01 PM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 11:34:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 11:34:01 PM eth0 33.29 28.23 207.19 9.80 0.00 0.00 0.00 0.00 11:34:01 PM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 Average: eth0 108.10 74.51 729.73 27.66 0.00 0.00 0.00 0.00 Average: docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 ---> sar -P ALL: Linux 4.18.0-547.el8.x86_64 (centos-stream-8-builder-140785a5-b754-4c0c-b31b-2b4ade92ecf9.nov) 05/01/2024 _x86_64_ (2 CPU) 23:31:20 LINUX RESTART (2 CPU) 11:32:01 PM CPU %user %nice %system %iowait %steal %idle 11:33:01 PM all 37.58 0.00 6.11 3.82 0.10 52.39 11:33:01 PM 0 35.74 0.00 6.43 5.38 0.10 52.35 11:33:01 PM 1 39.43 0.00 5.78 2.26 0.10 52.44 11:34:01 PM all 33.15 0.00 4.75 2.71 0.11 59.27 11:34:01 PM 0 30.18 0.00 4.79 2.81 0.10 62.12 11:34:01 PM 1 36.13 0.00 4.72 2.61 0.12 56.43 Average: all 35.37 0.00 5.43 3.26 0.10 55.83 Average: 0 32.97 0.00 5.61 4.10 0.10 57.23 Average: 1 37.78 0.00 5.25 2.43 0.11 54.43