Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on prd-centos7-helm-4c-4g-4511 (centos7-helm-4c-4g) in workspace /w/workspace/packaging-k8s-odl-deploy-test [ssh-agent] Looking for ssh-agent implementation... [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) $ ssh-agent SSH_AUTH_SOCK=/tmp/ssh-AbqC14tH0Y5h/agent.8371 SSH_AGENT_PID=8373 [ssh-agent] Started. Running ssh-add (command line suppressed) Identity added: /w/workspace/packaging-k8s-odl-deploy-test@tmp/private_key_18259151105587759901.key (/w/workspace/packaging-k8s-odl-deploy-test@tmp/private_key_18259151105587759901.key) [ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key) Running ssh-add (command line suppressed) Identity added: /w/workspace/packaging-k8s-odl-deploy-test@tmp/private_key_2917916441532254391.key (/w/workspace/packaging-k8s-odl-deploy-test@tmp/private_key_2917916441532254391.key) [ssh-agent] Using credentials jenkins (jenkins-ssh) The recommended git tool is: NONE using credential opendaylight-jenkins-ssh Wiping out workspace first. Cloning the remote Git repository Cloning repository git://devvexx.opendaylight.org/mirror/integration/packaging > git init /w/workspace/packaging-k8s-odl-deploy-test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/packaging > git --version # timeout=10 > git --version # 'git version 2.36.5' using GIT_SSH to set credentials Release Engineering Jenkins Key [INFO] Currently running in a labeled security context [INFO] Currently SELinux is 'enforcing' on the host > /usr/bin/chcon --type=ssh_home_t /w/workspace/packaging-k8s-odl-deploy-test@tmp/jenkins-gitclient-ssh12511020360825957003.key Verifying host key using known hosts file You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/packaging +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/packaging # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 Avoid second fetch > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision 8da973357171313c0de8a2096601139fa0702c58 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 8da973357171313c0de8a2096601139fa0702c58 # timeout=10 Commit message: "Helm charts for supporting clustering in ODL" > git rev-list --no-walk 8da973357171313c0de8a2096601139fa0702c58 # timeout=10 provisioning config files... copy managed file [npmrc] to file:/home/jenkins/.npmrc copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf [packaging-k8s-odl-deploy-test] $ /bin/bash /tmp/jenkins7867161481497482458.sh ---> python-tools-install.sh Setup pyenv: system * 3.8.13 (set by /opt/pyenv/version) * 3.9.13 (set by /opt/pyenv/version) lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-QdyA lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-QdyA/bin to PATH Generating Requirements File ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. lftools 0.37.9 requires openstacksdk>=2.1.0, but you have openstacksdk 0.62.0 which is incompatible. Python 3.9.13 pip 24.0 from /tmp/venv-QdyA/lib/python3.9/site-packages/pip (python 3.9) appdirs==1.4.4 argcomplete==3.2.3 aspy.yaml==1.3.0 attrs==23.2.0 autopage==0.5.2 beautifulsoup4==4.12.3 boto3==1.34.58 botocore==1.34.58 bs4==0.0.2 cachetools==5.3.3 certifi==2024.2.2 cffi==1.16.0 cfgv==3.4.0 chardet==5.2.0 charset-normalizer==3.3.2 click==8.1.7 cliff==4.6.0 cmd2==2.4.3 cryptography==3.3.2 debtcollector==3.0.0 decorator==5.1.1 defusedxml==0.7.1 Deprecated==1.2.14 distlib==0.3.8 dnspython==2.6.1 docker==4.2.2 dogpile.cache==1.3.2 email_validator==2.1.1 filelock==3.13.1 future==1.0.0 gitdb==4.0.11 GitPython==3.1.42 google-auth==2.28.1 httplib2==0.22.0 identify==2.5.35 idna==3.6 importlib-resources==1.5.0 importlib_metadata==7.0.2 iso8601==2.1.0 Jinja2==3.1.3 jmespath==1.0.1 jsonpatch==1.33 jsonpointer==2.4 jsonschema==4.21.1 jsonschema-specifications==2023.12.1 keystoneauth1==5.6.0 kubernetes==29.0.0 lftools==0.37.9 lxml==5.1.0 MarkupSafe==2.1.5 msgpack==1.0.8 multi_key_dict==2.0.3 munch==4.0.0 netaddr==1.2.1 netifaces==0.11.0 niet==1.4.2 nodeenv==1.8.0 oauth2client==4.1.3 oauthlib==3.2.2 openstacksdk==0.62.0 os-client-config==2.1.0 os-service-types==1.7.0 osc-lib==3.0.1 oslo.config==9.4.0 oslo.context==5.5.0 oslo.i18n==6.3.0 oslo.log==5.5.0 oslo.serialization==5.4.0 oslo.utils==7.1.0 packaging==23.2 pbr==6.0.0 platformdirs==4.2.0 prettytable==3.10.0 pyasn1==0.5.1 pyasn1-modules==0.3.0 pycparser==2.21 pygerrit2==2.0.15 PyGithub==2.2.0 pyinotify==0.9.6 PyJWT==2.8.0 PyNaCl==1.5.0 pyparsing==2.4.7 pyperclip==1.8.2 pyrsistent==0.20.0 python-cinderclient==9.5.0 python-dateutil==2.9.0.post0 python-heatclient==3.5.0 python-jenkins==1.8.2 python-keystoneclient==5.4.0 python-magnumclient==4.4.0 python-novaclient==18.5.0 python-openstackclient==6.0.1 python-swiftclient==4.5.0 PyYAML==6.0.1 referencing==0.33.0 requests==2.31.0 requests-oauthlib==1.3.1 requestsexceptions==1.4.0 rfc3986==2.0.0 rpds-py==0.18.0 rsa==4.9 ruamel.yaml==0.18.6 ruamel.yaml.clib==0.2.8 s3transfer==0.10.0 simplejson==3.19.2 six==1.16.0 smmap==5.0.1 soupsieve==2.5 stevedore==5.2.0 tabulate==0.9.0 toml==0.10.2 tomlkit==0.12.4 tqdm==4.66.2 typing_extensions==4.10.0 tzdata==2024.1 urllib3==1.26.18 virtualenv==20.25.1 wcwidth==0.2.13 websocket-client==1.7.0 wrapt==1.16.0 xdg==6.0.0 xmltodict==0.13.0 yq==3.2.3 zipp==3.17.0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content CLUSTER_NAME=releng-packaging-k8s-odl-deploy-test-128 MASTER_LB_FLOATING_IP_ENABLED=false KEYPAIR={'keypair': None} BOOT_VOLUME_SIZE=40 OS_CLOUD=vex KUBE_TAG=v1.21.1 CLOUD_PROVIDER_TAG=v1.18.0 K8S_VERSION=v1.16.0 CLUSTER_TEMPLATE_NAME=k8s-1.21.1 MASTER_COUNT=1 HELM_SHA256=6cd6cad4b97e10c33c978ff3ac97bb42b68f79766f1d2284cfd62ec04cd177f4 CLUSTER_SETTLE_TIME=1m HELM_VERSION=v3.7.1 NODE_COUNT=2 NODE_FLAVOR=v3-standard-8 MASTER_FLAVOR=v3-standard-8 CONTAINER_INFRA_PREFIX=registry.public.yul1.vexxhost.net/magnum/ ETCD_VOLUME_SIZE=20 HELM_CLIENT_URL=https://get.helm.sh/helm-v3.7.1-linux-amd64.tar.gz [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [packaging-k8s-odl-deploy-test] $ /bin/bash -l /tmp/jenkins17454930869219533268.sh ---> Create K8S cluster with pre-existing template + . /home/jenkins/lf-env.sh + lf-activate-venv --python python3 python-heatclient python-openstackclient urllib3~=1.26.15 yq ++ mktemp -d /tmp/venv-XXXX + lf_venv=/tmp/venv-H0CE + local venv_file=/tmp/.os_lf_venv + local python=python3 + local options + local set_path=true + local install_args= ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 python-heatclient python-openstackclient urllib3~=1.26.15 yq + options=' --python '\''python3'\'' -- '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''urllib3~=1.26.15'\'' '\''yq'\''' + eval set -- ' --python '\''python3'\'' -- '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''urllib3~=1.26.15'\'' '\''yq'\''' ++ set -- --python python3 -- python-heatclient python-openstackclient urllib3~=1.26.15 yq + true + case $1 in + python=python3 + shift 2 + true + case $1 in + shift + break + case $python in + local pkg_list= + [[ -d /opt/pyenv ]] + echo 'Setup pyenv:' Setup pyenv: + export PYENV_ROOT=/opt/pyenv + PYENV_ROOT=/opt/pyenv + export PATH=/opt/pyenv/bin:/usr/local/bin:/usr/bin:/opt/puppetlabs/bin:/usr/local/sbin:/usr/sbin:/home/jenkins/.local/bin:/home/jenkins/bin + PATH=/opt/pyenv/bin:/usr/local/bin:/usr/bin:/opt/puppetlabs/bin:/usr/local/sbin:/usr/sbin:/home/jenkins/.local/bin:/home/jenkins/bin + pyenv versions system 3.8.13 * 3.9.13 (set by /w/workspace/packaging-k8s-odl-deploy-test/.python-version) + command -v pyenv ++ pyenv init - --no-rehash + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "'\''/opt/pyenv/shims'\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; fi; done; echo "${paths[*]}"'\'')" export PATH="/opt/pyenv/shims:${PATH}" export PYENV_SHELL=bash source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\'' pyenv() { local command command="${1:-}" if [ "$#" -gt 0 ]; then shift fi case "$command" in rehash|shell) eval "$(pyenv "sh-$command" "$@")" ;; *) command pyenv "$command" "$@" ;; esac }' +++ bash --norc -ec 'IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; fi; done; echo "${paths[*]}"' ++ PATH=/opt/pyenv/bin:/usr/local/bin:/usr/bin:/opt/puppetlabs/bin:/usr/local/sbin:/usr/sbin:/home/jenkins/.local/bin:/home/jenkins/bin ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/usr/local/bin:/usr/bin:/opt/puppetlabs/bin:/usr/local/sbin:/usr/sbin:/home/jenkins/.local/bin:/home/jenkins/bin ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/usr/local/bin:/usr/bin:/opt/puppetlabs/bin:/usr/local/sbin:/usr/sbin:/home/jenkins/.local/bin:/home/jenkins/bin ++ export PYENV_SHELL=bash ++ PYENV_SHELL=bash ++ source /opt/pyenv/libexec/../completions/pyenv.bash +++ complete -F _pyenv pyenv ++ lf-pyver python3 ++ local py_version_xy=python3 ++ local py_version_xyz= ++ pyenv versions ++ sed 's/^[ *]* //' ++ awk '{ print $1 }' ++ local command ++ command=versions ++ '[' 1 -gt 0 ']' ++ shift ++ case "$command" in ++ grep -E '^[0-9.]*[0-9]$' ++ command pyenv versions ++ pyenv versions ++ [[ ! -s /tmp/.pyenv_versions ]] +++ sort -V +++ grep '^3' /tmp/.pyenv_versions +++ tail -n 1 ++ py_version_xyz=3.9.13 ++ [[ -z 3.9.13 ]] ++ echo 3.9.13 ++ return 0 + pyenv local 3.9.13 + local command + command=local + '[' 2 -gt 0 ']' + shift + case "$command" in + command pyenv local 3.9.13 + pyenv local 3.9.13 + for arg in '"$@"' + case $arg in + pkg_list+='python-heatclient ' + for arg in '"$@"' + case $arg in + pkg_list+='python-openstackclient ' + for arg in '"$@"' + case $arg in + pkg_list+='urllib3~=1.26.15 ' + for arg in '"$@"' + case $arg in + pkg_list+='yq ' + [[ -f /tmp/.os_lf_venv ]] ++ cat /tmp/.os_lf_venv + lf_venv=/tmp/venv-QdyA + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-QdyA from' file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Reuse venv:/tmp/venv-QdyA from file:/tmp/.os_lf_venv + /tmp/venv-QdyA/bin/python3 -m pip install --upgrade --quiet pip virtualenv + [[ -z python-heatclient python-openstackclient urllib3~=1.26.15 yq ]] + echo 'lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient urllib3~=1.26.15 yq ' lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient urllib3~=1.26.15 yq + /tmp/venv-QdyA/bin/python3 -m pip install --upgrade --quiet --upgrade-strategy eager python-heatclient python-openstackclient urllib3~=1.26.15 yq + type python3 + true + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-QdyA/bin to PATH' lf-activate-venv(): INFO: Adding /tmp/venv-QdyA/bin to PATH + PATH=/tmp/venv-QdyA/bin:/opt/pyenv/shims:/opt/pyenv/bin:/usr/local/bin:/usr/bin:/opt/puppetlabs/bin:/usr/local/sbin:/usr/sbin:/home/jenkins/.local/bin:/home/jenkins/bin + return 0 + OS_TIMEOUT=20 + CLUSTER_RETRIES=3 + CLUSTER_SUCCESSFUL=false + mkdir -p /w/workspace/packaging-k8s-odl-deploy-test/archives + boot_volume_size=40 + cluster_name=releng-packaging-k8s-odl-deploy-test-128 + cluster_settle_time=1m + cluster_template_name=k8s-1.21.1 + cloud_provider_tag=v1.18.0 + container_infra_prefix=registry.public.yul1.vexxhost.net/magnum/ + etcd_volume_size=20 + k8s_version=v1.16.0 + keypair=releng + kube_tag=v1.21.1 + helm_client_url=https://get.helm.sh/helm-v3.7.1-linux-amd64.tar.gz + helm_sha256=6cd6cad4b97e10c33c978ff3ac97bb42b68f79766f1d2284cfd62ec04cd177f4 + helm_version=v3.7.1 + master_count=1 + master_flavor=v3-standard-8 + master_lb_floating_ip_enabled=false + node_count=2 + node_flavor=v3-standard-8 + os_cloud=vex + echo 'INFO: Create a Cluster:releng-packaging-k8s-odl-deploy-test-128 for attempts:3.' INFO: Create a Cluster:releng-packaging-k8s-odl-deploy-test-128 for attempts:3. ++ seq 3 + for try in '$(seq $CLUSTER_RETRIES)' ++ openstack --os-cloud vex coe cluster create releng-packaging-k8s-odl-deploy-test-128 --cluster-template k8s-1.21.1 --keypair releng --master-count 1 --node-count 2 --master-flavor v3-standard-8 --flavor v3-standard-8 --labels boot_volume_size=40,container_infra_prefix=registry.public.yul1.vexxhost.net/magnum/,cloud_provider_tag=v1.18.0,helm_client_sha256=6cd6cad4b97e10c33c978ff3ac97bb42b68f79766f1d2284cfd62ec04cd177f4,helm_client_tag=v3.7.1,etcd_volume_size=20,kube_tag=v1.21.1,master_lb_floating_ip_enabled=false,helm_client_url=https://get.helm.sh/helm-v3.7.1-linux-amd64.tar.gz --floating-ip-disabled + cluster_status='Request to create cluster 54a885e0-c73a-4d82-8627-dda0b9aeaf6c accepted' + [[ -z Request to create cluster 54a885e0-c73a-4d82-8627-dda0b9aeaf6c accepted ]] + [[ Request to create cluster 54a885e0-c73a-4d82-8627-dda0b9aeaf6c accepted =~ .*accepted.* ]] ++ echo 'Request to create cluster 54a885e0-c73a-4d82-8627-dda0b9aeaf6c accepted' ++ awk '-F ' '{print $5}' + cluster_uuid=54a885e0-c73a-4d82-8627-dda0b9aeaf6c + echo 'INFO 1: Wait until 20 (in minutes) to rollout releng-packaging-k8s-odl-deploy-test-128.' INFO 1: Wait until 20 (in minutes) to rollout releng-packaging-k8s-odl-deploy-test-128. ++ seq 20 + for i in '$(seq $OS_TIMEOUT)' + sleep 90 ++ openstack --os-cloud vex coe cluster show 54a885e0-c73a-4d82-8627-dda0b9aeaf6c -c status -f value + CLUSTER_STATUS=CREATE_FAILED + echo '1: CREATE_FAILED' 1: CREATE_FAILED + case "${CLUSTER_STATUS}" in ++ openstack coe cluster show releng-packaging-k8s-odl-deploy-test-128 -f value -c health_status_reason + reason='{}' + echo 'ERROR: Failed to initialize infrastructure. Reason: {}' ERROR: Failed to initialize infrastructure. Reason: {} + openstack ceo cluster show releng-packaging-k8s-odl-deploy-test-128 openstack: 'ceo cluster show releng-packaging-k8s-odl-deploy-test-128' is not an openstack command. See 'openstack --help'. Did you mean one of these? coe ca rotate coe ca show coe ca sign coe cluster config coe cluster create coe cluster delete coe cluster list coe cluster resize coe cluster show coe cluster template create coe cluster template delete coe cluster template list coe cluster template show coe cluster template update coe cluster update coe cluster upgrade coe nodegroup create coe nodegroup delete coe nodegroup list coe nodegroup show coe nodegroup update coe quotas create coe quotas delete coe quotas list coe quotas show coe quotas update coe service list coe stats list Build step 'Execute shell' marked build as failure $ ssh-agent -k unset SSH_AUTH_SOCK; unset SSH_AGENT_PID; echo Agent pid 8373 killed; [ssh-agent] Stopped. [PostBuildScript] - [INFO] Executing post build scripts. [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content CLUSTER_NAME=releng-packaging-k8s-odl-deploy-test-128 OS_CLOUD=vex [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [packaging-k8s-odl-deploy-test] $ /bin/bash -l /tmp/jenkins2157134570831111792.sh ---> Delete K8S cluster + . /home/jenkins/lf-env.sh + lf-activate-venv --python python3 kubernetes python-heatclient python-openstackclient yq ++ mktemp -d /tmp/venv-XXXX + lf_venv=/tmp/venv-jXwN + local venv_file=/tmp/.os_lf_venv + local python=python3 + local options + local set_path=true + local install_args= ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 kubernetes python-heatclient python-openstackclient yq + options=' --python '\''python3'\'' -- '\''kubernetes'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''yq'\''' + eval set -- ' --python '\''python3'\'' -- '\''kubernetes'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''yq'\''' ++ set -- --python python3 -- kubernetes python-heatclient python-openstackclient yq + true + case $1 in + python=python3 + shift 2 + true + case $1 in + shift + break + case $python in + local pkg_list= + [[ -d /opt/pyenv ]] + echo 'Setup pyenv:' Setup pyenv: + export PYENV_ROOT=/opt/pyenv + PYENV_ROOT=/opt/pyenv + export PATH=/opt/pyenv/bin:/usr/local/bin:/usr/bin:/opt/puppetlabs/bin:/usr/local/sbin:/usr/sbin:/home/jenkins/.local/bin:/home/jenkins/bin + PATH=/opt/pyenv/bin:/usr/local/bin:/usr/bin:/opt/puppetlabs/bin:/usr/local/sbin:/usr/sbin:/home/jenkins/.local/bin:/home/jenkins/bin + pyenv versions system 3.8.13 * 3.9.13 (set by /w/workspace/packaging-k8s-odl-deploy-test/.python-version) + command -v pyenv ++ pyenv init - --no-rehash + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "'\''/opt/pyenv/shims'\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; fi; done; echo "${paths[*]}"'\'')" export PATH="/opt/pyenv/shims:${PATH}" export PYENV_SHELL=bash source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\'' pyenv() { local command command="${1:-}" if [ "$#" -gt 0 ]; then shift fi case "$command" in rehash|shell) eval "$(pyenv "sh-$command" "$@")" ;; *) command pyenv "$command" "$@" ;; esac }' +++ bash --norc -ec 'IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; fi; done; echo "${paths[*]}"' ++ PATH=/opt/pyenv/bin:/usr/local/bin:/usr/bin:/opt/puppetlabs/bin:/usr/local/sbin:/usr/sbin:/home/jenkins/.local/bin:/home/jenkins/bin ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/usr/local/bin:/usr/bin:/opt/puppetlabs/bin:/usr/local/sbin:/usr/sbin:/home/jenkins/.local/bin:/home/jenkins/bin ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/usr/local/bin:/usr/bin:/opt/puppetlabs/bin:/usr/local/sbin:/usr/sbin:/home/jenkins/.local/bin:/home/jenkins/bin ++ export PYENV_SHELL=bash ++ PYENV_SHELL=bash ++ source /opt/pyenv/libexec/../completions/pyenv.bash +++ complete -F _pyenv pyenv ++ lf-pyver python3 ++ local py_version_xy=python3 ++ local py_version_xyz= ++ pyenv versions ++ sed 's/^[ *]* //' ++ local command ++ command=versions ++ '[' 1 -gt 0 ']' ++ shift ++ case "$command" in ++ awk '{ print $1 }' ++ command pyenv versions ++ pyenv versions ++ grep -E '^[0-9.]*[0-9]$' ++ [[ ! -s /tmp/.pyenv_versions ]] +++ grep '^3' /tmp/.pyenv_versions +++ sort -V +++ tail -n 1 ++ py_version_xyz=3.9.13 ++ [[ -z 3.9.13 ]] ++ echo 3.9.13 ++ return 0 + pyenv local 3.9.13 + local command + command=local + '[' 2 -gt 0 ']' + shift + case "$command" in + command pyenv local 3.9.13 + pyenv local 3.9.13 + for arg in '"$@"' + case $arg in + pkg_list+='kubernetes ' + for arg in '"$@"' + case $arg in + pkg_list+='python-heatclient ' + for arg in '"$@"' + case $arg in + pkg_list+='python-openstackclient ' + for arg in '"$@"' + case $arg in + pkg_list+='yq ' + [[ -f /tmp/.os_lf_venv ]] ++ cat /tmp/.os_lf_venv + lf_venv=/tmp/venv-QdyA + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-QdyA from' file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Reuse venv:/tmp/venv-QdyA from file:/tmp/.os_lf_venv + /tmp/venv-QdyA/bin/python3 -m pip install --upgrade --quiet pip virtualenv + [[ -z kubernetes python-heatclient python-openstackclient yq ]] + echo 'lf-activate-venv(): INFO: Installing: kubernetes python-heatclient python-openstackclient yq ' lf-activate-venv(): INFO: Installing: kubernetes python-heatclient python-openstackclient yq + /tmp/venv-QdyA/bin/python3 -m pip install --upgrade --quiet --upgrade-strategy eager kubernetes python-heatclient python-openstackclient yq ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. botocore 1.34.58 requires urllib3<1.27,>=1.25.4; python_version < "3.10", but you have urllib3 2.2.1 which is incompatible. lftools 0.37.9 requires urllib3<2.0.0, but you have urllib3 2.2.1 which is incompatible. + type python3 + true + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-QdyA/bin to PATH' lf-activate-venv(): INFO: Adding /tmp/venv-QdyA/bin to PATH + PATH=/tmp/venv-QdyA/bin:/opt/pyenv/shims:/opt/pyenv/bin:/usr/local/bin:/usr/bin:/opt/puppetlabs/bin:/usr/local/sbin:/usr/sbin:/home/jenkins/.local/bin:/home/jenkins/bin + return 0 + os_cloud=vex + cluster_name=releng-packaging-k8s-odl-deploy-test-128 ++ openstack --os-cloud vex coe cluster delete releng-packaging-k8s-odl-deploy-test-128 Traceback (most recent call last): File "/tmp/venv-QdyA/bin/openstack", line 5, in from openstackclient.shell import main File "/tmp/venv-QdyA/lib/python3.9/site-packages/openstackclient/shell.py", line 22, in from osc_lib.api import auth File "/tmp/venv-QdyA/lib/python3.9/site-packages/osc_lib/api/auth.py", line 18, in from keystoneauth1.identity.v3 import k2k File "/tmp/venv-QdyA/lib/python3.9/site-packages/keystoneauth1/identity/__init__.py", line 14, in from keystoneauth1.identity import generic File "/tmp/venv-QdyA/lib/python3.9/site-packages/keystoneauth1/identity/generic/__init__.py", line 14, in from keystoneauth1.identity.generic.password import Password # noqa File "/tmp/venv-QdyA/lib/python3.9/site-packages/keystoneauth1/identity/generic/password.py", line 16, in from keystoneauth1.identity import v3 File "/tmp/venv-QdyA/lib/python3.9/site-packages/keystoneauth1/identity/v3/__init__.py", line 19, in from keystoneauth1.identity.v3.multi_factor import * # noqa File "/tmp/venv-QdyA/lib/python3.9/site-packages/keystoneauth1/identity/v3/multi_factor.py", line 14, in from keystoneauth1 import loading File "/tmp/venv-QdyA/lib/python3.9/site-packages/keystoneauth1/loading/__init__.py", line 15, in from keystoneauth1.loading import adapter File "/tmp/venv-QdyA/lib/python3.9/site-packages/keystoneauth1/loading/adapter.py", line 13, in from keystoneauth1 import adapter File "/tmp/venv-QdyA/lib/python3.9/site-packages/keystoneauth1/adapter.py", line 16, in import requests File "/tmp/venv-QdyA/lib/python3.9/site-packages/requests/__init__.py", line 43, in import urllib3 File "/tmp/venv-QdyA/lib/python3.9/site-packages/urllib3/__init__.py", line 42, in raise ImportError( ImportError: urllib3 v2 only supports OpenSSL 1.1.1+, currently the 'ssl' module is compiled with 'OpenSSL 1.0.2k-fips 26 Jan 2017'. See: https://github.com/urllib3/urllib3/issues/2168 + cluster_delete_status= Build step 'Execute scripts' marked build as failure [PostBuildScript] - [INFO] Executing post build scripts. [packaging-k8s-odl-deploy-test] $ /bin/bash /tmp/jenkins9315558520851717529.sh ---> sysstat.sh [packaging-k8s-odl-deploy-test] $ /bin/bash /tmp/jenkins4246905120475947260.sh ---> package-listing.sh ++ facter osfamily ++ tr '[:upper:]' '[:lower:]' + OS_FAMILY=redhat + workspace=/w/workspace/packaging-k8s-odl-deploy-test + START_PACKAGES=/tmp/packages_start.txt + END_PACKAGES=/tmp/packages_end.txt + DIFF_PACKAGES=/tmp/packages_diff.txt + PACKAGES=/tmp/packages_start.txt + '[' /w/workspace/packaging-k8s-odl-deploy-test ']' + PACKAGES=/tmp/packages_end.txt + case "${OS_FAMILY}" in + rpm -qa + sort + '[' -f /tmp/packages_start.txt ']' + '[' -f /tmp/packages_end.txt ']' + diff /tmp/packages_start.txt /tmp/packages_end.txt + '[' /w/workspace/packaging-k8s-odl-deploy-test ']' + mkdir -p /w/workspace/packaging-k8s-odl-deploy-test/archives/ + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/packaging-k8s-odl-deploy-test/archives/ [packaging-k8s-odl-deploy-test] $ /bin/bash /tmp/jenkins933601043413730503.sh ---> capture-instance-metadata.sh Setup pyenv: system 3.8.13 * 3.9.13 (set by /w/workspace/packaging-k8s-odl-deploy-test/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-QdyA from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-QdyA/bin to PATH INFO: Running in OpenStack, capturing instance metadata [packaging-k8s-odl-deploy-test] $ /bin/bash /tmp/jenkins2463526435537199955.sh provisioning config files... Could not find credentials [logs] for packaging-k8s-odl-deploy-test #128 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/packaging-k8s-odl-deploy-test@tmp/config15597739671677123160tmp Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] Run condition [Regular expression match] enabling perform for step [Provide Configuration files] provisioning config files... copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content SERVER_ID=logs [EnvInject] - Variables injected successfully. [packaging-k8s-odl-deploy-test] $ /bin/bash /tmp/jenkins8543987027668869008.sh ---> create-netrc.sh WARN: Log server credential not found. [packaging-k8s-odl-deploy-test] $ /bin/bash /tmp/jenkins12728483417332071108.sh ---> python-tools-install.sh Setup pyenv: system 3.8.13 * 3.9.13 (set by /w/workspace/packaging-k8s-odl-deploy-test/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-QdyA from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-QdyA/bin to PATH [packaging-k8s-odl-deploy-test] $ /bin/bash /tmp/jenkins15918083287575076521.sh ---> sudo-logs.sh Archiving 'sudo' log.. [packaging-k8s-odl-deploy-test] $ /bin/bash /tmp/jenkins6344614309775875987.sh ---> job-cost.sh Setup pyenv: system 3.8.13 * 3.9.13 (set by /w/workspace/packaging-k8s-odl-deploy-test/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-QdyA from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 lf-activate-venv(): INFO: Adding /tmp/venv-QdyA/bin to PATH INFO: No Stack... INFO: Retrieving Pricing Info for: v3-standard-4 INFO: Archiving Costs [packaging-k8s-odl-deploy-test] $ /bin/bash -l /tmp/jenkins1908904986184592367.sh ---> logs-deploy.sh Setup pyenv: system 3.8.13 * 3.9.13 (set by /w/workspace/packaging-k8s-odl-deploy-test/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-QdyA from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-QdyA/bin to PATH WARNING: Nexus logging server not set INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/packaging-k8s-odl-deploy-test/128/ INFO: archiving logs to S3 ---> uname -a: Linux prd-centos7-helm-4c-4g-4511.novalocal 3.10.0-1160.83.1.el7.x86_64 #1 SMP Wed Jan 25 16:41:43 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux ---> lscpu: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 4 On-line CPU(s) list: 0-3 Thread(s) per core: 1 Core(s) per socket: 1 Socket(s): 4 NUMA node(s): 1 Vendor ID: AuthenticAMD CPU family: 23 Model: 49 Model name: AMD EPYC-Rome Processor Stepping: 0 CPU MHz: 2800.000 BogoMIPS: 5600.00 Virtualization: AMD-V Hypervisor vendor: KVM Virtualization type: full L1d cache: 32K L1i cache: 32K L2 cache: 512K L3 cache: 16384K NUMA node0 CPU(s): 0-3 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm art rep_good nopl extd_apicid eagerfpu pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd rsb_ctxsw ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 clzero xsaveerptr arat npt nrip_save umip spec_ctrl intel_stibp arch_capabilities ---> nproc: 4 ---> df -h: Filesystem Size Used Avail Use% Mounted on devtmpfs 7.8G 0 7.8G 0% /dev tmpfs 7.8G 0 7.8G 0% /dev/shm tmpfs 7.8G 17M 7.8G 1% /run tmpfs 7.8G 0 7.8G 0% /sys/fs/cgroup /dev/vda1 80G 6.1G 74G 8% / tmpfs 1.6G 0 1.6G 0% /run/user/1001 ---> free -m: total used free shared buff/cache available Mem: 15884 751 13117 16 2016 14818 Swap: 1023 0 1023 ---> ip addr: 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: mtu 1458 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:6a:74:cf brd ff:ff:ff:ff:ff:ff inet 10.30.170.16/23 brd 10.30.171.255 scope global dynamic eth0 valid_lft 86114sec preferred_lft 86114sec inet6 fe80::f816:3eff:fe6a:74cf/64 scope link valid_lft forever preferred_lft forever 3: docker0: mtu 1500 qdisc noqueue state DOWN group default link/ether 02:42:fa:fa:54:6b brd ff:ff:ff:ff:ff:ff inet 10.250.0.254/24 brd 10.250.0.255 scope global docker0 valid_lft forever preferred_lft forever ---> sar -b -r -n DEV: Linux 3.10.0-1160.83.1.el7.x86_64 (centos-7-builder-63fe95dd-7c01-a815-2b88-3e049a6fc151.novalocal) 03/08/2024 _x86_64_ (4 CPU) 10:39:40 AM LINUX RESTART 10:40:01 AM tps rtps wtps bread/s bwrtn/s 10:41:02 AM 160.14 23.64 136.50 4504.73 40577.07 10:42:01 AM 218.26 0.46 217.80 20.59 7332.92 10:43:01 AM 133.68 0.00 133.68 0.00 3776.80 10:44:01 AM 14.91 1.65 13.26 214.79 302.73 Average: 131.39 6.46 124.93 1190.13 13023.13 10:40:01 AM kbmemfree kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 10:41:02 AM 13553424 2712544 16.68 2620 1858092 1065776 6.16 709176 1641976 144436 10:42:01 AM 13523828 2742140 16.86 2620 1951928 957024 5.53 631096 1707604 93700 10:43:01 AM 13518948 2747020 16.89 2620 1951936 957004 5.53 632176 1707608 4 10:44:01 AM 13513872 2752096 16.92 2620 1956496 956604 5.52 744348 1601236 6920 Average: 13527518 2738450 16.84 2620 1929613 984102 5.68 679199 1664606 61265 10:40:01 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s 10:41:02 AM eth0 338.53 229.92 1324.22 56.86 0.00 0.00 0.00 10:41:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:41:02 AM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:42:01 AM eth0 40.44 36.12 348.50 6.35 0.00 0.00 0.00 10:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:42:01 AM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:43:01 AM eth0 0.12 0.10 0.01 0.01 0.00 0.00 0.00 10:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:43:01 AM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:44:01 AM eth0 16.32 14.22 13.93 6.44 0.00 0.00 0.00 10:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:44:01 AM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 Average: eth0 99.11 70.25 422.04 17.46 0.00 0.00 0.00 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 Average: docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 ---> sar -P ALL: Linux 3.10.0-1160.83.1.el7.x86_64 (centos-7-builder-63fe95dd-7c01-a815-2b88-3e049a6fc151.novalocal) 03/08/2024 _x86_64_ (4 CPU) 10:39:40 AM LINUX RESTART 10:40:01 AM CPU %user %nice %system %iowait %steal %idle 10:41:02 AM all 16.89 0.00 3.01 7.57 0.07 72.46 10:41:02 AM 0 19.29 0.00 3.46 12.82 0.07 64.37 10:41:02 AM 1 13.29 0.00 2.58 8.93 0.07 75.13 10:41:02 AM 2 18.98 0.00 3.11 1.50 0.09 76.32 10:41:02 AM 3 16.03 0.00 2.88 7.05 0.07 73.97 10:42:01 AM all 15.19 0.00 1.35 1.40 0.05 82.01 10:42:01 AM 0 5.17 0.00 0.61 0.00 0.03 94.18 10:42:01 AM 1 4.66 0.00 0.62 0.58 0.07 94.08 10:42:01 AM 2 15.71 0.00 2.06 2.25 0.05 79.92 10:42:01 AM 3 35.98 0.00 2.18 2.80 0.07 58.97 10:43:01 AM all 0.06 0.00 0.08 0.73 0.02 99.12 10:43:01 AM 0 0.02 0.00 0.08 0.48 0.00 99.42 10:43:01 AM 1 0.20 0.00 0.07 0.27 0.03 99.43 10:43:01 AM 2 0.02 0.00 0.12 1.65 0.02 98.20 10:43:01 AM 3 0.02 0.00 0.05 0.50 0.02 99.42 10:44:01 AM all 8.26 0.00 0.48 0.06 0.03 91.17 10:44:01 AM 0 2.36 0.00 0.37 0.00 0.03 97.24 10:44:01 AM 1 1.88 0.00 0.32 0.12 0.05 97.63 10:44:01 AM 2 3.37 0.00 0.45 0.00 0.00 96.18 10:44:01 AM 3 25.88 0.00 0.77 0.12 0.05 73.17 Average: all 10.01 0.00 1.22 2.42 0.04 86.31 Average: 0 6.62 0.00 1.12 3.27 0.03 88.95 Average: 1 4.97 0.00 0.89 2.45 0.06 91.63 Average: 2 9.39 0.00 1.42 1.34 0.04 87.81 Average: 3 19.20 0.00 1.46 2.61 0.05 76.69