10:32:22 Started by timer 10:32:22 Running as SYSTEM 10:32:22 [EnvInject] - Loading node environment variables. 10:32:22 Building remotely on prd-centos8-builder-2c-2g-30891 (centos8-builder-2c-2g) in workspace /w/workspace/builder-openstack-cron 10:32:22 [ssh-agent] Looking for ssh-agent implementation... 10:32:23 [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) 10:32:23 $ ssh-agent 10:32:23 SSH_AUTH_SOCK=/tmp/ssh-dATlmyCI22g8/agent.5476 10:32:23 SSH_AGENT_PID=5477 10:32:23 [ssh-agent] Started. 10:32:23 Running ssh-add (command line suppressed) 10:32:23 Identity added: /w/workspace/builder-openstack-cron@tmp/private_key_11092239934034855646.key (/w/workspace/builder-openstack-cron@tmp/private_key_11092239934034855646.key) 10:32:23 [ssh-agent] Using credentials jenkins (jenkins-ssh) 10:32:23 The recommended git tool is: NONE 10:32:25 using credential jenkins-ssh 10:32:25 Wiping out workspace first. 10:32:25 Cloning the remote Git repository 10:32:25 Cloning repository git://devvexx.opendaylight.org/mirror/releng/builder 10:32:25 > git init /w/workspace/builder-openstack-cron # timeout=10 10:32:25 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/releng/builder 10:32:25 > git --version # timeout=10 10:32:25 > git --version # 'git version 2.43.0' 10:32:25 using GIT_SSH to set credentials jenkins-ssh 10:32:25 [INFO] Currently running in a labeled security context 10:32:25 [INFO] Currently SELinux is 'enforcing' on the host 10:32:25 > /usr/bin/chcon --type=ssh_home_t /w/workspace/builder-openstack-cron@tmp/jenkins-gitclient-ssh13237725588895338955.key 10:32:25 Verifying host key using known hosts file 10:32:25 You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. 10:32:25 > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/releng/builder +refs/heads/*:refs/remotes/origin/* # timeout=10 10:32:28 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/releng/builder # timeout=10 10:32:28 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 10:32:28 Avoid second fetch 10:32:28 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 10:32:28 Checking out Revision 1d63b900750173f3a58231e6e4d029581de2b124 (refs/remotes/origin/master) 10:32:28 > git config core.sparsecheckout # timeout=10 10:32:28 > git checkout -f 1d63b900750173f3a58231e6e4d029581de2b124 # timeout=10 10:32:29 Commit message: "Chore: Add Ubuntu 20.04 and 22.04 jobs for mininet" 10:32:29 > git rev-list --no-walk 1d63b900750173f3a58231e6e4d029581de2b124 # timeout=10 10:32:29 > git remote # timeout=10 10:32:29 > git submodule init # timeout=10 10:32:29 > git submodule sync # timeout=10 10:32:29 > git config --get remote.origin.url # timeout=10 10:32:29 > git submodule init # timeout=10 10:32:29 > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10 10:32:29 > git config --get submodule.global-jjb.url # timeout=10 10:32:29 > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10 10:32:29 > git config --get submodule.packer/common-packer.url # timeout=10 10:32:29 > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10 10:32:29 > git submodule update --init --recursive global-jjb # timeout=10 10:32:30 > git submodule update --init --recursive packer/common-packer # timeout=10 10:32:34 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 10:32:34 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 10:32:34 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 10:32:34 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 10:32:34 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 10:32:34 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 10:32:34 Run condition [Boolean condition] enabling prebuild for step [BuilderChain] 10:32:34 No emails were triggered. 10:32:34 provisioning config files... 10:32:34 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml 10:32:34 copy managed file [npmrc] to file:/home/jenkins/.npmrc 10:32:34 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 10:32:34 [builder-openstack-cron] $ /bin/bash /tmp/jenkins6167487791721829591.sh 10:32:34 ---> python-tools-install.sh 10:32:34 Setup pyenv: 10:32:35 system 10:32:35 * 3.8.13 (set by /opt/pyenv/version) 10:32:35 * 3.9.13 (set by /opt/pyenv/version) 10:32:35 * 3.10.13 (set by /opt/pyenv/version) 10:32:35 * 3.11.7 (set by /opt/pyenv/version) 10:32:40 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-9NwM 10:32:40 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 10:32:43 lf-activate-venv(): INFO: Installing: lftools 10:33:19 lf-activate-venv(): INFO: Adding /tmp/venv-9NwM/bin to PATH 10:33:19 Generating Requirements File 10:33:45 Python 3.11.7 10:33:45 pip 24.2 from /tmp/venv-9NwM/lib/python3.11/site-packages/pip (python 3.11) 10:33:45 appdirs==1.4.4 10:33:45 argcomplete==3.5.0 10:33:45 aspy.yaml==1.3.0 10:33:45 attrs==24.2.0 10:33:45 autopage==0.5.2 10:33:45 beautifulsoup4==4.12.3 10:33:45 boto3==1.35.29 10:33:45 botocore==1.35.29 10:33:45 bs4==0.0.2 10:33:45 cachetools==5.5.0 10:33:45 certifi==2024.8.30 10:33:45 cffi==1.17.1 10:33:45 cfgv==3.4.0 10:33:45 chardet==5.2.0 10:33:45 charset-normalizer==3.3.2 10:33:45 click==8.1.7 10:33:45 cliff==4.7.0 10:33:45 cmd2==2.4.3 10:33:45 cryptography==3.3.2 10:33:45 debtcollector==3.0.0 10:33:45 decorator==5.1.1 10:33:45 defusedxml==0.7.1 10:33:45 Deprecated==1.2.14 10:33:45 distlib==0.3.8 10:33:45 dnspython==2.6.1 10:33:45 docker==4.2.2 10:33:45 dogpile.cache==1.3.3 10:33:45 durationpy==0.7 10:33:45 email_validator==2.2.0 10:33:45 filelock==3.16.1 10:33:45 future==1.0.0 10:33:45 gitdb==4.0.11 10:33:45 GitPython==3.1.43 10:33:45 google-auth==2.35.0 10:33:45 httplib2==0.22.0 10:33:45 identify==2.6.1 10:33:45 idna==3.10 10:33:45 importlib-resources==1.5.0 10:33:45 iso8601==2.1.0 10:33:45 Jinja2==3.1.4 10:33:45 jmespath==1.0.1 10:33:45 jsonpatch==1.33 10:33:45 jsonpointer==3.0.0 10:33:45 jsonschema==4.23.0 10:33:45 jsonschema-specifications==2023.12.1 10:33:45 keystoneauth1==5.8.0 10:33:45 kubernetes==31.0.0 10:33:45 lftools==0.37.10 10:33:45 lxml==5.3.0 10:33:45 MarkupSafe==2.1.5 10:33:45 msgpack==1.1.0 10:33:45 multi_key_dict==2.0.3 10:33:45 munch==4.0.0 10:33:45 netaddr==1.3.0 10:33:45 netifaces==0.11.0 10:33:45 niet==1.4.2 10:33:45 nodeenv==1.9.1 10:33:45 oauth2client==4.1.3 10:33:45 oauthlib==3.2.2 10:33:45 openstacksdk==4.0.0 10:33:45 os-client-config==2.1.0 10:33:45 os-service-types==1.7.0 10:33:45 osc-lib==3.1.0 10:33:45 oslo.config==9.6.0 10:33:45 oslo.context==5.6.0 10:33:45 oslo.i18n==6.4.0 10:33:45 oslo.log==6.1.2 10:33:45 oslo.serialization==5.5.0 10:33:45 oslo.utils==7.3.0 10:33:45 packaging==24.1 10:33:45 pbr==6.1.0 10:33:45 platformdirs==4.3.6 10:33:45 prettytable==3.11.0 10:33:45 pyasn1==0.6.1 10:33:45 pyasn1_modules==0.4.1 10:33:45 pycparser==2.22 10:33:45 pygerrit2==2.0.15 10:33:45 PyGithub==2.4.0 10:33:45 PyJWT==2.9.0 10:33:45 PyNaCl==1.5.0 10:33:45 pyparsing==2.4.7 10:33:45 pyperclip==1.9.0 10:33:45 pyrsistent==0.20.0 10:33:45 python-cinderclient==9.6.0 10:33:45 python-dateutil==2.9.0.post0 10:33:45 python-heatclient==4.0.0 10:33:45 python-jenkins==1.8.2 10:33:45 python-keystoneclient==5.5.0 10:33:45 python-magnumclient==4.7.0 10:33:45 python-openstackclient==7.1.2 10:33:45 python-swiftclient==4.6.0 10:33:45 PyYAML==6.0.2 10:33:45 referencing==0.35.1 10:33:45 requests==2.32.3 10:33:45 requests-oauthlib==2.0.0 10:33:45 requestsexceptions==1.4.0 10:33:45 rfc3986==2.0.0 10:33:45 rpds-py==0.20.0 10:33:45 rsa==4.9 10:33:45 ruamel.yaml==0.18.6 10:33:45 ruamel.yaml.clib==0.2.8 10:33:45 s3transfer==0.10.2 10:33:45 simplejson==3.19.3 10:33:45 six==1.16.0 10:33:45 smmap==5.0.1 10:33:45 soupsieve==2.6 10:33:45 stevedore==5.3.0 10:33:45 tabulate==0.9.0 10:33:45 toml==0.10.2 10:33:45 tomlkit==0.13.2 10:33:45 tqdm==4.66.5 10:33:45 typing_extensions==4.12.2 10:33:45 tzdata==2024.2 10:33:45 urllib3==1.26.20 10:33:45 virtualenv==20.26.6 10:33:45 wcwidth==0.2.13 10:33:45 websocket-client==1.8.0 10:33:45 wrapt==1.16.0 10:33:45 xdg==6.0.0 10:33:45 xmltodict==0.13.0 10:33:45 yq==3.4.3 10:33:46 [EnvInject] - Injecting environment variables from a build step. 10:33:46 [EnvInject] - Injecting as environment variables the properties content 10:33:46 OS_CLOUD=vex 10:33:46 10:33:46 [EnvInject] - Variables injected successfully. 10:33:46 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 10:33:46 Run condition [Boolean condition] enabling perform for step [Execute shell] 10:33:46 [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins13865591573909324188.sh 10:33:46 ---> Orphaned k8s clusters 10:33:46 Setup pyenv: 10:33:46 system 10:33:46 3.8.13 10:33:46 3.9.13 10:33:46 3.10.13 10:33:46 * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version) 10:33:46 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-9NwM from file:/tmp/.os_lf_venv 10:33:47 lf-activate-venv(): INFO: Installing: kubernetes python-heatclient python-openstackclient python-magnumclient 10:33:53 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 10:33:53 lftools 0.37.10 requires urllib3<2.1.0, but you have urllib3 2.2.3 which is incompatible. 10:33:54 lf-activate-venv(): INFO: Adding /tmp/venv-9NwM/bin to PATH 10:33:56 -----> Delete orphaned cluster 10:33:56 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 10:33:56 Run condition [Boolean condition] enabling perform for step [Execute shell] 10:33:56 [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins13793860972969021236.sh 10:33:56 ---> Orphaned stacks 10:33:56 Setup pyenv: 10:33:57 system 10:33:57 3.8.13 10:33:57 3.9.13 10:33:57 3.10.13 10:33:57 * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version) 10:33:57 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-9NwM from file:/tmp/.os_lf_venv 10:33:58 lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 10:34:16 lf-activate-venv(): INFO: Adding /tmp/venv-9NwM/bin to PATH 10:34:16 + mapfile -t OS_COE_CLUSTERS_ID 10:34:16 ++ awk '{print $1}' 10:34:16 ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name 10:34:16 ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)' 10:34:18 + echo '-----> Active clusters -> stacks' 10:34:18 -----> Active clusters -> stacks 10:34:18 + OS_COE_STACKS=() 10:34:18 + [[ 0 -gt 0 ]] 10:34:18 + mapfile -t OS_STACKS 10:34:18 ++ awk '{print $1}' 10:34:18 ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED 10:34:19 + echo '-----> Active stacks' 10:34:19 -----> Active stacks 10:34:19 + for stack in "${OS_STACKS[@]}" 10:34:19 + echo releng-openflowplugin-csit-1node-perf-bulkomatic-only-potassium-400 10:34:19 releng-openflowplugin-csit-1node-perf-bulkomatic-only-potassium-400 10:34:19 + echo '-----> Delete orphaned stacks' 10:34:19 -----> Delete orphaned stacks 10:34:19 + for STACK_NAME in "${OS_STACKS[@]}" 10:34:19 + [[ 0 -gt 0 ]] 10:34:19 + stack_in_jenkins releng-openflowplugin-csit-1node-perf-bulkomatic-only-potassium-400 https://jenkins.opendaylight.org/releng https://jenkins.opendaylight.org/sandbox 10:34:19 + STACK_NAME=releng-openflowplugin-csit-1node-perf-bulkomatic-only-potassium-400 10:34:19 + builds=() 10:34:19 + for jenkins in "${@:2}" 10:34:19 + PARAMS='tree=computer[executors[currentExecutable[url]],' 10:34:19 + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]' 10:34:19 + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 10:34:19 + JENKINS_URL='https://jenkins.opendaylight.org/releng/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 10:34:19 ++ curl -s -w '\n\n%{http_code}' --globoff -H Content-Type:application/json 'https://jenkins.opendaylight.org/releng/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 10:34:20 + resp='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/65355/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.maven.MavenModuleSetBuild","url":"https://jenkins.opendaylight.org/releng/job/distribution-merge-managed-scandium/890/"}}],"oneOffExecutors":[]}]} 10:34:20 10:34:20 200' 10:34:20 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/65355/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.maven.MavenModuleSetBuild","url":"https://jenkins.opendaylight.org/releng/job/distribution-merge-managed-scandium/890/"}}],"oneOffExecutors":[]}]} 10:34:20 10:34:20 200' 10:34:20 ++ head -n1 10:34:20 + json_data='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/65355/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.maven.MavenModuleSetBuild","url":"https://jenkins.opendaylight.org/releng/job/distribution-merge-managed-scandium/890/"}}],"oneOffExecutors":[]}]}' 10:34:20 ++ awk 'END {print $NF}' 10:34:20 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/65355/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.maven.MavenModuleSetBuild","url":"https://jenkins.opendaylight.org/releng/job/distribution-merge-managed-scandium/890/"}}],"oneOffExecutors":[]}]} 10:34:20 10:34:20 200' 10:34:20 + status=200 10:34:20 + '[' 200 '!=' 200 ']' 10:34:20 + [[ https://jenkins.opendaylight.org/releng == *\j\e\n\k\i\n\s\.*\.\o\r\g ]] 10:34:20 + [[ https://jenkins.opendaylight.org/releng == *\j\e\n\k\i\n\s\.*\.\i\o ]] 10:34:20 ++ sed 's/\/*$//' 10:34:20 ++ awk -F/ '{print $NF}' 10:34:20 ++ echo https://jenkins.opendaylight.org/releng 10:34:20 + silo=releng 10:34:20 + export silo 10:34:20 + builds=(${builds[@]} $(echo "$json_data" | jq -r '.computer[].executors[].currentExecutable.url' | grep -v null | awk -F'/' '{print ENVIRON["silo"] "-" $6 "-" $7}')) 10:34:20 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.model.FreeStyleBuild","url":"https://jenkins.opendaylight.org/releng/job/builder-openstack-cron/65355/"}}],"oneOffExecutors":[]},{"_class":"jenkins.plugins.openstack.compute.JCloudsComputer","executors":[{"currentExecutable":{"_class":"hudson.maven.MavenModuleSetBuild","url":"https://jenkins.opendaylight.org/releng/job/distribution-merge-managed-scandium/890/"}}],"oneOffExecutors":[]}]}' 10:34:20 ++ awk -F/ '{print ENVIRON["silo"] "-" $6 "-" $7}' 10:34:20 ++ grep -v null 10:34:20 ++ jq -r '.computer[].executors[].currentExecutable.url' 10:34:20 + for jenkins in "${@:2}" 10:34:20 + PARAMS='tree=computer[executors[currentExecutable[url]],' 10:34:20 + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]' 10:34:20 + PARAMS='tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 10:34:20 + JENKINS_URL='https://jenkins.opendaylight.org/sandbox/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 10:34:20 ++ curl -s -w '\n\n%{http_code}' --globoff -H Content-Type:application/json 'https://jenkins.opendaylight.org/sandbox/computer/api/json?tree=computer[executors[currentExecutable[url]],oneOffExecutors[currentExecutable[url]]]&xpath=//url&wrapper=builds' 10:34:20 + resp='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]} 10:34:20 10:34:20 200' 10:34:20 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]} 10:34:20 10:34:20 200' 10:34:20 ++ head -n1 10:34:20 + json_data='{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}' 10:34:20 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]} 10:34:20 10:34:20 200' 10:34:20 ++ awk 'END {print $NF}' 10:34:20 + status=200 10:34:20 + '[' 200 '!=' 200 ']' 10:34:20 + [[ https://jenkins.opendaylight.org/sandbox == *\j\e\n\k\i\n\s\.*\.\o\r\g ]] 10:34:20 + [[ https://jenkins.opendaylight.org/sandbox == *\j\e\n\k\i\n\s\.*\.\i\o ]] 10:34:20 ++ echo https://jenkins.opendaylight.org/sandbox 10:34:20 ++ sed 's/\/*$//' 10:34:20 ++ awk -F/ '{print $NF}' 10:34:20 + silo=sandbox 10:34:20 + export silo 10:34:20 + builds=(${builds[@]} $(echo "$json_data" | jq -r '.computer[].executors[].currentExecutable.url' | grep -v null | awk -F'/' '{print ENVIRON["silo"] "-" $6 "-" $7}')) 10:34:20 ++ jq -r '.computer[].executors[].currentExecutable.url' 10:34:20 ++ echo '{"_class":"hudson.model.ComputerSet","computer":[{"_class":"hudson.model.Hudson$MasterComputer","executors":[],"oneOffExecutors":[]}]}' 10:34:20 ++ grep -v null 10:34:20 ++ awk -F/ '{print ENVIRON["silo"] "-" $6 "-" $7}' 10:34:20 + [[ releng-builder-openstack-cron-65355 releng-distribution-merge-managed-scandium-890 =~ releng-openflowplugin-csit-1node-perf-bulkomatic-only-potassium-400 ]] 10:34:20 + return 1 10:34:20 + echo 'Deleting orphaned stack: releng-openflowplugin-csit-1node-perf-bulkomatic-only-potassium-400' 10:34:20 Deleting orphaned stack: releng-openflowplugin-csit-1node-perf-bulkomatic-only-potassium-400 10:34:20 + lftools openstack --os-cloud vex stack delete --force releng-openflowplugin-csit-1node-perf-bulkomatic-only-potassium-400 10:42:34 Build timed out (after 10 minutes). Marking the build as failed. 10:42:34 $ ssh-agent -k 10:42:34 unset SSH_AUTH_SOCK; 10:42:34 unset SSH_AGENT_PID; 10:42:34 echo Agent pid 5477 killed; 10:42:34 [ssh-agent] Stopped. 10:42:34 Build was aborted 10:42:34 [PostBuildScript] - [INFO] Executing post build scripts. 10:42:34 /tmp/jenkins13793860972969021236.sh: line 129: 7119 Terminated lftools openstack --os-cloud "${os_cloud}" stack delete --force "${STACK_NAME}" 10:42:34 [builder-openstack-cron] $ /bin/bash /tmp/jenkins5059675933483088513.sh 10:42:34 ---> sysstat.sh 10:42:34 [builder-openstack-cron] $ /bin/bash /tmp/jenkins13586361929321705275.sh 10:42:34 ---> package-listing.sh 10:42:34 ++ facter osfamily 10:42:34 ++ tr '[:upper:]' '[:lower:]' 10:42:35 + OS_FAMILY=redhat 10:42:35 + workspace=/w/workspace/builder-openstack-cron 10:42:35 + START_PACKAGES=/tmp/packages_start.txt 10:42:35 + END_PACKAGES=/tmp/packages_end.txt 10:42:35 + DIFF_PACKAGES=/tmp/packages_diff.txt 10:42:35 + PACKAGES=/tmp/packages_start.txt 10:42:35 + '[' /w/workspace/builder-openstack-cron ']' 10:42:35 + PACKAGES=/tmp/packages_end.txt 10:42:35 + case "${OS_FAMILY}" in 10:42:35 + rpm -qa 10:42:35 + sort 10:42:35 + '[' -f /tmp/packages_start.txt ']' 10:42:35 + '[' -f /tmp/packages_end.txt ']' 10:42:35 + diff /tmp/packages_start.txt /tmp/packages_end.txt 10:42:35 + '[' /w/workspace/builder-openstack-cron ']' 10:42:35 + mkdir -p /w/workspace/builder-openstack-cron/archives/ 10:42:35 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/builder-openstack-cron/archives/ 10:42:35 [builder-openstack-cron] $ /bin/bash /tmp/jenkins11641068349053127859.sh 10:42:35 ---> capture-instance-metadata.sh 10:42:35 Setup pyenv: 10:42:35 system 10:42:35 3.8.13 10:42:35 3.9.13 10:42:35 3.10.13 10:42:35 * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version) 10:42:36 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-9NwM from file:/tmp/.os_lf_venv 10:42:37 lf-activate-venv(): INFO: Installing: lftools 10:42:51 lf-activate-venv(): INFO: Adding /tmp/venv-9NwM/bin to PATH 10:42:51 INFO: Running in OpenStack, capturing instance metadata 10:42:52 [builder-openstack-cron] $ /bin/bash /tmp/jenkins7714857042372818587.sh 10:42:52 provisioning config files... 10:42:52 Could not find credentials [logs] for builder-openstack-cron #65355 10:42:52 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/builder-openstack-cron@tmp/config14298463778817324008tmp 10:42:52 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] 10:42:52 Run condition [Regular expression match] enabling perform for step [Provide Configuration files] 10:42:52 provisioning config files... 10:42:53 copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials 10:42:53 [EnvInject] - Injecting environment variables from a build step. 10:42:53 [EnvInject] - Injecting as environment variables the properties content 10:42:53 SERVER_ID=logs 10:42:53 10:42:53 [EnvInject] - Variables injected successfully. 10:42:53 [builder-openstack-cron] $ /bin/bash /tmp/jenkins5420755589213232229.sh 10:42:53 ---> create-netrc.sh 10:42:53 WARN: Log server credential not found. 10:42:53 [builder-openstack-cron] $ /bin/bash /tmp/jenkins806604139604926973.sh 10:42:53 ---> python-tools-install.sh 10:42:53 Setup pyenv: 10:42:53 system 10:42:53 3.8.13 10:42:53 3.9.13 10:42:53 3.10.13 10:42:53 * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version) 10:42:53 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-9NwM from file:/tmp/.os_lf_venv 10:42:55 lf-activate-venv(): INFO: Installing: lftools 10:43:03 lf-activate-venv(): INFO: Adding /tmp/venv-9NwM/bin to PATH 10:43:03 [builder-openstack-cron] $ /bin/bash /tmp/jenkins2903380376189450774.sh 10:43:03 ---> sudo-logs.sh 10:43:03 Archiving 'sudo' log.. 10:43:03 [builder-openstack-cron] $ /bin/bash /tmp/jenkins10054585156608481358.sh 10:43:03 ---> job-cost.sh 10:43:03 Setup pyenv: 10:43:04 system 10:43:04 3.8.13 10:43:04 3.9.13 10:43:04 3.10.13 10:43:04 * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version) 10:43:04 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-9NwM from file:/tmp/.os_lf_venv 10:43:05 lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 10:43:14 lf-activate-venv(): INFO: Adding /tmp/venv-9NwM/bin to PATH 10:43:14 INFO: No Stack... 10:43:14 INFO: Retrieving Pricing Info for: v3-standard-2 10:43:14 INFO: Archiving Costs 10:43:14 [builder-openstack-cron] $ /bin/bash -l /tmp/jenkins825200966644462499.sh 10:43:14 ---> logs-deploy.sh 10:43:14 Setup pyenv: 10:43:14 system 10:43:14 3.8.13 10:43:14 3.9.13 10:43:14 3.10.13 10:43:14 * 3.11.7 (set by /w/workspace/builder-openstack-cron/.python-version) 10:43:15 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-9NwM from file:/tmp/.os_lf_venv 10:43:16 lf-activate-venv(): INFO: Installing: lftools 10:43:24 lf-activate-venv(): INFO: Adding /tmp/venv-9NwM/bin to PATH 10:43:24 WARNING: Nexus logging server not set 10:43:24 INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/builder-openstack-cron/65355/ 10:43:24 INFO: archiving logs to S3 10:43:25 ---> uname -a: 10:43:25 Linux prd-centos8-builder-2c-2g-30891.novalocal 4.18.0-553.5.1.el8.x86_64 #1 SMP Tue May 21 05:46:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux 10:43:25 10:43:25 10:43:25 ---> lscpu: 10:43:25 Architecture: x86_64 10:43:25 CPU op-mode(s): 32-bit, 64-bit 10:43:25 Byte Order: Little Endian 10:43:25 CPU(s): 2 10:43:25 On-line CPU(s) list: 0,1 10:43:25 Thread(s) per core: 1 10:43:25 Core(s) per socket: 1 10:43:25 Socket(s): 2 10:43:25 NUMA node(s): 1 10:43:25 Vendor ID: AuthenticAMD 10:43:25 CPU family: 23 10:43:25 Model: 49 10:43:25 Model name: AMD EPYC-Rome Processor 10:43:25 Stepping: 0 10:43:25 CPU MHz: 2799.998 10:43:25 BogoMIPS: 5599.99 10:43:25 Virtualization: AMD-V 10:43:25 Hypervisor vendor: KVM 10:43:25 Virtualization type: full 10:43:25 L1d cache: 32K 10:43:25 L1i cache: 32K 10:43:25 L2 cache: 512K 10:43:25 L3 cache: 16384K 10:43:25 NUMA node0 CPU(s): 0,1 10:43:25 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities 10:43:25 10:43:25 10:43:25 ---> nproc: 10:43:25 2 10:43:25 10:43:25 10:43:25 ---> df -h: 10:43:25 Filesystem Size Used Avail Use% Mounted on 10:43:25 devtmpfs 3.8G 0 3.8G 0% /dev 10:43:25 tmpfs 3.8G 0 3.8G 0% /dev/shm 10:43:25 tmpfs 3.8G 17M 3.8G 1% /run 10:43:25 tmpfs 3.8G 0 3.8G 0% /sys/fs/cgroup 10:43:25 /dev/vda1 40G 8.4G 32G 21% / 10:43:25 tmpfs 770M 0 770M 0% /run/user/1001 10:43:25 10:43:25 10:43:25 ---> free -m: 10:43:25 total used free shared buff/cache available 10:43:25 Mem: 7697 628 4814 19 2254 6773 10:43:25 Swap: 1023 0 1023 10:43:25 10:43:25 10:43:25 ---> ip addr: 10:43:25 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 10:43:25 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 10:43:25 inet 127.0.0.1/8 scope host lo 10:43:25 valid_lft forever preferred_lft forever 10:43:25 inet6 ::1/128 scope host 10:43:25 valid_lft forever preferred_lft forever 10:43:25 2: eth0: mtu 1458 qdisc mq state UP group default qlen 1000 10:43:25 link/ether fa:16:3e:09:bd:c6 brd ff:ff:ff:ff:ff:ff 10:43:25 altname enp0s3 10:43:25 altname ens3 10:43:25 inet 10.30.171.166/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0 10:43:25 valid_lft 85696sec preferred_lft 85696sec 10:43:25 inet6 fe80::f816:3eff:fe09:bdc6/64 scope link 10:43:25 valid_lft forever preferred_lft forever 10:43:25 3: docker0: mtu 1458 qdisc noqueue state DOWN group default 10:43:25 link/ether 02:42:47:cc:a4:5d brd ff:ff:ff:ff:ff:ff 10:43:25 inet 10.250.0.254/24 brd 10.250.0.255 scope global docker0 10:43:25 valid_lft forever preferred_lft forever 10:43:25 10:43:25 10:43:25 ---> sar -b -r -n DEV: 10:43:25 Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-builder-5e6ee0fb-b6d9-4116-90d4-35c890e2b0f7.nov) 09/30/2024 _x86_64_ (2 CPU) 10:43:25 10:43:25 10:31:36 LINUX RESTART (2 CPU) 10:43:25 10:43:25 10:32:01 AM tps rtps wtps bread/s bwrtn/s 10:43:25 10:33:01 AM 161.36 31.66 129.70 7503.26 41404.48 10:43:25 10:34:01 AM 107.52 6.97 100.55 1264.99 8174.95 10:43:25 10:35:01 AM 39.62 0.70 38.92 71.31 5478.17 10:43:25 10:36:01 AM 5.28 0.00 5.28 0.00 197.92 10:43:25 10:37:01 AM 0.38 0.00 0.38 0.00 4.37 10:43:25 10:38:01 AM 0.55 0.00 0.55 0.00 9.95 10:43:25 10:39:01 AM 0.32 0.00 0.32 0.00 3.28 10:43:25 10:40:01 AM 0.33 0.00 0.33 0.00 3.47 10:43:25 10:41:01 AM 0.38 0.00 0.38 0.00 4.40 10:43:25 10:42:01 AM 0.37 0.00 0.37 0.00 3.68 10:43:25 10:43:01 AM 7.40 0.30 7.10 36.12 105.55 10:43:25 Average: 29.41 3.60 25.81 807.11 5036.75 10:43:25 10:43:25 10:32:01 AM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 10:43:25 10:33:01 AM 5237440 6988532 2644992 33.56 2688 1941884 1000612 11.20 205148 2146324 107904 10:43:25 10:34:01 AM 5008120 6982784 2874312 36.46 2688 2151860 951084 10.65 225760 2300120 103456 10:43:25 10:35:01 AM 4952448 6952600 2929984 37.17 2688 2177080 995824 11.15 251188 2327728 8 10:43:25 10:36:01 AM 4949912 6949488 2932520 37.20 2688 2177080 995824 11.15 251188 2331640 4 10:43:25 10:37:01 AM 4947644 6947224 2934788 37.23 2688 2177084 995824 11.15 251188 2334304 4 10:43:25 10:38:01 AM 4947796 6947352 2934636 37.23 2688 2177084 995824 11.15 251188 2334268 4 10:43:25 10:39:01 AM 4947612 6947168 2934820 37.23 2688 2177084 995824 11.15 251188 2334332 4 10:43:25 10:40:01 AM 4947672 6947220 2934760 37.23 2688 2177088 990708 11.09 251188 2334344 4 10:43:25 10:41:01 AM 4947812 6947412 2934620 37.23 2688 2177088 990708 11.09 251188 2334280 4 10:43:25 10:42:01 AM 4947936 6947540 2934496 37.23 2688 2177092 990708 11.09 251188 2334288 4 10:43:25 10:43:01 AM 4940664 6941504 2941768 37.32 2688 2178344 995936 11.15 408436 2184604 36 10:43:25 Average: 4979551 6954439 2902881 36.83 2688 2153524 990807 11.09 258986 2299657 19221 10:43:25 10:43:25 10:32:01 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 10:43:25 10:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:43:25 10:33:01 AM eth0 298.67 182.96 1656.88 61.66 0.00 0.00 0.00 0.00 10:43:25 10:33:01 AM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:43:25 10:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:43:25 10:34:01 AM eth0 40.68 33.43 279.53 6.44 0.00 0.00 0.00 0.00 10:43:25 10:34:01 AM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:43:25 10:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:43:25 10:35:01 AM eth0 32.91 24.19 380.36 3.66 0.00 0.00 0.00 0.00 10:43:25 10:35:01 AM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:43:25 10:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:43:25 10:36:01 AM eth0 0.53 0.38 0.34 0.14 0.00 0.00 0.00 0.00 10:43:25 10:36:01 AM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:43:25 10:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:43:25 10:37:01 AM eth0 0.47 0.43 0.34 0.15 0.00 0.00 0.00 0.00 10:43:25 10:37:01 AM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:43:25 10:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:43:25 10:38:01 AM eth0 0.70 0.52 0.47 0.21 0.00 0.00 0.00 0.00 10:43:25 10:38:01 AM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:43:25 10:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:43:25 10:39:01 AM eth0 0.50 0.38 0.34 0.14 0.00 0.00 0.00 0.00 10:43:25 10:39:01 AM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:43:25 10:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:43:25 10:40:01 AM eth0 0.60 0.38 0.35 0.14 0.00 0.00 0.00 0.00 10:43:25 10:40:01 AM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:43:25 10:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:43:25 10:41:01 AM eth0 0.55 0.42 0.34 0.15 0.00 0.00 0.00 0.00 10:43:25 10:41:01 AM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:43:25 10:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:43:25 10:42:01 AM eth0 0.58 0.38 0.34 0.14 0.00 0.00 0.00 0.00 10:43:25 10:42:01 AM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:43:25 10:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:43:25 10:43:01 AM eth0 13.31 10.85 10.40 8.80 0.00 0.00 0.00 0.00 10:43:25 10:43:01 AM docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:43:25 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:43:25 Average: eth0 35.42 23.13 211.84 7.42 0.00 0.00 0.00 0.00 10:43:25 Average: docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:43:25 10:43:25 10:43:25 ---> sar -P ALL: 10:43:25 Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-builder-5e6ee0fb-b6d9-4116-90d4-35c890e2b0f7.nov) 09/30/2024 _x86_64_ (2 CPU) 10:43:25 10:43:25 10:31:36 LINUX RESTART (2 CPU) 10:43:25 10:43:25 10:32:01 AM CPU %user %nice %system %iowait %steal %idle 10:43:25 10:33:01 AM all 36.82 0.00 8.77 6.91 0.11 47.39 10:43:25 10:33:01 AM 0 38.73 0.00 9.71 6.98 0.12 44.47 10:43:25 10:33:01 AM 1 34.91 0.00 7.84 6.84 0.10 50.30 10:43:25 10:34:01 AM all 31.06 0.00 5.84 3.09 0.09 59.91 10:43:25 10:34:01 AM 0 41.12 0.00 6.94 3.55 0.10 48.29 10:43:25 10:34:01 AM 1 21.03 0.00 4.74 2.64 0.08 71.51 10:43:25 10:35:01 AM all 9.95 0.00 1.30 2.31 0.05 86.39 10:43:25 10:35:01 AM 0 14.99 0.00 1.25 2.76 0.05 80.95 10:43:25 10:35:01 AM 1 4.91 0.00 1.35 1.85 0.05 91.84 10:43:25 10:36:01 AM all 0.19 0.00 0.10 0.10 0.04 99.57 10:43:25 10:36:01 AM 0 0.10 0.00 0.13 0.20 0.05 99.52 10:43:25 10:36:01 AM 1 0.28 0.00 0.07 0.00 0.03 99.61 10:43:25 10:37:01 AM all 0.43 0.00 0.11 0.00 0.05 99.42 10:43:25 10:37:01 AM 0 0.42 0.00 0.13 0.00 0.05 99.40 10:43:25 10:37:01 AM 1 0.43 0.00 0.08 0.00 0.05 99.43 10:43:25 10:38:01 AM all 0.42 0.00 0.08 0.00 0.04 99.47 10:43:25 10:38:01 AM 0 0.53 0.00 0.08 0.00 0.05 99.33 10:43:25 10:38:01 AM 1 0.30 0.00 0.07 0.00 0.03 99.60 10:43:25 10:39:01 AM all 0.24 0.00 0.06 0.00 0.04 99.66 10:43:25 10:39:01 AM 0 0.22 0.00 0.08 0.00 0.05 99.65 10:43:25 10:39:01 AM 1 0.27 0.00 0.03 0.00 0.03 99.67 10:43:25 10:40:01 AM all 0.37 0.00 0.08 0.00 0.04 99.52 10:43:25 10:40:01 AM 0 0.18 0.00 0.08 0.00 0.03 99.70 10:43:25 10:40:01 AM 1 0.55 0.00 0.07 0.00 0.05 99.33 10:43:25 10:41:01 AM all 0.42 0.00 0.07 0.00 0.04 99.47 10:43:25 10:41:01 AM 0 0.22 0.00 0.05 0.00 0.02 99.72 10:43:25 10:41:01 AM 1 0.62 0.00 0.08 0.00 0.07 99.23 10:43:25 10:42:01 AM all 0.32 0.00 0.08 0.00 0.04 99.56 10:43:25 10:42:01 AM 0 0.23 0.00 0.08 0.00 0.05 99.63 10:43:25 10:42:01 AM 1 0.40 0.00 0.08 0.00 0.03 99.48 10:43:25 10:43:01 AM all 12.84 0.00 1.43 0.29 0.08 85.36 10:43:25 10:43:01 AM 0 16.90 0.00 1.37 0.42 0.07 81.25 10:43:25 10:43:01 AM 1 8.78 0.00 1.49 0.17 0.08 89.48 10:43:25 10:43:25 Average: CPU %user %nice %system %iowait %steal %idle 10:43:25 Average: all 8.44 0.00 1.62 1.15 0.06 88.73 10:43:25 Average: 0 10.30 0.00 1.80 1.26 0.06 86.58 10:43:25 Average: 1 6.57 0.00 1.44 1.04 0.06 90.88 10:43:25 10:43:25 10:43:25