Started by upstream project "integration-distribution-test-titanium" build number 41 originally caused by: Started by upstream project "autorelease-release-titanium-mvn39-openjdk21" build number 41 originally caused by: Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on prd-centos8-robot-2c-8g-39469 (centos8-robot-2c-8g) in workspace /w/workspace/openflowplugin-csit-1node-scale-switch-only-titanium [ssh-agent] Looking for ssh-agent implementation... [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) $ ssh-agent SSH_AUTH_SOCK=/tmp/ssh-hUvFBei90WtY/agent.5281 SSH_AGENT_PID=5282 [ssh-agent] Started. Running ssh-add (command line suppressed) Identity added: /w/workspace/openflowplugin-csit-1node-scale-switch-only-titanium@tmp/private_key_5341757760450343176.key (/w/workspace/openflowplugin-csit-1node-scale-switch-only-titanium@tmp/private_key_5341757760450343176.key) [ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key) The recommended git tool is: NONE using credential opendaylight-jenkins-ssh Wiping out workspace first. Cloning the remote Git repository Cloning repository git://devvexx.opendaylight.org/mirror/integration/test > git init /w/workspace/openflowplugin-csit-1node-scale-switch-only-titanium/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test > git --version # timeout=10 > git --version # 'git version 2.43.0' using GIT_SSH to set credentials Release Engineering Jenkins Key [INFO] Currently running in a labeled security context [INFO] Currently SELinux is 'enforcing' on the host > /usr/bin/chcon --type=ssh_home_t /w/workspace/openflowplugin-csit-1node-scale-switch-only-titanium/test@tmp/jenkins-gitclient-ssh13886677066109578215.key Verifying host key using known hosts file You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test using GIT_SSH to set credentials Release Engineering Jenkins Key [INFO] Currently running in a labeled security context [INFO] Currently SELinux is 'enforcing' on the host > /usr/bin/chcon --type=ssh_home_t /w/workspace/openflowplugin-csit-1node-scale-switch-only-titanium/test@tmp/jenkins-gitclient-ssh1163005948654371518.key Verifying host key using known hosts file You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10 > git rev-parse FETCH_HEAD^{commit} # timeout=10 Checking out Revision 8004221a209b958d01e793917ecd77dad3fb4be4 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 8004221a209b958d01e793917ecd77dad3fb4be4 # timeout=10 Commit message: "Adapt netconf device configuration in daexim CSIT" > git rev-parse FETCH_HEAD^{commit} # timeout=10 > git rev-list --no-walk 1e8cddc2427ae5bda4fe4c272ff9c71b1ca83d75 # timeout=10 No emails were triggered. provisioning config files... copy managed file [npmrc] to file:/home/jenkins/.npmrc copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [openflowplugin-csit-1node-scale-switch-only-titanium] $ /bin/bash /tmp/jenkins16702573414349490329.sh ---> python-tools-install.sh Setup pyenv: system * 3.8.13 (set by /opt/pyenv/version) * 3.9.13 (set by /opt/pyenv/version) * 3.10.13 (set by /opt/pyenv/version) * 3.11.7 (set by /opt/pyenv/version) lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-I1XH lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-I1XH/bin to PATH Generating Requirements File Python 3.11.7 pip 24.2 from /tmp/venv-I1XH/lib/python3.11/site-packages/pip (python 3.11) appdirs==1.4.4 argcomplete==3.5.0 aspy.yaml==1.3.0 attrs==24.2.0 autopage==0.5.2 beautifulsoup4==4.12.3 boto3==1.35.34 botocore==1.35.34 bs4==0.0.2 cachetools==5.5.0 certifi==2024.8.30 cffi==1.17.1 cfgv==3.4.0 chardet==5.2.0 charset-normalizer==3.3.2 click==8.1.7 cliff==4.7.0 cmd2==2.4.3 cryptography==3.3.2 debtcollector==3.0.0 decorator==5.1.1 defusedxml==0.7.1 Deprecated==1.2.14 distlib==0.3.8 dnspython==2.7.0 docker==4.2.2 dogpile.cache==1.3.3 durationpy==0.9 email_validator==2.2.0 filelock==3.16.1 future==1.0.0 gitdb==4.0.11 GitPython==3.1.43 google-auth==2.35.0 httplib2==0.22.0 identify==2.6.1 idna==3.10 importlib-resources==1.5.0 iso8601==2.1.0 Jinja2==3.1.4 jmespath==1.0.1 jsonpatch==1.33 jsonpointer==3.0.0 jsonschema==4.23.0 jsonschema-specifications==2023.12.1 keystoneauth1==5.8.0 kubernetes==31.0.0 lftools==0.37.10 lxml==5.3.0 MarkupSafe==2.1.5 msgpack==1.1.0 multi_key_dict==2.0.3 munch==4.0.0 netaddr==1.3.0 netifaces==0.11.0 niet==1.4.2 nodeenv==1.9.1 oauth2client==4.1.3 oauthlib==3.2.2 openstacksdk==4.0.0 os-client-config==2.1.0 os-service-types==1.7.0 osc-lib==3.1.0 oslo.config==9.6.0 oslo.context==5.6.0 oslo.i18n==6.4.0 oslo.log==6.1.2 oslo.serialization==5.5.0 oslo.utils==7.3.0 packaging==24.1 pbr==6.1.0 platformdirs==4.3.6 prettytable==3.11.0 pyasn1==0.6.1 pyasn1_modules==0.4.1 pycparser==2.22 pygerrit2==2.0.15 PyGithub==2.4.0 PyJWT==2.9.0 PyNaCl==1.5.0 pyparsing==2.4.7 pyperclip==1.9.0 pyrsistent==0.20.0 python-cinderclient==9.6.0 python-dateutil==2.9.0.post0 python-heatclient==4.0.0 python-jenkins==1.8.2 python-keystoneclient==5.5.0 python-magnumclient==4.7.0 python-openstackclient==7.1.2 python-swiftclient==4.6.0 PyYAML==6.0.2 referencing==0.35.1 requests==2.32.3 requests-oauthlib==2.0.0 requestsexceptions==1.4.0 rfc3986==2.0.0 rpds-py==0.20.0 rsa==4.9 ruamel.yaml==0.18.6 ruamel.yaml.clib==0.2.8 s3transfer==0.10.2 simplejson==3.19.3 six==1.16.0 smmap==5.0.1 soupsieve==2.6 stevedore==5.3.0 tabulate==0.9.0 toml==0.10.2 tomlkit==0.13.2 tqdm==4.66.5 typing_extensions==4.12.2 tzdata==2024.2 urllib3==1.26.20 virtualenv==20.26.6 wcwidth==0.2.13 websocket-client==1.8.0 wrapt==1.16.0 xdg==6.0.0 xmltodict==0.13.0 yq==3.4.3 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_STACK_TEMPLATE=csit-2-instance-type.yaml OS_CLOUD=vex OS_STACK_NAME=releng-openflowplugin-csit-1node-scale-switch-only-titanium-41 OS_STACK_TEMPLATE_DIR=openstack-hot [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [openflowplugin-csit-1node-scale-switch-only-titanium] $ /bin/bash /tmp/jenkins16604631411295374633.sh ---> Create parameters file for OpenStack HOT OpenStack Heat parameters generated ----------------------------------- parameters: vm_0_count: '1' vm_0_flavor: 'v3-standard-4' vm_0_image: 'ZZCI - Ubuntu 20.04 - builder - x86_64 - 20240901-160214.010' vm_1_count: '1' vm_1_flavor: 'v3-standard-2' vm_1_image: 'ZZCI - Ubuntu 18.04 - mininet-ovs-28 - x86_64 - 20230601-180106.003' job_name: '36899-41' silo: 'releng' [openflowplugin-csit-1node-scale-switch-only-titanium] $ /bin/bash -l /tmp/jenkins7598634886630018262.sh ---> Create HEAT stack + source /home/jenkins/lf-env.sh + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ++ mktemp -d /tmp/venv-XXXX + lf_venv=/tmp/venv-K2Ch + local venv_file=/tmp/.os_lf_venv + local python=python3 + local options + local set_path=true + local install_args= ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\''' + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\''' ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + true + case $1 in + python=python3 + shift 2 + true + case $1 in + shift + break + case $python in + local pkg_list= + [[ -d /opt/pyenv ]] + echo 'Setup pyenv:' Setup pyenv: + export PYENV_ROOT=/opt/pyenv + PYENV_ROOT=/opt/pyenv + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + pyenv versions system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/openflowplugin-csit-1node-scale-switch-only-titanium/.python-version) + command -v pyenv ++ pyenv init - --no-rehash + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; fi; done; echo "${paths[*]}"'\'')" export PATH="/opt/pyenv/shims:${PATH}" export PYENV_SHELL=bash source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\'' pyenv() { local command command="${1:-}" if [ "$#" -gt 0 ]; then shift fi case "$command" in rehash|shell) eval "$(pyenv "sh-$command" "$@")" ;; *) command pyenv "$command" "$@" ;; esac }' +++ bash --norc -ec 'IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; fi; done; echo "${paths[*]}"' ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ export PYENV_SHELL=bash ++ PYENV_SHELL=bash ++ source /opt/pyenv/libexec/../completions/pyenv.bash +++ complete -F _pyenv pyenv ++ lf-pyver python3 ++ local py_version_xy=python3 ++ local py_version_xyz= ++ awk '{ print $1 }' ++ pyenv versions ++ local command ++ command=versions ++ '[' 1 -gt 0 ']' ++ shift ++ case "$command" in ++ command pyenv versions ++ pyenv versions ++ sed 's/^[ *]* //' ++ grep -E '^[0-9.]*[0-9]$' ++ [[ ! -s /tmp/.pyenv_versions ]] +++ grep '^3' /tmp/.pyenv_versions +++ tail -n 1 +++ sort -V ++ py_version_xyz=3.11.7 ++ [[ -z 3.11.7 ]] ++ echo 3.11.7 ++ return 0 + pyenv local 3.11.7 + local command + command=local + '[' 2 -gt 0 ']' + shift + case "$command" in + command pyenv local 3.11.7 + pyenv local 3.11.7 + for arg in "$@" + case $arg in + pkg_list+='lftools[openstack] ' + for arg in "$@" + case $arg in + pkg_list+='kubernetes ' + for arg in "$@" + case $arg in + pkg_list+='niet ' + for arg in "$@" + case $arg in + pkg_list+='python-heatclient ' + for arg in "$@" + case $arg in + pkg_list+='python-openstackclient ' + for arg in "$@" + case $arg in + pkg_list+='python-magnumclient ' + for arg in "$@" + case $arg in + pkg_list+='yq ' + [[ -f /tmp/.os_lf_venv ]] ++ cat /tmp/.os_lf_venv + lf_venv=/tmp/venv-I1XH + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-I1XH from' file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Reuse venv:/tmp/venv-I1XH from file:/tmp/.os_lf_venv + /tmp/venv-I1XH/bin/python3 -m pip install --upgrade --quiet pip virtualenv + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ]] + echo 'lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ' lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + /tmp/venv-I1XH/bin/python3 -m pip install --upgrade --quiet --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + type python3 + true + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-I1XH/bin to PATH' lf-activate-venv(): INFO: Adding /tmp/venv-I1XH/bin to PATH + PATH=/tmp/venv-I1XH/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + return 0 + openstack --os-cloud vex limits show --absolute +--------------------------+---------+ | Name | Value | +--------------------------+---------+ | maxTotalInstances | -1 | | maxTotalCores | 450 | | maxTotalRAMSize | 1000000 | | maxServerMeta | 128 | | maxImageMeta | 128 | | maxPersonality | 5 | | maxPersonalitySize | 10240 | | maxTotalKeypairs | 100 | | maxServerGroups | 10 | | maxServerGroupMembers | 10 | | maxTotalFloatingIps | -1 | | maxSecurityGroups | -1 | | maxSecurityGroupRules | -1 | | totalRAMUsed | 557056 | | totalCoresUsed | 136 | | totalInstancesUsed | 47 | | totalFloatingIpsUsed | 0 | | totalSecurityGroupsUsed | 0 | | totalServerGroupsUsed | 0 | | maxTotalVolumes | -1 | | maxTotalSnapshots | 10 | | maxTotalVolumeGigabytes | 4096 | | maxTotalBackups | 10 | | maxTotalBackupGigabytes | 1000 | | totalVolumesUsed | 2 | | totalGigabytesUsed | 40 | | totalSnapshotsUsed | 0 | | totalBackupsUsed | 0 | | totalBackupGigabytesUsed | 0 | +--------------------------+---------+ + pushd /opt/ciman/openstack-hot /opt/ciman/openstack-hot /w/workspace/openflowplugin-csit-1node-scale-switch-only-titanium + lftools openstack --os-cloud vex stack create releng-openflowplugin-csit-1node-scale-switch-only-titanium-41 csit-2-instance-type.yaml /w/workspace/openflowplugin-csit-1node-scale-switch-only-titanium/stack-parameters.yaml Creating stack releng-openflowplugin-csit-1node-scale-switch-only-titanium-41 WARN: Failed to initialize stack. Reason: Resource CREATE failed: NotFound: resources.vm_1_group.resources[0].resources.instance: Instance 9035b3e4-e084-4da2-9902-c3922dfd7c04 could not be found. (HTTP 404) (Request-ID: req-2ea39573-1656-4ad4-be2e-6f15727eb8e1) TypeError: delete() missing 1 required positional argument: 'force' Build step 'Execute shell' marked build as failure $ ssh-agent -k unset SSH_AUTH_SOCK; unset SSH_AGENT_PID; echo Agent pid 5282 killed; [ssh-agent] Stopped. Recording plot data Robot results publisher started... INFO: Checking test criticality is deprecated and will be dropped in a future release! -Parsing output xml: Failed! hudson.AbortException: No files found in path /w/workspace/openflowplugin-csit-1node-scale-switch-only-titanium with configured filemask: output.xml at hudson.plugins.robot.RobotParser$RobotParserCallable.invoke(RobotParser.java:81) at hudson.plugins.robot.RobotParser$RobotParserCallable.invoke(RobotParser.java:52) at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3616) at hudson.remoting.UserRequest.perform(UserRequest.java:211) at hudson.remoting.UserRequest.perform(UserRequest.java:54) at hudson.remoting.Request$2.run(Request.java:377) at hudson.remoting.InterceptingExecutorService.lambda$wrap$0(InterceptingExecutorService.java:78) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:829) Suppressed: hudson.remoting.Channel$CallSiteStackTrace: Remote call to prd-centos8-robot-2c-8g-39469 at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1787) at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:356) at hudson.remoting.Channel.call(Channel.java:1003) at hudson.FilePath.act(FilePath.java:1230) at hudson.FilePath.act(FilePath.java:1219) at hudson.plugins.robot.RobotParser.parse(RobotParser.java:48) at hudson.plugins.robot.RobotPublisher.parse(RobotPublisher.java:246) at hudson.plugins.robot.RobotPublisher.perform(RobotPublisher.java:268) at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:80) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:818) at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:767) at hudson.model.Build$BuildExecution.post2(Build.java:179) at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:711) at hudson.model.Run.execute(Run.java:1918) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44) at hudson.model.ResourceController.execute(ResourceController.java:101) at hudson.model.Executor.run(Executor.java:442) [PostBuildScript] - [INFO] Executing post build scripts. [openflowplugin-csit-1node-scale-switch-only-titanium] $ /bin/bash /tmp/jenkins12920808620732859961.sh Archiving csit artifacts seq: invalid floating point argument: ‘’ Try 'seq --help' for more information. % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 237 0 237 0 0 2135 0 --:--:-- --:--:-- --:--:-- 2135 Archive: robot-plugin.zip End-of-central-directory signature not found. Either this file is not a zipfile, or it constitutes one disk of a multi-part archive. In the latter case the central directory and zipfile comment will be found on the last disk(s) of this archive. unzip: cannot find zipfile directory in one of robot-plugin.zip or robot-plugin.zip.zip, and cannot find robot-plugin.zip.ZIP, period. mv: cannot stat '*.log': No such file or directory mv: cannot stat '*.log.gz': No such file or directory mv: cannot stat '*.csv': No such file or directory mv: cannot stat '*.png': No such file or directory [PostBuildScript] - [INFO] Executing post build scripts. [openflowplugin-csit-1node-scale-switch-only-titanium] $ /bin/bash /tmp/jenkins1375363080620805918.sh [PostBuildScript] - [INFO] Executing post build scripts. [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_CLOUD=vex OS_STACK_NAME=releng-openflowplugin-csit-1node-scale-switch-only-titanium-41 [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [openflowplugin-csit-1node-scale-switch-only-titanium] $ /bin/bash /tmp/jenkins6736900709225876917.sh ---> openstack-stack-delete.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/openflowplugin-csit-1node-scale-switch-only-titanium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-I1XH from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient lf-activate-venv(): INFO: Adding /tmp/venv-I1XH/bin to PATH INFO: Retrieving stack cost for: releng-openflowplugin-csit-1node-scale-switch-only-titanium-41 TypeError: strptime() argument 1 must be str, not None WARNING: Unable to get stack costs, continuing anyway INFO: Deleting stack releng-openflowplugin-csit-1node-scale-switch-only-titanium-41 WARN: Failed to delete $STACK_NAME. Reason: Resource DELETE failed: RemoteError: resources.vm_0_group: Remote error: DBReferenceError (pymysql.err.IntegrityError) (1452, 'Cannot add or update a child row: a foreign key constraint fails (`heat`.`stack`, CONSTRAINT `stack_ibfk_1` FOREIGN KEY (`raw_template_id`) REFERENCES `raw_template` (`id`) ON DELETE RESTRICT ON UPDATE RESTRICT)') [SQL: UPDATE stack SET `action`=%(action)s, `status`=%(status)s, status_reason=%(status_reason)s, name=%(name)s, raw_template_id=%(raw_template_id)s, prev_raw_template_id=%(prev_raw_template_id)s, username=%(username)s, tenant=%(tenant)s, user_creds_id=%(user_creds_id)s, owner_id=%(owner_id)s, parent_resource_name=%(parent_resource_name)s, timeout=%(timeout)s, disable_rollback=%(disable_rollback)s, stack_user_project_id=%(stack_user_project_id)s, backup=%(backup)s, nested_depth=%(nested_depth)s, convergence=%(convergence)s, current_traversal=%(current_traversal)s, current_deps=%(current_deps)s, updated_at=%(updated_at)s WHERE stack.id = %(id_1)s AND stack.deleted_at IS NULL AND (stack.tenant = %(tenant_1)s OR stack.stack_user_project_id = %(stack_user_project_id_1)s) AND stack.current_traversal = %(current_traversal_1)s] [parameters: {'action': 'DELETE', 'status': 'IN_PROGRESS', 'status_reason': 'Stack DELETE started', 'name': 'releng-openflowplugin-csit-1node-scale-switch-only-titanium-41-vm_0_group-riykgfcnnka6', 'raw_template_id': 21117645, 'prev_raw_template_id': 21117615, 'username': ****, 'tenant': '12c36e260d8e4bb2913965203b1b491f', 'user_creds_id': 1842082, 'owner_id': '22e0a1d1-36d9-4566-85e0-79f9c3ec4cf8', 'parent_resource_name': 'vm_0_group', 'timeout': 15, 'disable_rollback': 1, 'stack_user_project_id': '5386eea949284300bdcbad2bd7e966cd', 'backup': 0, 'nested_depth': 1, 'convergence': 1, 'current_traversal': 'c85ce7fe-4b0e-4da5-98c1-7af431306c24', 'current_deps': '{"edges": [[[17475712, true], null]]}', 'updated_at': datetime.datetime(2024, 10, 6, 3, 1, 48, 939114), 'id_1': '25447d30-61bd-4004-a63f-bef7a0a212e4', 'tenant_1': '12c36e260d8e4bb2913965203b1b491f', 'stack_user_project_id_1': '12c36e260d8e4bb2913965203b1b491f', 'current_traversal_1': '769f00f7-a377-4373-9fed-c9aa83ead40b'}] (Background on this error at: http://sqlalche.me/e/13/gkpj) ['Traceback (most recent call last):\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context\n self.dialect.do_execute(\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute\n cursor.execute(statement, parameters)\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/pymysql/cursors.py", line 148, in execute\n result = self._query(query)\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/pymysql/cursors.py", line 310, in _query\n conn.query(q)\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/pymysql/connections.py", line 548, in query\n self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/pymysql/connections.py", line 775, in _read_query_result\n result.read()\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/pymysql/connections.py", line 1156, in read\n first_packet = self.connection._read_packet()\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/pymysql/connections.py", line 725, in _read_packet\n packet.raise_for_error()\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/pymysql/protocol.py", line 221, in raise_for_error\n err.raise_mysql_exception(self._data)\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/pymysql/err.py", line 143, in raise_mysql_exception\n raise errorclass(errno, errval)\n', "pymysql.err.IntegrityError: (1452, 'Cannot add or update a child row: a foreign key constraint fails (`heat`.`stack`, CONSTRAINT `stack_ibfk_1` FOREIGN KEY (`raw_template_id`) REFERENCES `raw_template` (`id`) ON DELETE RESTRICT ON UPDATE RESTRICT)')\n", '\nThe above exception was the direct cause of the following exception:\n\n', 'Traceback (most recent call last):\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming\n res = self.dispatcher.dispatch(message)\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch\n return self._do_dispatch(endpoint, method, ctxt, args)\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch\n result = func(ctxt, **new_args)\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/osprofiler/profiler.py", line 160, in wrapper\n result = f(*args, **kwargs)\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/heat/common/context.py", line 416, in wrapped\n return func(self, ctx, *args, **kwargs)\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/heat/engine/service.py", line 1444, in delete_stack\n stack.converge_stack(template=template, action=stack.DELETE,\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/osprofiler/profiler.py", line 160, in wrapper\n result = f(*args, **kwargs)\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/heat/engine/stack.py", line 85, in handle_exceptions\n LOG.error(\'Unexpected exception in %(func)s: %(msg)s\',\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/heat/engine/stack.py", line 81, in handle_exceptions\n return func(stack, *args, **kwargs)\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/heat/engine/stack.py", line 1432, in converge_stack\n stack_id = self.store(exp_trvsl=previous_traversal)\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/osprofiler/profiler.py", line 160, in wrapper\n result = f(*args, **kwargs)\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/heat/engine/stack.py", line 744, in store\n updated = stack_object.Stack.select_and_update(\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/heat/objects/stack.py", line 215, in select_and_update\n return db_api.stack_update(context, stack_id, values,\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/heat/db/sqlalchemy/api.py", line 110, in try_func\n return wrapped(context, *args, **kwargs)\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/oslo_db/api.py", line 154, in wrapper\n ectxt.value = e.inner_exc\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/oslo_db/api.py", line 142, in wrapper\n return f(*args, **kwargs)\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/heat/db/sqlalchemy/api.py", line 831, in stack_update\n rows_updated = query.update(values, synchronize_session=False)\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/sqlalchemy/orm/query.py", line 4063, in update\n update_op.exec_()\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/sqlalchemy/orm/persistence.py", line 1697, in exec_\n self._do_exec()\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/sqlalchemy/orm/persistence.py", line 1895, in _do_exec\n self._execute_stmt(update_stmt)\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/sqlalchemy/orm/persistence.py", line 1702, in _execute_stmt\n self.result = self.query._execute_crud(stmt, self.mapper)\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/sqlalchemy/orm/query.py", line 3568, in _execute_crud\n return conn.execute(stmt, self._params)\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1011, in execute\n return meth(self, multiparams, params)\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection\n return connection._execute_clauseelement(self, multiparams, params)\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement\n ret = self._execute_context(\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context\n self._handle_dbapi_exception(\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1508, in _handle_dbapi_exception\n util.raise_(newraise, with_traceback=exc_info[2], from_=e)\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/sqlalchemy/util/compat.py", line 182, in raise_\n raise exception\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context\n self.dialect.do_execute(\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute\n cursor.execute(statement, parameters)\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/pymysql/cursors.py", line 148, in execute\n result = self._query(query)\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/pymysql/cursors.py", line 310, in _query\n conn.query(q)\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/pymysql/connections.py", line 548, in query\n self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/pymysql/connections.py", line 775, in _read_query_result\n result.read()\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/pymysql/connections.py", line 1156, in read\n first_packet = self.connection._read_packet()\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/pymysql/connections.py", line 725, in _read_packet\n packet.raise_for_error()\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/pymysql/protocol.py", line 221, in raise_for_error\n err.raise_mysql_exception(self._data)\n', ' File "/var/lib/openstack/lib/python3.8/site-packages/pymysql/err.py", line 143, in raise_mysql_exception\n raise errorclass(errno, errval)\n', 'oslo_db.exception.DBReferenceError: (pymysql.err.IntegrityError) (1452, \'Cannot add or update a child row: a foreign key constraint fails (`heat`.`stack`, CONSTRAINT `stack_ibfk_1` FOREIGN KEY (`raw_template_id`) REFERENCES `raw_template` (`id`) ON DELETE RESTRICT ON UPDATE RESTRICT)\')\n[SQL: UPDATE stack SET `action`=%(action)s, `status`=%(status)s, status_reason=%(status_reason)s, name=%(name)s, raw_template_id=%(raw_template_id)s, prev_raw_template_id=%(prev_raw_template_id)s, username=%(username)s, tenant=%(tenant)s, user_creds_id=%(user_creds_id)s, owner_id=%(owner_id)s, parent_resource_name=%(parent_resource_name)s, timeout=%(timeout)s, disable_rollback=%(disable_rollback)s, stack_user_project_id=%(stack_user_project_id)s, backup=%(backup)s, nested_depth=%(nested_depth)s, convergence=%(convergence)s, current_traversal=%(current_traversal)s, current_deps=%(current_deps)s, updated_at=%(updated_at)s WHERE stack.id = %(id_1)s AND stack.deleted_at IS NULL AND (stack.tenant = %(tenant_1)s OR stack.stack_user_project_id = %(stack_user_project_id_1)s) AND stack.current_traversal = %(current_traversal_1)s]\n[parameters: {\'action\': \'DELETE\', \'status\': \'IN_PROGRESS\', \'status_reason\': \'Stack DELETE started\', \'name\': \'releng-openflowplugin-csit-1node-scale-switch-only-titanium-41-vm_0_group-riykgfcnnka6\', \'raw_template_id\': 21117645, \'prev_raw_template_id\': 21117615, \'username\': \'****\', \'tenant\': \'12c36e260d8e4bb2913965203b1b491f\', \'user_creds_id\': 1842082, \'owner_id\': \'22e0a1d1-36d9-4566-85e0-79f9c3ec4cf8\', \'parent_resource_name\': \'vm_0_group\', \'timeout\': 15, \'disable_rollback\': 1, \'stack_user_project_id\': \'5386eea949284300bdcbad2bd7e966cd\', \'backup\': 0, \'nested_depth\': 1, \'convergence\': 1, \'current_traversal\': \'c85ce7fe-4b0e-4da5-98c1-7af431306c24\', \'current_deps\': \'{"edges": [[[17475712, true], null]]}\', \'updated_at\': datetime.datetime(2024, 10, 6, 3, 1, 48, 939114), \'id_1\': \'25447d30-61bd-4004-a63f-bef7a0a212e4\', \'tenant_1\': \'12c36e260d8e4bb2913965203b1b491f\', \'stack_user_project_id_1\': \'12c36e260d8e4bb2913965203b1b491f\', \'current_traversal_1\': \'769f00f7-a377-4373-9fed-c9aa83ead40b\'}]\n(Background on this error at: http://sqlalche.me/e/13/gkpj)\n']. Retrying delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Failed to delete stack releng-openflowplugin-csit-1node-scale-switch-only-titanium-41 [PostBuildScript] - [INFO] Executing post build scripts. [openflowplugin-csit-1node-scale-switch-only-titanium] $ /bin/bash /tmp/jenkins14459366445052164387.sh ---> sysstat.sh [openflowplugin-csit-1node-scale-switch-only-titanium] $ /bin/bash /tmp/jenkins9025948324715690464.sh ---> package-listing.sh ++ facter osfamily ++ tr '[:upper:]' '[:lower:]' + OS_FAMILY=redhat + workspace=/w/workspace/openflowplugin-csit-1node-scale-switch-only-titanium + START_PACKAGES=/tmp/packages_start.txt + END_PACKAGES=/tmp/packages_end.txt + DIFF_PACKAGES=/tmp/packages_diff.txt + PACKAGES=/tmp/packages_start.txt + '[' /w/workspace/openflowplugin-csit-1node-scale-switch-only-titanium ']' + PACKAGES=/tmp/packages_end.txt + case "${OS_FAMILY}" in + rpm -qa + sort + '[' -f /tmp/packages_start.txt ']' + '[' -f /tmp/packages_end.txt ']' + diff /tmp/packages_start.txt /tmp/packages_end.txt + '[' /w/workspace/openflowplugin-csit-1node-scale-switch-only-titanium ']' + mkdir -p /w/workspace/openflowplugin-csit-1node-scale-switch-only-titanium/archives/ + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/openflowplugin-csit-1node-scale-switch-only-titanium/archives/ [openflowplugin-csit-1node-scale-switch-only-titanium] $ /bin/bash /tmp/jenkins2823699352699332438.sh ---> capture-instance-metadata.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/openflowplugin-csit-1node-scale-switch-only-titanium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-I1XH from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-I1XH/bin to PATH INFO: Running in OpenStack, capturing instance metadata [openflowplugin-csit-1node-scale-switch-only-titanium] $ /bin/bash /tmp/jenkins13405656457436829831.sh provisioning config files... Could not find credentials [logs] for openflowplugin-csit-1node-scale-switch-only-titanium #41 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/openflowplugin-csit-1node-scale-switch-only-titanium@tmp/config13366114011423623685tmp Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] Run condition [Regular expression match] enabling perform for step [Provide Configuration files] provisioning config files... copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content SERVER_ID=logs [EnvInject] - Variables injected successfully. [openflowplugin-csit-1node-scale-switch-only-titanium] $ /bin/bash /tmp/jenkins15657646852007046217.sh ---> create-netrc.sh WARN: Log server credential not found. [openflowplugin-csit-1node-scale-switch-only-titanium] $ /bin/bash /tmp/jenkins7180035682375620242.sh ---> python-tools-install.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/openflowplugin-csit-1node-scale-switch-only-titanium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-I1XH from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-I1XH/bin to PATH [openflowplugin-csit-1node-scale-switch-only-titanium] $ /bin/bash /tmp/jenkins3640665216808385923.sh ---> sudo-logs.sh Archiving 'sudo' log.. [openflowplugin-csit-1node-scale-switch-only-titanium] $ /bin/bash /tmp/jenkins5733056937440780757.sh ---> job-cost.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/openflowplugin-csit-1node-scale-switch-only-titanium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-I1XH from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 lf-activate-venv(): INFO: Adding /tmp/venv-I1XH/bin to PATH DEBUG: total: 0 INFO: Retrieving Stack Cost... INFO: Retrieving Pricing Info for: v3-standard-2 INFO: Archiving Costs [openflowplugin-csit-1node-scale-switch-only-titanium] $ /bin/bash -l /tmp/jenkins12933185616756844609.sh ---> logs-deploy.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/openflowplugin-csit-1node-scale-switch-only-titanium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-I1XH from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-I1XH/bin to PATH WARNING: Nexus logging server not set INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/openflowplugin-csit-1node-scale-switch-only-titanium/41/ INFO: archiving logs to S3 ---> uname -a: Linux prd-centos8-robot-2c-8g-39469.novalocal 4.18.0-553.5.1.el8.x86_64 #1 SMP Tue May 21 05:46:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux ---> lscpu: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 1 Socket(s): 2 NUMA node(s): 1 Vendor ID: AuthenticAMD CPU family: 23 Model: 49 Model name: AMD EPYC-Rome Processor Stepping: 0 CPU MHz: 2800.000 BogoMIPS: 5600.00 Virtualization: AMD-V Hypervisor vendor: KVM Virtualization type: full L1d cache: 32K L1i cache: 32K L2 cache: 512K L3 cache: 16384K NUMA node0 CPU(s): 0,1 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities ---> nproc: 2 ---> df -h: Filesystem Size Used Avail Use% Mounted on devtmpfs 3.8G 0 3.8G 0% /dev tmpfs 3.8G 0 3.8G 0% /dev/shm tmpfs 3.8G 17M 3.8G 1% /run tmpfs 3.8G 0 3.8G 0% /sys/fs/cgroup /dev/vda1 40G 8.2G 32G 21% / tmpfs 770M 0 770M 0% /run/user/1001 ---> free -m: total used free shared buff/cache available Mem: 7697 573 5032 19 2091 6828 Swap: 1023 0 1023 ---> ip addr: 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: mtu 1458 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:ce:2b:98 brd ff:ff:ff:ff:ff:ff altname enp0s3 altname ens3 inet 10.30.170.219/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0 valid_lft 85255sec preferred_lft 85255sec inet6 fe80::f816:3eff:fece:2b98/64 scope link valid_lft forever preferred_lft forever ---> sar -b -r -n DEV: Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-robot-7d7a37eb-bc14-4dd6-9530-dc22c5eae738.noval) 10/06/2024 _x86_64_ (2 CPU) 02:58:19 LINUX RESTART (2 CPU) 02:59:01 AM tps rtps wtps bread/s bwrtn/s 03:00:01 AM 111.59 52.77 58.82 7188.41 12065.68 03:01:01 AM 87.67 0.28 87.39 20.13 8601.95 03:02:01 AM 32.63 0.73 31.90 67.72 3686.56 03:03:01 AM 1.60 0.00 1.60 0.00 26.66 03:04:01 AM 0.17 0.00 0.17 0.00 1.42 03:05:01 AM 0.28 0.00 0.28 0.00 4.17 03:06:01 AM 0.10 0.00 0.10 0.00 1.03 03:07:01 AM 0.12 0.00 0.12 0.00 0.80 03:08:01 AM 0.13 0.00 0.13 0.00 0.92 03:09:01 AM 0.30 0.00 0.30 0.00 4.70 03:10:01 AM 0.20 0.00 0.20 0.00 2.77 03:11:01 AM 0.25 0.00 0.25 0.00 2.43 03:12:01 AM 0.15 0.00 0.15 0.00 2.00 03:13:01 AM 0.13 0.00 0.13 0.00 1.32 03:14:01 AM 1.42 0.03 1.38 0.27 32.61 03:15:01 AM 0.20 0.00 0.20 0.00 3.08 03:16:01 AM 0.17 0.00 0.17 0.00 1.18 03:17:01 AM 6.96 0.48 6.48 67.31 115.06 Average: 13.56 3.02 10.55 408.05 1364.57 02:59:01 AM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 03:00:01 AM 5340376 7016588 2542056 32.25 2688 1863692 722604 8.09 226884 2012556 137492 03:01:01 AM 5206252 7035884 2676180 33.95 2688 2006184 670348 7.51 211864 2117168 90028 03:02:01 AM 5172188 7003552 2710244 34.38 2688 2008332 711884 7.97 249376 2114272 8 03:03:01 AM 5172772 7004120 2709660 34.38 2688 2008332 711884 7.97 249376 2114076 4 03:04:01 AM 5172908 7004252 2709524 34.37 2688 2008336 711884 7.97 249376 2114088 4 03:05:01 AM 5173040 7004384 2709392 34.37 2688 2008336 711884 7.97 249376 2114156 4 03:06:01 AM 5172856 7004200 2709576 34.37 2688 2008336 711884 7.97 249376 2114092 4 03:07:01 AM 5172784 7004132 2709648 34.38 2688 2008340 711884 7.97 249376 2114100 4 03:08:01 AM 5172764 7004112 2709668 34.38 2688 2008340 711884 7.97 249376 2114104 4 03:09:01 AM 5172688 7004036 2709744 34.38 2688 2008340 711884 7.97 249376 2114108 4 03:10:01 AM 5172208 7003560 2710224 34.38 2688 2008344 702948 7.87 249376 2114712 8 03:11:01 AM 5172192 7003548 2710240 34.38 2688 2008344 702948 7.87 249376 2114264 8 03:12:01 AM 5172300 7003660 2710132 34.38 2688 2008348 702948 7.87 249376 2114268 4 03:13:01 AM 5172284 7003644 2710148 34.38 2688 2008348 702948 7.87 249376 2114548 4 03:14:01 AM 5172572 7003936 2709860 34.38 2688 2008352 718588 8.05 249568 2114104 4 03:15:01 AM 5172280 7003648 2710152 34.38 2688 2008356 718588 8.05 249568 2114300 4 03:16:01 AM 5172440 7003808 2709992 34.38 2688 2008356 718588 8.05 249568 2114244 4 03:17:01 AM 5198836 7032416 2683596 34.05 2688 2010576 670680 7.51 406748 1931592 220 Average: 5185208 7007971 2697224 34.22 2688 2000311 707014 7.92 254817 2098597 12656 02:59:01 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 03:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:00:01 AM eth0 294.69 195.19 1574.51 59.55 0.00 0.00 0.00 0.00 03:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:01:01 AM eth0 64.28 53.02 612.42 8.42 0.00 0.00 0.00 0.00 03:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:02:01 AM eth0 16.66 13.09 15.55 5.90 0.00 0.00 0.00 0.00 03:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:03:01 AM eth0 1.17 0.47 0.40 0.15 0.00 0.00 0.00 0.00 03:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:04:01 AM eth0 0.88 0.43 0.45 0.15 0.00 0.00 0.00 0.00 03:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:05:01 AM eth0 0.83 0.47 0.48 0.21 0.00 0.00 0.00 0.00 03:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:06:01 AM eth0 0.83 0.33 0.35 0.14 0.00 0.00 0.00 0.00 03:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:07:01 AM eth0 0.68 0.38 0.35 0.14 0.00 0.00 0.00 0.00 03:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:08:01 AM eth0 0.83 0.40 0.35 0.14 0.00 0.00 0.00 0.00 03:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:09:01 AM eth0 4.58 0.38 0.79 0.14 0.00 0.00 0.00 0.00 03:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:10:01 AM eth0 2.05 0.97 1.31 0.78 0.00 0.00 0.00 0.00 03:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:11:01 AM eth0 4.92 0.40 77.34 0.14 0.00 0.00 0.00 0.00 03:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:12:01 AM eth0 2.82 0.33 0.59 0.12 0.00 0.00 0.00 0.00 03:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:13:01 AM eth0 1.22 0.58 0.61 0.34 0.00 0.00 0.00 0.00 03:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:14:01 AM eth0 0.72 0.38 0.35 0.14 0.00 0.00 0.00 0.00 03:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:15:01 AM eth0 0.93 0.57 0.49 0.24 0.00 0.00 0.00 0.00 03:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:16:01 AM eth0 0.78 0.38 0.35 0.14 0.00 0.00 0.00 0.00 03:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:17:01 AM eth0 11.95 10.06 8.76 15.87 0.00 0.00 0.00 0.00 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 Average: eth0 22.83 15.44 127.54 5.15 0.00 0.00 0.00 0.00 ---> sar -P ALL: Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-robot-7d7a37eb-bc14-4dd6-9530-dc22c5eae738.noval) 10/06/2024 _x86_64_ (2 CPU) 02:58:19 LINUX RESTART (2 CPU) 02:59:01 AM CPU %user %nice %system %iowait %steal %idle 03:00:01 AM all 38.98 0.03 7.36 10.20 0.11 43.33 03:00:01 AM 0 36.65 0.02 6.46 7.92 0.10 48.84 03:00:01 AM 1 41.30 0.03 8.25 12.47 0.12 37.82 03:01:01 AM all 27.95 0.00 4.25 8.23 0.08 59.49 03:01:01 AM 0 20.20 0.00 3.87 6.74 0.07 69.12 03:01:01 AM 1 35.69 0.00 4.63 9.72 0.08 49.88 03:02:01 AM all 12.26 0.00 1.61 3.13 0.06 82.94 03:02:01 AM 0 7.92 0.00 1.77 2.12 0.05 88.14 03:02:01 AM 1 16.59 0.00 1.45 4.15 0.07 77.74 03:03:01 AM all 0.40 0.00 0.07 0.09 0.02 99.42 03:03:01 AM 0 0.63 0.00 0.05 0.18 0.02 99.12 03:03:01 AM 1 0.17 0.00 0.08 0.00 0.02 99.73 03:04:01 AM all 0.41 0.00 0.05 0.08 0.02 99.44 03:04:01 AM 0 0.57 0.00 0.05 0.00 0.02 99.37 03:04:01 AM 1 0.25 0.00 0.05 0.17 0.02 99.52 03:05:01 AM all 0.39 0.00 0.06 0.00 0.03 99.52 03:05:01 AM 0 0.58 0.00 0.08 0.00 0.03 99.30 03:05:01 AM 1 0.20 0.00 0.03 0.00 0.02 99.75 03:06:01 AM all 0.41 0.00 0.07 0.00 0.02 99.51 03:06:01 AM 0 0.72 0.00 0.07 0.00 0.02 99.20 03:06:01 AM 1 0.10 0.00 0.07 0.00 0.02 99.82 03:07:01 AM all 0.35 0.00 0.06 0.00 0.02 99.57 03:07:01 AM 0 0.57 0.00 0.05 0.00 0.02 99.37 03:07:01 AM 1 0.13 0.00 0.07 0.00 0.02 99.78 03:08:01 AM all 0.38 0.00 0.07 0.00 0.04 99.52 03:08:01 AM 0 0.25 0.00 0.07 0.00 0.02 99.67 03:08:01 AM 1 0.50 0.00 0.07 0.00 0.07 99.37 03:09:01 AM all 0.38 0.00 0.10 0.00 0.02 99.50 03:09:01 AM 0 0.42 0.00 0.08 0.00 0.02 99.48 03:09:01 AM 1 0.35 0.00 0.12 0.00 0.02 99.52 03:10:01 AM all 0.65 0.00 0.08 0.00 0.03 99.25 03:10:01 AM 0 0.58 0.00 0.10 0.00 0.03 99.28 03:10:01 AM 1 0.72 0.00 0.05 0.00 0.02 99.22 03:10:01 AM CPU %user %nice %system %iowait %steal %idle 03:11:01 AM all 0.40 0.00 0.06 0.02 0.02 99.51 03:11:01 AM 0 0.58 0.00 0.05 0.03 0.02 99.31 03:11:01 AM 1 0.22 0.00 0.07 0.00 0.02 99.70 03:12:01 AM all 0.40 0.00 0.05 0.00 0.03 99.52 03:12:01 AM 0 0.65 0.00 0.03 0.00 0.02 99.30 03:12:01 AM 1 0.15 0.00 0.07 0.00 0.03 99.75 03:13:01 AM all 0.41 0.00 0.05 0.00 0.03 99.52 03:13:01 AM 0 0.65 0.00 0.03 0.00 0.02 99.30 03:13:01 AM 1 0.17 0.00 0.07 0.00 0.03 99.73 03:14:01 AM all 0.44 0.00 0.18 0.03 0.02 99.33 03:14:01 AM 0 0.55 0.00 0.23 0.00 0.02 99.20 03:14:01 AM 1 0.33 0.00 0.12 0.07 0.02 99.47 03:15:01 AM all 0.42 0.00 0.06 0.00 0.03 99.49 03:15:01 AM 0 0.65 0.00 0.07 0.00 0.03 99.25 03:15:01 AM 1 0.18 0.00 0.05 0.00 0.03 99.73 03:16:01 AM all 0.40 0.00 0.05 0.00 0.02 99.53 03:16:01 AM 0 0.57 0.00 0.07 0.00 0.02 99.35 03:16:01 AM 1 0.23 0.00 0.03 0.00 0.02 99.72 03:17:01 AM all 11.04 0.00 1.43 0.34 0.04 87.14 03:17:01 AM 0 11.06 0.00 1.50 0.33 0.05 87.05 03:17:01 AM 1 11.03 0.00 1.35 0.35 0.03 87.24 Average: all 5.33 0.00 0.87 1.23 0.03 92.54 Average: 0 4.65 0.00 0.81 0.96 0.03 93.54 Average: 1 6.01 0.00 0.92 1.49 0.04 91.53