02:09:22  Started by upstream project "integration-distribution-mri-test-potassium" build number 54
02:09:22  originally caused by:
02:09:22   Started by timer
02:09:22  Running as SYSTEM
02:09:22  [EnvInject] - Loading node environment variables.
02:09:22  Building remotely on prd-centos8-robot-2c-8g-5217 (centos8-robot-2c-8g) in workspace /w/workspace/mdsal-csit-3node-netty-replicate-only-potassium
02:09:23  [ssh-agent] Looking for ssh-agent implementation...
02:09:23  [ssh-agent]   Exec ssh-agent (binary ssh-agent on a remote machine)
02:09:23  $ ssh-agent
02:09:23  SSH_AUTH_SOCK=/tmp/ssh-LyUqKGafhtou/agent.5291
02:09:23  SSH_AGENT_PID=5292
02:09:23  [ssh-agent] Started.
02:09:23  Running ssh-add (command line suppressed)
02:09:23  Identity added: /w/workspace/mdsal-csit-3node-netty-replicate-only-potassium@tmp/private_key_16014782683206210976.key (/w/workspace/mdsal-csit-3node-netty-replicate-only-potassium@tmp/private_key_16014782683206210976.key)
02:09:23  [ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key)
02:09:23  The recommended git tool is: NONE
02:09:26  using credential opendaylight-jenkins-ssh
02:09:26  Wiping out workspace first.
02:09:26  Cloning the remote Git repository
02:09:26  Cloning repository git://devvexx.opendaylight.org/mirror/integration/test
02:09:26   > git init /w/workspace/mdsal-csit-3node-netty-replicate-only-potassium/test # timeout=10
02:09:26  Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
02:09:26   > git --version # timeout=10
02:09:26   > git --version # 'git version 2.43.0'
02:09:26  using GIT_SSH to set credentials Release Engineering Jenkins Key
02:09:26  [INFO] Currently running in a labeled security context
02:09:26  [INFO] Currently SELinux is 'enforcing' on the host
02:09:26   > /usr/bin/chcon --type=ssh_home_t /w/workspace/mdsal-csit-3node-netty-replicate-only-potassium/test@tmp/jenkins-gitclient-ssh15321578656324793668.key
02:09:26  Verifying host key using known hosts file
02:09:26  You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
02:09:26   > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10
02:09:29   > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
02:09:29   > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
02:09:29   > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
02:09:29  Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
02:09:29  using GIT_SSH to set credentials Release Engineering Jenkins Key
02:09:29  [INFO] Currently running in a labeled security context
02:09:29  [INFO] Currently SELinux is 'enforcing' on the host
02:09:29   > /usr/bin/chcon --type=ssh_home_t /w/workspace/mdsal-csit-3node-netty-replicate-only-potassium/test@tmp/jenkins-gitclient-ssh16623970723302222548.key
02:09:29  Verifying host key using known hosts file
02:09:29  You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
02:09:29   > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10
02:09:29   > git rev-parse FETCH_HEAD^{commit} # timeout=10
02:09:29  Checking out Revision 8e32c4077c4413c889c852088ceb853f3a77402b (origin/master)
02:09:29   > git config core.sparsecheckout # timeout=10
02:09:29   > git checkout -f 8e32c4077c4413c889c852088ceb853f3a77402b # timeout=10
02:09:30  Commit message: "Adapt robot files to RFC 8040 (variables)"
02:09:30   > git rev-parse FETCH_HEAD^{commit} # timeout=10
02:09:30   > git rev-list --no-walk 9b1dc785cb09674c89e21810a9eb490eaae2d698 # timeout=10
02:09:30  No emails were triggered.
02:09:30  provisioning config files...
02:09:30  copy managed file [npmrc] to file:/home/jenkins/.npmrc
02:09:30  copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
02:09:30  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
02:09:30  [mdsal-csit-3node-netty-replicate-only-potassium] $ /bin/bash /tmp/jenkins1216690037158259708.sh
02:09:30  ---> python-tools-install.sh
02:09:30  Setup pyenv:
02:09:31    system
02:09:31  * 3.8.13 (set by /opt/pyenv/version)
02:09:31  * 3.9.13 (set by /opt/pyenv/version)
02:09:31  * 3.10.13 (set by /opt/pyenv/version)
02:09:31  * 3.11.7 (set by /opt/pyenv/version)
02:09:36  lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-k0YS
02:09:36  lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
02:09:40  lf-activate-venv(): INFO: Installing: lftools 
02:10:13  lf-activate-venv(): INFO: Adding /tmp/venv-k0YS/bin to PATH
02:10:13  Generating Requirements File
02:10:36  Python 3.11.7
02:10:36  pip 24.1.2 from /tmp/venv-k0YS/lib/python3.11/site-packages/pip (python 3.11)
02:10:37  appdirs==1.4.4
02:10:37  argcomplete==3.4.0
02:10:37  aspy.yaml==1.3.0
02:10:37  attrs==23.2.0
02:10:37  autopage==0.5.2
02:10:37  beautifulsoup4==4.12.3
02:10:37  boto3==1.34.149
02:10:37  botocore==1.34.149
02:10:37  bs4==0.0.2
02:10:37  cachetools==5.4.0
02:10:37  certifi==2024.7.4
02:10:37  cffi==1.16.0
02:10:37  cfgv==3.4.0
02:10:37  chardet==5.2.0
02:10:37  charset-normalizer==3.3.2
02:10:37  click==8.1.7
02:10:37  cliff==4.7.0
02:10:37  cmd2==2.4.3
02:10:37  cryptography==3.3.2
02:10:37  debtcollector==3.0.0
02:10:37  decorator==5.1.1
02:10:37  defusedxml==0.7.1
02:10:37  Deprecated==1.2.14
02:10:37  distlib==0.3.8
02:10:37  dnspython==2.6.1
02:10:37  docker==4.2.2
02:10:37  dogpile.cache==1.3.3
02:10:37  email_validator==2.2.0
02:10:37  filelock==3.15.4
02:10:37  future==1.0.0
02:10:37  gitdb==4.0.11
02:10:37  GitPython==3.1.43
02:10:37  google-auth==2.32.0
02:10:37  httplib2==0.22.0
02:10:37  identify==2.6.0
02:10:37  idna==3.7
02:10:37  importlib-resources==1.5.0
02:10:37  iso8601==2.1.0
02:10:37  Jinja2==3.1.4
02:10:37  jmespath==1.0.1
02:10:37  jsonpatch==1.33
02:10:37  jsonpointer==3.0.0
02:10:37  jsonschema==4.23.0
02:10:37  jsonschema-specifications==2023.12.1
02:10:37  keystoneauth1==5.7.0
02:10:37  kubernetes==30.1.0
02:10:37  lftools==0.37.10
02:10:37  lxml==5.2.2
02:10:37  MarkupSafe==2.1.5
02:10:37  msgpack==1.0.8
02:10:37  multi_key_dict==2.0.3
02:10:37  munch==4.0.0
02:10:37  netaddr==1.3.0
02:10:37  netifaces==0.11.0
02:10:37  niet==1.4.2
02:10:37  nodeenv==1.9.1
02:10:37  oauth2client==4.1.3
02:10:37  oauthlib==3.2.2
02:10:37  openstacksdk==3.3.0
02:10:37  os-client-config==2.1.0
02:10:37  os-service-types==1.7.0
02:10:37  osc-lib==3.1.0
02:10:37  oslo.config==9.5.0
02:10:37  oslo.context==5.5.0
02:10:37  oslo.i18n==6.3.0
02:10:37  oslo.log==6.1.1
02:10:37  oslo.serialization==5.4.0
02:10:37  oslo.utils==7.2.0
02:10:37  packaging==24.1
02:10:37  pbr==6.0.0
02:10:37  platformdirs==4.2.2
02:10:37  prettytable==3.10.2
02:10:37  pyasn1==0.6.0
02:10:37  pyasn1_modules==0.4.0
02:10:37  pycparser==2.22
02:10:37  pygerrit2==2.0.15
02:10:37  PyGithub==2.3.0
02:10:37  PyJWT==2.8.0
02:10:37  PyNaCl==1.5.0
02:10:37  pyparsing==2.4.7
02:10:37  pyperclip==1.9.0
02:10:37  pyrsistent==0.20.0
02:10:37  python-cinderclient==9.5.0
02:10:37  python-dateutil==2.9.0.post0
02:10:37  python-heatclient==3.5.0
02:10:37  python-jenkins==1.8.2
02:10:37  python-keystoneclient==5.4.0
02:10:37  python-magnumclient==4.6.0
02:10:37  python-novaclient==18.6.0
02:10:37  python-openstackclient==6.6.0
02:10:37  python-swiftclient==4.6.0
02:10:37  PyYAML==6.0.1
02:10:37  referencing==0.35.1
02:10:37  requests==2.32.3
02:10:37  requests-oauthlib==2.0.0
02:10:37  requestsexceptions==1.4.0
02:10:37  rfc3986==2.0.0
02:10:37  rpds-py==0.19.1
02:10:37  rsa==4.9
02:10:37  ruamel.yaml==0.18.6
02:10:37  ruamel.yaml.clib==0.2.8
02:10:37  s3transfer==0.10.2
02:10:37  simplejson==3.19.2
02:10:37  six==1.16.0
02:10:37  smmap==5.0.1
02:10:37  soupsieve==2.5
02:10:37  stevedore==5.2.0
02:10:37  tabulate==0.9.0
02:10:37  toml==0.10.2
02:10:37  tomlkit==0.13.0
02:10:37  tqdm==4.66.4
02:10:37  typing_extensions==4.12.2
02:10:37  tzdata==2024.1
02:10:37  urllib3==1.26.19
02:10:37  virtualenv==20.26.3
02:10:37  wcwidth==0.2.13
02:10:37  websocket-client==1.8.0
02:10:37  wrapt==1.16.0
02:10:37  xdg==6.0.0
02:10:37  xmltodict==0.13.0
02:10:37  yq==3.4.3
02:10:37  [EnvInject] - Injecting environment variables from a build step.
02:10:37  [EnvInject] - Injecting as environment variables the properties content 
02:10:37  OS_STACK_TEMPLATE=csit-2-instance-type.yaml
02:10:37  OS_CLOUD=vex
02:10:37  OS_STACK_NAME=releng-mdsal-csit-3node-netty-replicate-only-potassium-54
02:10:37  OS_STACK_TEMPLATE_DIR=openstack-hot
02:10:37  
02:10:37  [EnvInject] - Variables injected successfully.
02:10:37  provisioning config files...
02:10:37  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
02:10:38  [mdsal-csit-3node-netty-replicate-only-potassium] $ /bin/bash /tmp/jenkins5738438350659958166.sh
02:10:38  ---> Create parameters file for OpenStack HOT
02:10:38  OpenStack Heat parameters generated
02:10:38  -----------------------------------
02:10:38  parameters:
02:10:38      vm_0_count: '3'
02:10:38      vm_0_flavor: 'v3-standard-4'
02:10:38      vm_0_image: 'ZZCI - CentOS Stream 8 - builder - x86_64 - 20240601-160217.263'
02:10:38      vm_1_count: '1'
02:10:38      vm_1_flavor: 'v3-standard-2'
02:10:38      vm_1_image: 'ZZCI - Ubuntu 18.04 - mininet-ovs-28 - x86_64 - 20230601-180106.003'
02:10:38      
02:10:38      job_name: '17092-54'
02:10:38      silo: 'releng'
02:10:38  [mdsal-csit-3node-netty-replicate-only-potassium] $ /bin/bash -l /tmp/jenkins3336962449918984061.sh
02:10:38  ---> Create HEAT stack
02:10:38  + source /home/jenkins/lf-env.sh
02:10:38  + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
02:10:38  ++ mktemp -d /tmp/venv-XXXX
02:10:38  + lf_venv=/tmp/venv-AxT9
02:10:38  + local venv_file=/tmp/.os_lf_venv
02:10:38  + local python=python3
02:10:38  + local options
02:10:38  + local set_path=true
02:10:38  + local install_args=
02:10:38  ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
02:10:38  + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
02:10:38  + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
02:10:38  ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
02:10:38  + true
02:10:38  + case $1 in
02:10:38  + python=python3
02:10:38  + shift 2
02:10:38  + true
02:10:38  + case $1 in
02:10:38  + shift
02:10:38  + break
02:10:38  + case $python in
02:10:38  + local pkg_list=
02:10:38  + [[ -d /opt/pyenv ]]
02:10:38  + echo 'Setup pyenv:'
02:10:38  Setup pyenv:
02:10:38  + export PYENV_ROOT=/opt/pyenv
02:10:38  + PYENV_ROOT=/opt/pyenv
02:10:38  + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
02:10:38  + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
02:10:38  + pyenv versions
02:10:38    system
02:10:38    3.8.13
02:10:38    3.9.13
02:10:38    3.10.13
02:10:38  * 3.11.7 (set by /w/workspace/mdsal-csit-3node-netty-replicate-only-potassium/.python-version)
02:10:38  + command -v pyenv
02:10:38  ++ pyenv init - --no-rehash
02:10:38  + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); 
02:10:38  for i in ${!paths[@]}; do 
02:10:38  if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; 
02:10:38  fi; done; 
02:10:38  echo "${paths[*]}"'\'')"
02:10:38  export PATH="/opt/pyenv/shims:${PATH}"
02:10:38  export PYENV_SHELL=bash
02:10:38  source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\''
02:10:38  pyenv() {
02:10:38    local command
02:10:38    command="${1:-}"
02:10:38    if [ "$#" -gt 0 ]; then
02:10:38      shift
02:10:38    fi
02:10:38  
02:10:38    case "$command" in
02:10:38    rehash|shell)
02:10:38      eval "$(pyenv "sh-$command" "$@")"
02:10:38      ;;
02:10:38    *)
02:10:38      command pyenv "$command" "$@"
02:10:38      ;;
02:10:38    esac
02:10:38  }'
02:10:38  +++ bash --norc -ec 'IFS=:; paths=($PATH); 
02:10:38  for i in ${!paths[@]}; do 
02:10:38  if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; 
02:10:38  fi; done; 
02:10:38  echo "${paths[*]}"'
02:10:38  ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
02:10:38  ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
02:10:38  ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
02:10:38  ++ export PYENV_SHELL=bash
02:10:38  ++ PYENV_SHELL=bash
02:10:38  ++ source /opt/pyenv/libexec/../completions/pyenv.bash
02:10:38  +++ complete -F _pyenv pyenv
02:10:38  ++ lf-pyver python3
02:10:38  ++ local py_version_xy=python3
02:10:38  ++ local py_version_xyz=
02:10:38  ++ awk '{ print $1 }'
02:10:38  ++ pyenv versions
02:10:38  ++ local command
02:10:38  ++ command=versions
02:10:38  ++ '[' 1 -gt 0 ']'
02:10:38  ++ shift
02:10:38  ++ case "$command" in
02:10:38  ++ command pyenv versions
02:10:38  ++ pyenv versions
02:10:38  ++ sed 's/^[ *]* //'
02:10:38  ++ grep -E '^[0-9.]*[0-9]$'
02:10:38  ++ [[ ! -s /tmp/.pyenv_versions ]]
02:10:38  +++ grep '^3' /tmp/.pyenv_versions
02:10:38  +++ sort -V
02:10:38  +++ tail -n 1
02:10:38  ++ py_version_xyz=3.11.7
02:10:38  ++ [[ -z 3.11.7 ]]
02:10:38  ++ echo 3.11.7
02:10:38  ++ return 0
02:10:38  + pyenv local 3.11.7
02:10:38  + local command
02:10:38  + command=local
02:10:38  + '[' 2 -gt 0 ']'
02:10:38  + shift
02:10:38  + case "$command" in
02:10:38  + command pyenv local 3.11.7
02:10:38  + pyenv local 3.11.7
02:10:38  + for arg in "$@"
02:10:38  + case $arg in
02:10:38  + pkg_list+='lftools[openstack] '
02:10:38  + for arg in "$@"
02:10:38  + case $arg in
02:10:38  + pkg_list+='kubernetes '
02:10:38  + for arg in "$@"
02:10:38  + case $arg in
02:10:38  + pkg_list+='niet '
02:10:38  + for arg in "$@"
02:10:38  + case $arg in
02:10:38  + pkg_list+='python-heatclient '
02:10:38  + for arg in "$@"
02:10:38  + case $arg in
02:10:38  + pkg_list+='python-openstackclient '
02:10:38  + for arg in "$@"
02:10:38  + case $arg in
02:10:38  + pkg_list+='python-magnumclient '
02:10:38  + for arg in "$@"
02:10:38  + case $arg in
02:10:38  + pkg_list+='yq '
02:10:38  + [[ -f /tmp/.os_lf_venv ]]
02:10:38  ++ cat /tmp/.os_lf_venv
02:10:38  + lf_venv=/tmp/venv-k0YS
02:10:38  + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-k0YS from' file:/tmp/.os_lf_venv
02:10:38  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-k0YS from file:/tmp/.os_lf_venv
02:10:38  + /tmp/venv-k0YS/bin/python3 -m pip install --upgrade --quiet pip virtualenv
02:10:40  + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq  ]]
02:10:40  + echo 'lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq '
02:10:40  lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
02:10:40  + /tmp/venv-k0YS/bin/python3 -m pip install --upgrade --quiet --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
02:10:57  + type python3
02:10:57  + true
02:10:57  + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-k0YS/bin to PATH'
02:10:57  lf-activate-venv(): INFO: Adding /tmp/venv-k0YS/bin to PATH
02:10:57  + PATH=/tmp/venv-k0YS/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
02:10:57  + return 0
02:10:57  + openstack --os-cloud vex limits show --absolute
02:10:58  +--------------------------+---------+
02:10:58  | Name                     |   Value |
02:10:58  +--------------------------+---------+
02:10:58  | maxTotalInstances        |      -1 |
02:10:58  | maxTotalCores            |     450 |
02:10:58  | maxTotalRAMSize          | 1000000 |
02:10:58  | maxServerMeta            |     128 |
02:10:58  | maxImageMeta             |     128 |
02:10:58  | maxPersonality           |       5 |
02:10:58  | maxPersonalitySize       |   10240 |
02:10:58  | maxTotalKeypairs         |     100 |
02:10:58  | maxServerGroups          |      10 |
02:10:58  | maxServerGroupMembers    |      10 |
02:10:58  | maxTotalFloatingIps      |      -1 |
02:10:58  | maxSecurityGroups        |      -1 |
02:10:58  | maxSecurityGroupRules    |      -1 |
02:10:58  | totalRAMUsed             |  835584 |
02:10:58  | totalCoresUsed           |     204 |
02:10:58  | totalInstancesUsed       |      66 |
02:10:58  | totalFloatingIpsUsed     |       0 |
02:10:58  | totalSecurityGroupsUsed  |       0 |
02:10:58  | totalServerGroupsUsed    |       0 |
02:10:58  | maxTotalVolumes          |      -1 |
02:10:58  | maxTotalSnapshots        |      10 |
02:10:58  | maxTotalVolumeGigabytes  |    4096 |
02:10:58  | maxTotalBackups          |      10 |
02:10:58  | maxTotalBackupGigabytes  |    1000 |
02:10:58  | totalVolumesUsed         |       1 |
02:10:58  | totalGigabytesUsed       |      20 |
02:10:58  | totalSnapshotsUsed       |       0 |
02:10:58  | totalBackupsUsed         |       0 |
02:10:58  | totalBackupGigabytesUsed |       0 |
02:10:58  +--------------------------+---------+
02:10:58  + pushd /opt/ciman/openstack-hot
02:10:58  /opt/ciman/openstack-hot /w/workspace/mdsal-csit-3node-netty-replicate-only-potassium
02:10:58  + lftools openstack --os-cloud vex stack create releng-mdsal-csit-3node-netty-replicate-only-potassium-54 csit-2-instance-type.yaml /w/workspace/mdsal-csit-3node-netty-replicate-only-potassium/stack-parameters.yaml
02:11:13  Creating stack releng-mdsal-csit-3node-netty-replicate-only-potassium-54
02:11:13  WARN: Failed to initialize stack. Reason: Resource CREATE failed: Forbidden: resources.vm_1_group.resources[0].resources.instance: Quota exceeded for ram: Requested 8192, but already used 999424 of 1000000 ram (HTTP 403) (Request-ID: req-25bdf692-e97c-41b3-b1df-fb0ffa10f9a4)
02:11:13  TypeError: delete() missing 1 required positional argument: 'force'
02:11:13  Build step 'Execute shell' marked build as failure
02:11:13  $ ssh-agent -k
02:11:13  unset SSH_AUTH_SOCK;
02:11:13  unset SSH_AGENT_PID;
02:11:13  echo Agent pid 5292 killed;
02:11:13  [ssh-agent] Stopped.
02:11:13  Recording plot data
02:11:13  Robot results publisher started...
02:11:13  INFO: Checking test criticality is deprecated and will be dropped in a future release!
02:11:13  -Parsing output xml:
02:11:13  Failed!
02:11:13  hudson.AbortException: No files found in path /w/workspace/mdsal-csit-3node-netty-replicate-only-potassium with configured filemask: output.xml
02:11:13  	at hudson.plugins.robot.RobotParser$RobotParserCallable.invoke(RobotParser.java:81)
02:11:13  	at hudson.plugins.robot.RobotParser$RobotParserCallable.invoke(RobotParser.java:52)
02:11:13  	at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3616)
02:11:13  	at hudson.remoting.UserRequest.perform(UserRequest.java:211)
02:11:13  	at hudson.remoting.UserRequest.perform(UserRequest.java:54)
02:11:13  	at hudson.remoting.Request$2.run(Request.java:377)
02:11:13  	at hudson.remoting.InterceptingExecutorService.lambda$wrap$0(InterceptingExecutorService.java:78)
02:11:13  	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
02:11:13  	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
02:11:13  	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
02:11:13  	at java.base/java.lang.Thread.run(Thread.java:829)
02:11:13  	Suppressed: hudson.remoting.Channel$CallSiteStackTrace: Remote call to prd-centos8-robot-2c-8g-5217
02:11:13  		at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1787)
02:11:13  		at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:356)
02:11:13  		at hudson.remoting.Channel.call(Channel.java:1003)
02:11:13  		at hudson.FilePath.act(FilePath.java:1230)
02:11:13  		at hudson.FilePath.act(FilePath.java:1219)
02:11:13  		at hudson.plugins.robot.RobotParser.parse(RobotParser.java:48)
02:11:13  		at hudson.plugins.robot.RobotPublisher.parse(RobotPublisher.java:246)
02:11:13  		at hudson.plugins.robot.RobotPublisher.perform(RobotPublisher.java:268)
02:11:13  		at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:80)
02:11:13  		at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
02:11:13  		at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:818)
02:11:13  		at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:767)
02:11:13  		at hudson.model.Build$BuildExecution.post2(Build.java:179)
02:11:13  		at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:711)
02:11:13  		at hudson.model.Run.execute(Run.java:1918)
02:11:13  		at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44)
02:11:13  		at hudson.model.ResourceController.execute(ResourceController.java:101)
02:11:13  		at hudson.model.Executor.run(Executor.java:442)
02:11:13  [PostBuildScript] - [INFO] Executing post build scripts.
02:11:13  [mdsal-csit-3node-netty-replicate-only-potassium] $ /bin/bash /tmp/jenkins16243217231337669642.sh
02:11:13  Archiving csit artifacts
02:11:13  seq: invalid floating point argument: ‘’
02:11:13  Try 'seq --help' for more information.
02:11:13    % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
02:11:13                                   Dload  Upload   Total   Spent    Left  Speed
02:11:13  
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100   237    0   237    0     0   6236      0 --:--:-- --:--:-- --:--:--  6236
02:11:13  Archive:  robot-plugin.zip
02:11:13    End-of-central-directory signature not found.  Either this file is not
02:11:13    a zipfile, or it constitutes one disk of a multi-part archive.  In the
02:11:13    latter case the central directory and zipfile comment will be found on
02:11:13    the last disk(s) of this archive.
02:11:13  unzip:  cannot find zipfile directory in one of robot-plugin.zip or
02:11:13          robot-plugin.zip.zip, and cannot find robot-plugin.zip.ZIP, period.
02:11:13  mv: cannot stat '*.log': No such file or directory
02:11:13  mv: cannot stat '*.log.gz': No such file or directory
02:11:13  mv: cannot stat '*.csv': No such file or directory
02:11:13  mv: cannot stat '*.png': No such file or directory
02:11:13  [PostBuildScript] - [INFO] Executing post build scripts.
02:11:13  [mdsal-csit-3node-netty-replicate-only-potassium] $ /bin/bash /tmp/jenkins8966090416288499396.sh
02:11:13  [PostBuildScript] - [INFO] Executing post build scripts.
02:11:13  [EnvInject] - Injecting environment variables from a build step.
02:11:13  [EnvInject] - Injecting as environment variables the properties content 
02:11:13  OS_CLOUD=vex
02:11:13  OS_STACK_NAME=releng-mdsal-csit-3node-netty-replicate-only-potassium-54
02:11:13  
02:11:13  [EnvInject] - Variables injected successfully.
02:11:13  provisioning config files...
02:11:14  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
02:11:14  [mdsal-csit-3node-netty-replicate-only-potassium] $ /bin/bash /tmp/jenkins5960355051957014821.sh
02:11:14  ---> openstack-stack-delete.sh
02:11:14  Setup pyenv:
02:11:14    system
02:11:14    3.8.13
02:11:14    3.9.13
02:11:14    3.10.13
02:11:14  * 3.11.7 (set by /w/workspace/mdsal-csit-3node-netty-replicate-only-potassium/.python-version)
02:11:14  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-k0YS from file:/tmp/.os_lf_venv
02:11:27  lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient 
02:11:41  lf-activate-venv(): INFO: Adding /tmp/venv-k0YS/bin to PATH
02:11:41  INFO: Retrieving stack cost for: releng-mdsal-csit-3node-netty-replicate-only-potassium-54
02:11:44  openstack.exceptions.BadRequestException: BadRequestException: 400: Client Error for url: https://compute.public.mtl1.vexxhost.net/v2.1/12c36e260d8e4bb2913965203b1b491f/servers/detail?name=, Invalid input for query parameters name. Value: . '' is not a 'regex'
02:11:45  WARNING: Unable to get stack costs, continuing anyway
02:11:57  INFO: Deleting stack releng-mdsal-csit-3node-netty-replicate-only-potassium-54
02:11:57  Successfully deleted stack releng-mdsal-csit-3node-netty-replicate-only-potassium-54
02:11:57  [PostBuildScript] - [INFO] Executing post build scripts.
02:11:57  [mdsal-csit-3node-netty-replicate-only-potassium] $ /bin/bash /tmp/jenkins2607867023471954247.sh
02:11:57  ---> sysstat.sh
02:11:57  [mdsal-csit-3node-netty-replicate-only-potassium] $ /bin/bash /tmp/jenkins7729004885432716814.sh
02:11:57  ---> package-listing.sh
02:11:57  ++ facter osfamily
02:11:57  ++ tr '[:upper:]' '[:lower:]'
02:11:57  + OS_FAMILY=redhat
02:11:57  + workspace=/w/workspace/mdsal-csit-3node-netty-replicate-only-potassium
02:11:57  + START_PACKAGES=/tmp/packages_start.txt
02:11:57  + END_PACKAGES=/tmp/packages_end.txt
02:11:57  + DIFF_PACKAGES=/tmp/packages_diff.txt
02:11:57  + PACKAGES=/tmp/packages_start.txt
02:11:57  + '[' /w/workspace/mdsal-csit-3node-netty-replicate-only-potassium ']'
02:11:57  + PACKAGES=/tmp/packages_end.txt
02:11:57  + case "${OS_FAMILY}" in
02:11:57  + rpm -qa
02:11:57  + sort
02:11:58  + '[' -f /tmp/packages_start.txt ']'
02:11:58  + '[' -f /tmp/packages_end.txt ']'
02:11:58  + diff /tmp/packages_start.txt /tmp/packages_end.txt
02:11:58  + '[' /w/workspace/mdsal-csit-3node-netty-replicate-only-potassium ']'
02:11:58  + mkdir -p /w/workspace/mdsal-csit-3node-netty-replicate-only-potassium/archives/
02:11:58  + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/mdsal-csit-3node-netty-replicate-only-potassium/archives/
02:11:58  [mdsal-csit-3node-netty-replicate-only-potassium] $ /bin/bash /tmp/jenkins6956621577644929247.sh
02:11:58  ---> capture-instance-metadata.sh
02:11:58  Setup pyenv:
02:11:58    system
02:11:58    3.8.13
02:11:58    3.9.13
02:11:58    3.10.13
02:11:58  * 3.11.7 (set by /w/workspace/mdsal-csit-3node-netty-replicate-only-potassium/.python-version)
02:11:58  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-k0YS from file:/tmp/.os_lf_venv
02:11:59  lf-activate-venv(): INFO: Installing: lftools 
02:12:08  lf-activate-venv(): INFO: Adding /tmp/venv-k0YS/bin to PATH
02:12:08  INFO: Running in OpenStack, capturing instance metadata
02:12:09  [mdsal-csit-3node-netty-replicate-only-potassium] $ /bin/bash /tmp/jenkins11500584292593501060.sh
02:12:09  provisioning config files...
02:12:09  Could not find credentials [logs] for mdsal-csit-3node-netty-replicate-only-potassium #54
02:12:09  copy managed file [jenkins-log-archives-settings] to file:/w/workspace/mdsal-csit-3node-netty-replicate-only-potassium@tmp/config9828846962593811824tmp
02:12:09  Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index]
02:12:09  Run condition [Regular expression match] enabling perform for step [Provide Configuration files]
02:12:09  provisioning config files...
02:12:09  copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials
02:12:09  [EnvInject] - Injecting environment variables from a build step.
02:12:09  [EnvInject] - Injecting as environment variables the properties content 
02:12:09  SERVER_ID=logs
02:12:09  
02:12:09  [EnvInject] - Variables injected successfully.
02:12:09  [mdsal-csit-3node-netty-replicate-only-potassium] $ /bin/bash /tmp/jenkins9400999468025789859.sh
02:12:09  ---> create-netrc.sh
02:12:09  WARN: Log server credential not found.
02:12:09  [mdsal-csit-3node-netty-replicate-only-potassium] $ /bin/bash /tmp/jenkins9305782806822118022.sh
02:12:09  ---> python-tools-install.sh
02:12:09  Setup pyenv:
02:12:10    system
02:12:10    3.8.13
02:12:10    3.9.13
02:12:10    3.10.13
02:12:10  * 3.11.7 (set by /w/workspace/mdsal-csit-3node-netty-replicate-only-potassium/.python-version)
02:12:10  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-k0YS from file:/tmp/.os_lf_venv
02:12:11  lf-activate-venv(): INFO: Installing: lftools 
02:12:19  lf-activate-venv(): INFO: Adding /tmp/venv-k0YS/bin to PATH
02:12:19  [mdsal-csit-3node-netty-replicate-only-potassium] $ /bin/bash /tmp/jenkins7465486580690458741.sh
02:12:19  ---> sudo-logs.sh
02:12:19  Archiving 'sudo' log..
02:12:19  [mdsal-csit-3node-netty-replicate-only-potassium] $ /bin/bash /tmp/jenkins6372227334048029023.sh
02:12:19  ---> job-cost.sh
02:12:19  Setup pyenv:
02:12:20    system
02:12:20    3.8.13
02:12:20    3.9.13
02:12:20    3.10.13
02:12:20  * 3.11.7 (set by /w/workspace/mdsal-csit-3node-netty-replicate-only-potassium/.python-version)
02:12:20  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-k0YS from file:/tmp/.os_lf_venv
02:12:21  lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
02:12:27  lf-activate-venv(): INFO: Adding /tmp/venv-k0YS/bin to PATH
02:12:27  DEBUG: total: 0
02:12:27  INFO: Retrieving Stack Cost...
02:12:27  INFO: Retrieving Pricing Info for: v3-standard-2
02:12:27  INFO: Archiving Costs
02:12:27  [mdsal-csit-3node-netty-replicate-only-potassium] $ /bin/bash -l /tmp/jenkins11797318767694954724.sh
02:12:27  ---> logs-deploy.sh
02:12:27  Setup pyenv:
02:12:27    system
02:12:27    3.8.13
02:12:27    3.9.13
02:12:27    3.10.13
02:12:27  * 3.11.7 (set by /w/workspace/mdsal-csit-3node-netty-replicate-only-potassium/.python-version)
02:12:28  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-k0YS from file:/tmp/.os_lf_venv
02:12:29  lf-activate-venv(): INFO: Installing: lftools 
02:12:38  lf-activate-venv(): INFO: Adding /tmp/venv-k0YS/bin to PATH
02:12:38  WARNING: Nexus logging server not set
02:12:38  INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/mdsal-csit-3node-netty-replicate-only-potassium/54/
02:12:38  INFO: archiving logs to S3
02:12:39  ---> uname -a:
02:12:39  Linux prd-centos8-robot-2c-8g-5217.novalocal 4.18.0-553.5.1.el8.x86_64 #1 SMP Tue May 21 05:46:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
02:12:39  
02:12:39  
02:12:39  ---> lscpu:
02:12:39  Architecture:        x86_64
02:12:39  CPU op-mode(s):      32-bit, 64-bit
02:12:39  Byte Order:          Little Endian
02:12:39  CPU(s):              2
02:12:39  On-line CPU(s) list: 0,1
02:12:39  Thread(s) per core:  1
02:12:39  Core(s) per socket:  1
02:12:39  Socket(s):           2
02:12:39  NUMA node(s):        1
02:12:39  Vendor ID:           AuthenticAMD
02:12:39  CPU family:          23
02:12:39  Model:               49
02:12:39  Model name:          AMD EPYC-Rome Processor
02:12:39  Stepping:            0
02:12:39  CPU MHz:             2799.998
02:12:39  BogoMIPS:            5599.99
02:12:39  Virtualization:      AMD-V
02:12:39  Hypervisor vendor:   KVM
02:12:39  Virtualization type: full
02:12:39  L1d cache:           32K
02:12:39  L1i cache:           32K
02:12:39  L2 cache:            512K
02:12:39  L3 cache:            16384K
02:12:39  NUMA node0 CPU(s):   0,1
02:12:39  Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
02:12:39  
02:12:39  
02:12:39  ---> nproc:
02:12:39  2
02:12:39  
02:12:39  
02:12:39  ---> df -h:
02:12:39  Filesystem      Size  Used Avail Use% Mounted on
02:12:39  devtmpfs        3.8G     0  3.8G   0% /dev
02:12:39  tmpfs           3.8G     0  3.8G   0% /dev/shm
02:12:39  tmpfs           3.8G   17M  3.8G   1% /run
02:12:39  tmpfs           3.8G     0  3.8G   0% /sys/fs/cgroup
02:12:39  /dev/vda1        40G  8.3G   32G  21% /
02:12:39  tmpfs           770M     0  770M   0% /run/user/1001
02:12:39  
02:12:39  
02:12:39  ---> free -m:
02:12:39                total        used        free      shared  buff/cache   available
02:12:39  Mem:           7697         583        5031          19        2082        6819
02:12:39  Swap:          1023           0        1023
02:12:39  
02:12:39  
02:12:39  ---> ip addr:
02:12:39  1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
02:12:39      link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
02:12:39      inet 127.0.0.1/8 scope host lo
02:12:39         valid_lft forever preferred_lft forever
02:12:39      inet6 ::1/128 scope host 
02:12:39         valid_lft forever preferred_lft forever
02:12:39  2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1458 qdisc mq state UP group default qlen 1000
02:12:39      link/ether fa:16:3e:cb:ee:fd brd ff:ff:ff:ff:ff:ff
02:12:39      altname enp0s3
02:12:39      altname ens3
02:12:39      inet 10.30.170.233/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0
02:12:39         valid_lft 86140sec preferred_lft 86140sec
02:12:39      inet6 fe80::f816:3eff:fecb:eefd/64 scope link 
02:12:39         valid_lft forever preferred_lft forever
02:12:39  
02:12:39  
02:12:39  ---> sar -b -r -n DEV:
02:12:39  Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-robot-7d7a37eb-bc14-4dd6-9530-dc22c5eae738.noval) 	07/28/2024 	_x86_64_	(2 CPU)
02:12:39  
02:12:39  02:08:15     LINUX RESTART	(2 CPU)
02:12:39  
02:12:39  02:09:01 AM       tps      rtps      wtps   bread/s   bwrtn/s
02:12:39  02:10:01 AM    109.79     38.31     71.48   7056.27  20071.55
02:12:39  02:11:01 AM    101.28      5.51     95.77    128.84   8632.29
02:12:39  02:12:01 AM     29.87      0.28     29.59     44.65   3579.79
02:12:39  Average:        80.30     14.65     65.65   2400.31  10745.61
02:12:39  
02:12:39  02:09:01 AM kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
02:12:39  02:10:01 AM   5368412   7001000   2514012     31.89      2688   1822732    770200      8.62    194808   2021024    105512
02:12:39  02:11:01 AM   5174320   6996372   2708104     34.36      2688   1999052    712380      7.98    222836   2135684     86912
02:12:39  02:12:01 AM   5212064   7035220   2670360     33.88      2688   2000676    678140      7.59    407076   1916672       148
02:12:39  Average:      5251599   7010864   2630825     33.38      2688   1940820    720240      8.06    274907   2024460     64191
02:12:39  
02:12:39  02:09:01 AM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
02:12:39  02:10:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:12:39  02:10:01 AM      eth0    309.53    195.63   1586.65     60.40      0.00      0.00      0.00      0.00
02:12:39  02:11:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:12:39  02:11:01 AM      eth0     57.54     46.31    502.85      8.04      0.00      0.00      0.00      0.00
02:12:39  02:12:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:12:39  02:12:01 AM      eth0     26.29     14.30     18.79      7.15      0.00      0.00      0.00      0.00
02:12:39  Average:           lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:12:39  Average:         eth0    130.77     85.21    701.28     25.12      0.00      0.00      0.00      0.00
02:12:39  
02:12:39  
02:12:39  ---> sar -P ALL:
02:12:39  Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-robot-7d7a37eb-bc14-4dd6-9530-dc22c5eae738.noval) 	07/28/2024 	_x86_64_	(2 CPU)
02:12:39  
02:12:39  02:08:15     LINUX RESTART	(2 CPU)
02:12:39  
02:12:39  02:09:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:12:39  02:10:01 AM     all     29.19      0.03      6.42     22.30      0.10     41.96
02:12:39  02:10:01 AM       0     29.25      0.02      5.84     22.40      0.10     42.39
02:12:39  02:10:01 AM       1     29.12      0.05      7.00     22.19      0.10     41.53
02:12:39  02:11:01 AM     all     36.42      0.00      5.90      4.97      0.13     52.57
02:12:39  02:11:01 AM       0     27.62      0.00      5.29      4.71      0.13     62.24
02:12:39  02:11:01 AM       1     45.23      0.00      6.52      5.23      0.13     42.89
02:12:39  02:12:01 AM     all     14.97      0.00      2.07      4.80      0.04     78.12
02:12:39  02:12:01 AM       0     10.31      0.00      1.87      4.26      0.03     83.52
02:12:39  02:12:01 AM       1     19.62      0.00      2.27      5.34      0.05     72.71
02:12:39  Average:        all     26.86      0.01      4.79     10.63      0.09     57.62
02:12:39  Average:          0     22.37      0.01      4.33     10.40      0.09     62.81
02:12:39  Average:          1     31.35      0.02      5.25     10.86      0.10     52.43
02:12:39  
02:12:39  
02:12:39