Started by upstream project "integration-distribution-mri-test-argon" build number 71 originally caused by: Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on prd-centos8-robot-2c-8g-2516 (centos8-robot-2c-8g) in workspace /w/workspace/controller-csit-3node-clustering-ask-all-argon [ssh-agent] Looking for ssh-agent implementation... [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) $ ssh-agent SSH_AUTH_SOCK=/tmp/ssh-qKQksvxoRo7g/agent.5362 SSH_AGENT_PID=5363 [ssh-agent] Started. Running ssh-add (command line suppressed) Identity added: /w/workspace/controller-csit-3node-clustering-ask-all-argon@tmp/private_key_16043317755303421954.key (/w/workspace/controller-csit-3node-clustering-ask-all-argon@tmp/private_key_16043317755303421954.key) [ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key) The recommended git tool is: NONE using credential opendaylight-jenkins-ssh Wiping out workspace first. Cloning the remote Git repository Cloning repository git://devvexx.opendaylight.org/mirror/integration/test > git init /w/workspace/controller-csit-3node-clustering-ask-all-argon/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test > git --version # timeout=10 > git --version # 'git version 2.43.0' using GIT_SSH to set credentials Release Engineering Jenkins Key [INFO] Currently running in a labeled security context [INFO] Currently SELinux is 'enforcing' on the host > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-ask-all-argon/test@tmp/jenkins-gitclient-ssh16042210381568287323.key Verifying host key using known hosts file You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test using GIT_SSH to set credentials Release Engineering Jenkins Key [INFO] Currently running in a labeled security context [INFO] Currently SELinux is 'enforcing' on the host > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-ask-all-argon/test@tmp/jenkins-gitclient-ssh281952810014564855.key Verifying host key using known hosts file You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10 > git rev-parse FETCH_HEAD^{commit} # timeout=10 Checking out Revision 3e167848278e822e4d409e0cc71d967d06150361 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 3e167848278e822e4d409e0cc71d967d06150361 # timeout=10 Commit message: "Remove scriptplans for tsdr" > git rev-parse FETCH_HEAD^{commit} # timeout=10 > git rev-list --no-walk 83350b8bf5eb6c28e5756f6745044edb96843f07 # timeout=10 No emails were triggered. provisioning config files... copy managed file [npmrc] to file:/home/jenkins/.npmrc copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-clustering-ask-all-argon] $ /bin/bash /tmp/jenkins10197743027731619260.sh ---> python-tools-install.sh Setup pyenv: system * 3.8.13 (set by /opt/pyenv/version) * 3.9.13 (set by /opt/pyenv/version) * 3.10.6 (set by /opt/pyenv/version) lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-WK1U lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-WK1U/bin to PATH Generating Requirements File Python 3.10.6 pip 24.0 from /tmp/venv-WK1U/lib/python3.10/site-packages/pip (python 3.10) appdirs==1.4.4 argcomplete==3.2.2 aspy.yaml==1.3.0 attrs==23.2.0 autopage==0.5.2 beautifulsoup4==4.12.3 boto3==1.34.34 botocore==1.34.34 bs4==0.0.2 cachetools==5.3.2 certifi==2024.2.2 cffi==1.16.0 cfgv==3.4.0 chardet==5.2.0 charset-normalizer==3.3.2 click==8.1.7 cliff==4.5.0 cmd2==2.4.3 cryptography==3.3.2 debtcollector==2.5.0 decorator==5.1.1 defusedxml==0.7.1 Deprecated==1.2.14 distlib==0.3.8 dnspython==2.5.0 docker==4.2.2 dogpile.cache==1.3.0 email-validator==2.1.0.post1 filelock==3.13.1 future==0.18.3 gitdb==4.0.11 GitPython==3.1.41 google-auth==2.27.0 httplib2==0.22.0 identify==2.5.33 idna==3.6 importlib-resources==1.5.0 iso8601==2.1.0 Jinja2==3.1.3 jmespath==1.0.1 jsonpatch==1.33 jsonpointer==2.4 jsonschema==4.21.1 jsonschema-specifications==2023.12.1 keystoneauth1==5.5.0 kubernetes==29.0.0 lftools==0.37.8 lxml==5.1.0 MarkupSafe==2.1.5 msgpack==1.0.7 multi_key_dict==2.0.3 munch==4.0.0 netaddr==0.10.1 netifaces==0.11.0 niet==1.4.2 nodeenv==1.8.0 oauth2client==4.1.3 oauthlib==3.2.2 openstacksdk==0.62.0 os-client-config==2.1.0 os-service-types==1.7.0 osc-lib==3.0.0 oslo.config==9.3.0 oslo.context==5.3.0 oslo.i18n==6.2.0 oslo.log==5.4.0 oslo.serialization==5.3.0 oslo.utils==7.0.0 packaging==23.2 pbr==6.0.0 platformdirs==4.2.0 prettytable==3.9.0 pyasn1==0.5.1 pyasn1-modules==0.3.0 pycparser==2.21 pygerrit2==2.0.15 PyGithub==2.2.0 pyinotify==0.9.6 PyJWT==2.8.0 PyNaCl==1.5.0 pyparsing==2.4.7 pyperclip==1.8.2 pyrsistent==0.20.0 python-cinderclient==9.4.0 python-dateutil==2.8.2 python-heatclient==3.4.0 python-jenkins==1.8.2 python-keystoneclient==5.3.0 python-magnumclient==4.3.0 python-novaclient==18.4.0 python-openstackclient==6.0.0 python-swiftclient==4.4.0 pytz==2024.1 PyYAML==6.0.1 referencing==0.33.0 requests==2.31.0 requests-oauthlib==1.3.1 requestsexceptions==1.4.0 rfc3986==2.0.0 rpds-py==0.17.1 rsa==4.9 ruamel.yaml==0.18.5 ruamel.yaml.clib==0.2.8 s3transfer==0.10.0 simplejson==3.19.2 six==1.16.0 smmap==5.0.1 soupsieve==2.5 stevedore==5.1.0 tabulate==0.9.0 toml==0.10.2 tomlkit==0.12.3 tqdm==4.66.1 typing_extensions==4.9.0 tzdata==2023.4 urllib3==1.26.18 virtualenv==20.25.0 wcwidth==0.2.13 websocket-client==1.7.0 wrapt==1.16.0 xdg==6.0.0 xmltodict==0.13.0 yq==3.2.3 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_STACK_TEMPLATE=csit-2-instance-type.yaml OS_CLOUD=vex OS_STACK_NAME=releng-controller-csit-3node-clustering-ask-all-argon-71 OS_STACK_TEMPLATE_DIR=openstack-hot [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-clustering-ask-all-argon] $ /bin/bash /tmp/jenkins16314499710215737499.sh ---> Create parameters file for OpenStack HOT OpenStack Heat parameters generated ----------------------------------- parameters: vm_0_count: '3' vm_0_flavor: 'v3-standard-4' vm_0_image: 'ZZCI - CentOS Stream 8 - builder - x86_64 - 20240117-011746.201' vm_1_count: '0' vm_1_flavor: 'v3-standard-2' vm_1_image: 'ZZCI - Ubuntu 18.04 - mininet-ovs-28 - x86_64 - 20230601-180106.003' job_name: '11311-71' silo: 'releng' [controller-csit-3node-clustering-ask-all-argon] $ /bin/bash -l /tmp/jenkins5964850323063197695.sh ---> Create HEAT stack + source /home/jenkins/lf-env.sh + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ++ mktemp -d /tmp/venv-XXXX + lf_venv=/tmp/venv-lr9x + local venv_file=/tmp/.os_lf_venv + local python=python3 + local options + local set_path=true + local install_args= ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\''' + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\''' ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + true + case $1 in + python=python3 + shift 2 + true + case $1 in + shift + break + case $python in + local pkg_list= + [[ -d /opt/pyenv ]] + echo 'Setup pyenv:' Setup pyenv: + export PYENV_ROOT=/opt/pyenv + PYENV_ROOT=/opt/pyenv + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + pyenv versions system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/controller-csit-3node-clustering-ask-all-argon/.python-version) + command -v pyenv ++ pyenv init - --no-rehash + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "'\''/opt/pyenv/shims'\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; fi; done; echo "${paths[*]}"'\'')" export PATH="/opt/pyenv/shims:${PATH}" export PYENV_SHELL=bash source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\'' pyenv() { local command command="${1:-}" if [ "$#" -gt 0 ]; then shift fi case "$command" in rehash|shell) eval "$(pyenv "sh-$command" "$@")" ;; *) command pyenv "$command" "$@" ;; esac }' +++ bash --norc -ec 'IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; fi; done; echo "${paths[*]}"' ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ export PYENV_SHELL=bash ++ PYENV_SHELL=bash ++ source /opt/pyenv/libexec/../completions/pyenv.bash +++ complete -F _pyenv pyenv ++ lf-pyver python3 ++ local py_version_xy=python3 ++ local py_version_xyz= ++ awk '{ print $1 }' ++ pyenv versions ++ local command ++ command=versions ++ '[' 1 -gt 0 ']' ++ shift ++ case "$command" in ++ command pyenv versions ++ pyenv versions ++ sed 's/^[ *]* //' ++ grep -E '^[0-9.]*[0-9]$' ++ [[ ! -s /tmp/.pyenv_versions ]] +++ grep '^3' /tmp/.pyenv_versions +++ sort -V +++ tail -n 1 ++ py_version_xyz=3.10.6 ++ [[ -z 3.10.6 ]] ++ echo 3.10.6 ++ return 0 + pyenv local 3.10.6 + local command + command=local + '[' 2 -gt 0 ']' + shift + case "$command" in + command pyenv local 3.10.6 + pyenv local 3.10.6 + for arg in "$@" + case $arg in + pkg_list+='lftools[openstack] ' + for arg in "$@" + case $arg in + pkg_list+='kubernetes ' + for arg in "$@" + case $arg in + pkg_list+='niet ' + for arg in "$@" + case $arg in + pkg_list+='python-heatclient ' + for arg in "$@" + case $arg in + pkg_list+='python-openstackclient ' + for arg in "$@" + case $arg in + pkg_list+='python-magnumclient ' + for arg in "$@" + case $arg in + pkg_list+='yq ' + [[ -f /tmp/.os_lf_venv ]] ++ cat /tmp/.os_lf_venv + lf_venv=/tmp/venv-WK1U + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-WK1U from' file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Reuse venv:/tmp/venv-WK1U from file:/tmp/.os_lf_venv + /tmp/venv-WK1U/bin/python3 -m pip install --upgrade --quiet pip virtualenv + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ]] + echo 'lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ' lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + /tmp/venv-WK1U/bin/python3 -m pip install --upgrade --quiet --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + type python3 + true + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-WK1U/bin to PATH' lf-activate-venv(): INFO: Adding /tmp/venv-WK1U/bin to PATH + PATH=/tmp/venv-WK1U/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + return 0 + openstack --os-cloud vex limits show --absolute +--------------------------+---------+ | Name | Value | +--------------------------+---------+ | maxTotalInstances | -1 | | maxTotalCores | 450 | | maxTotalRAMSize | 1000000 | | maxServerMeta | 128 | | maxImageMeta | 128 | | maxPersonality | 5 | | maxPersonalitySize | 10240 | | maxTotalKeypairs | 100 | | maxServerGroups | 10 | | maxServerGroupMembers | 10 | | maxTotalFloatingIps | -1 | | maxSecurityGroups | -1 | | maxSecurityGroupRules | -1 | | totalRAMUsed | 393216 | | totalCoresUsed | 96 | | totalInstancesUsed | 34 | | totalFloatingIpsUsed | 0 | | totalSecurityGroupsUsed | 0 | | totalServerGroupsUsed | 0 | | maxTotalVolumes | -1 | | maxTotalSnapshots | 10 | | maxTotalVolumeGigabytes | 4096 | | maxTotalBackups | 10 | | maxTotalBackupGigabytes | 1000 | | totalVolumesUsed | 0 | | totalGigabytesUsed | 0 | | totalSnapshotsUsed | 0 | | totalBackupsUsed | 0 | | totalBackupGigabytesUsed | 0 | +--------------------------+---------+ + pushd /opt/ciman/openstack-hot /opt/ciman/openstack-hot /w/workspace/controller-csit-3node-clustering-ask-all-argon + lftools openstack --os-cloud vex stack create releng-controller-csit-3node-clustering-ask-all-argon-71 csit-2-instance-type.yaml /w/workspace/controller-csit-3node-clustering-ask-all-argon/stack-parameters.yaml Creating stack releng-controller-csit-3node-clustering-ask-all-argon-71 Waiting to initialize infrastructure... Stack initialization successful. ------------------------------------ Stack Details ------------------------------------ {'added': None, 'capabilities': [], 'created_at': '2024-02-03T23:07:03Z', 'deleted': None, 'deleted_at': None, 'description': 'No description', 'environment': None, 'environment_files': None, 'files': None, 'files_container': None, 'id': 'eafe8cf5-0cbd-4c22-b22e-69a5f86d7878', 'is_rollback_disabled': True, 'links': [{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-controller-csit-3node-clustering-ask-all-argon-71/eafe8cf5-0cbd-4c22-b22e-69a5f86d7878', 'rel': 'self'}], 'location': Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}), 'name': 'releng-controller-csit-3node-clustering-ask-all-argon-71', 'notification_topics': [], 'outputs': [{'description': 'IP addresses of the 1st vm types', 'output_key': 'vm_0_ips', 'output_value': ['10.30.171.15', '10.30.171.76', '10.30.171.20']}, {'description': 'IP addresses of the 2nd vm types', 'output_key': 'vm_1_ips', 'output_value': []}], 'owner_id': ****, 'parameters': {'OS::project_id': '12c36e260d8e4bb2913965203b1b491f', 'OS::stack_id': 'eafe8cf5-0cbd-4c22-b22e-69a5f86d7878', 'OS::stack_name': 'releng-controller-csit-3node-clustering-ask-all-argon-71', 'job_name': '11311-71', 'silo': 'releng', 'vm_0_count': '3', 'vm_0_flavor': 'v3-standard-4', 'vm_0_image': 'ZZCI - CentOS Stream 8 - builder - x86_64 - ' '20240117-011746.201', 'vm_1_count': '0', 'vm_1_flavor': 'v3-standard-2', 'vm_1_image': 'ZZCI - Ubuntu 18.04 - mininet-ovs-28 - x86_64 - ' '20230601-180106.003'}, 'parent_id': None, 'replaced': None, 'status': 'CREATE_COMPLETE', 'status_reason': 'Stack CREATE completed successfully', 'tags': [], 'template': None, 'template_description': 'No description', 'template_url': None, 'timeout_mins': 15, 'unchanged': None, 'updated': None, 'updated_at': None, 'user_project_id': '218e7ad2b89845d3887f8c9804fda94c'} ------------------------------------ + popd /w/workspace/controller-csit-3node-clustering-ask-all-argon [controller-csit-3node-clustering-ask-all-argon] $ /bin/bash -l /tmp/jenkins15046954430409289248.sh ---> Copy SSH public keys to CSIT lab Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/controller-csit-3node-clustering-ask-all-argon/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-WK1U from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient lf-activate-venv(): INFO: Adding /tmp/venv-WK1U/bin to PATH SSH not responding on 10.30.171.15. Retrying in 10 seconds... SSH not responding on 10.30.171.20. Retrying in 10 seconds... SSH not responding on 10.30.171.76. Retrying in 10 seconds... Ping to 10.30.171.15 successful. SSH not responding on 10.30.171.15. Retrying in 10 seconds... Ping to 10.30.171.20 successful. SSH not responding on 10.30.171.20. Retrying in 10 seconds... Ping to 10.30.171.76 successful. SSH not responding on 10.30.171.76. Retrying in 10 seconds... Ping to 10.30.171.15 successful. SSH not responding on 10.30.171.15. Retrying in 10 seconds... Ping to 10.30.171.20 successful. SSH not responding on 10.30.171.20. Retrying in 10 seconds... Ping to 10.30.171.76 successful. SSH not responding on 10.30.171.76. Retrying in 10 seconds... Ping to 10.30.171.15 successful. SSH not responding on 10.30.171.15. Retrying in 10 seconds... Ping to 10.30.171.20 successful. SSH not responding on 10.30.171.20. Retrying in 10 seconds... Ping to 10.30.171.76 successful. SSH not responding on 10.30.171.76. Retrying in 10 seconds... Ping to 10.30.171.15 successful. SSH not responding on 10.30.171.15. Retrying in 10 seconds... Ping to 10.30.171.20 successful. SSH not responding on 10.30.171.20. Retrying in 10 seconds... Ping to 10.30.171.76 successful. SSH not responding on 10.30.171.76. Retrying in 10 seconds... Ping to 10.30.171.15 successful. SSH not responding on 10.30.171.15. Retrying in 10 seconds... Ping to 10.30.171.20 successful. SSH not responding on 10.30.171.20. Retrying in 10 seconds... Ping to 10.30.171.76 successful. SSH not responding on 10.30.171.76. Retrying in 10 seconds... Ping to 10.30.171.15 successful. Ping to 10.30.171.20 successful. SSH not responding on 10.30.171.15. Retrying in 10 seconds... Warning: Permanently added '10.30.171.20' (ECDSA) to the list of known hosts. 10.30.171.20 releng-11311-71-0-builder-2.novalocal Successfully copied public keys to slave 10.30.171.20 Ping to 10.30.171.76 successful. SSH not responding on 10.30.171.76. Retrying in 10 seconds... Ping to 10.30.171.15 successful. SSH not responding on 10.30.171.15. Retrying in 10 seconds... Ping to 10.30.171.76 successful. SSH not responding on 10.30.171.76. Retrying in 10 seconds... Ping to 10.30.171.15 successful. Warning: Permanently added '10.30.171.15' (ECDSA) to the list of known hosts. 10.30.171.15 releng-11311-71-0-builder-0.novalocal Successfully copied public keys to slave 10.30.171.15 Process 6500 ready. Ping to 10.30.171.76 successful. Warning: Permanently added '10.30.171.76' (ECDSA) to the list of known hosts. 10.30.171.76 releng-11311-71-0-builder-1.novalocal Successfully copied public keys to slave 10.30.171.76 Process 6501 ready. Process 6502 ready. SSH ready on all stack servers. [controller-csit-3node-clustering-ask-all-argon] $ /bin/bash -l /tmp/jenkins16276135351066237310.sh Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/controller-csit-3node-clustering-ask-all-argon/.python-version) lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-kCvl lf-activate-venv(): INFO: Save venv in file: /w/workspace/controller-csit-3node-clustering-ask-all-argon/.robot_venv lf-activate-venv(): INFO: Installing: setuptools wheel lf-activate-venv(): INFO: Adding /tmp/venv-kCvl/bin to PATH + echo 'Installing Python Requirements' Installing Python Requirements + cat + python -m pip install -r requirements.txt Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple Collecting docker-py (from -r requirements.txt (line 1)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-py/1.10.6/docker_py-1.10.6-py2.py3-none-any.whl (50 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50.0/50.0 kB 7.4 MB/s eta 0:00:00 Collecting ipaddr (from -r requirements.txt (line 2)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ipaddr/2.2.0/ipaddr-2.2.0.tar.gz (26 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting netaddr (from -r requirements.txt (line 3)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/netaddr/0.10.1/netaddr-0.10.1-py2.py3-none-any.whl (2.2 MB) Collecting netifaces (from -r requirements.txt (line 4)) Using cached netifaces-0.11.0-cp310-cp310-linux_x86_64.whl Collecting pyhocon (from -r requirements.txt (line 5)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyhocon/0.3.60/pyhocon-0.3.60.tar.gz (158 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 158.8/158.8 kB 3.8 MB/s eta 0:00:00 Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting requests (from -r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/requests/2.31.0/requests-2.31.0-py3-none-any.whl (62 kB) Collecting robotframework (from -r requirements.txt (line 7)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework/7.0/robotframework-7.0-py3-none-any.whl (726 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 726.3/726.3 kB 42.3 MB/s eta 0:00:00 Collecting robotframework-httplibrary (from -r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-httplibrary/0.4.2/robotframework-httplibrary-0.4.2.tar.gz (9.1 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting robotframework-requests==0.9.3 (from -r requirements.txt (line 9)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-requests/0.9.3/robotframework_requests-0.9.3-py3-none-any.whl (21 kB) Collecting robotframework-selenium2library (from -r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-selenium2library/3.0.0/robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB) Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-sshlibrary/3.8.0/robotframework-sshlibrary-3.8.0.tar.gz (51 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 51.4/51.4 kB 8.0 MB/s eta 0:00:00 Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting scapy (from -r requirements.txt (line 12)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scapy/2.5.0/scapy-2.5.0.tar.gz (1.3 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 49.4 MB/s eta 0:00:00 Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting jsonpath-rw (from -r requirements.txt (line 15)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpath-rw/1.4.0/jsonpath-rw-1.4.0.tar.gz (13 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting elasticsearch (from -r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/8.12.0/elasticsearch-8.12.0-py3-none-any.whl (431 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 431.9/431.9 kB 32.4 MB/s eta 0:00:00 Collecting elasticsearch-dsl (from -r requirements.txt (line 19)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.12.0/elasticsearch_dsl-8.12.0-py3-none-any.whl (63 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64.0/64.0 kB 10.2 MB/s eta 0:00:00 Collecting pyangbind (from -r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyangbind/0.8.4.post1/pyangbind-0.8.4.post1-py3-none-any.whl (52 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 52.8/52.8 kB 11.1 MB/s eta 0:00:00 Collecting isodate (from -r requirements.txt (line 25)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/isodate/0.6.1/isodate-0.6.1-py2.py3-none-any.whl (41 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 41.7/41.7 kB 6.5 MB/s eta 0:00:00 Collecting jmespath (from -r requirements.txt (line 28)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jmespath/1.0.1/jmespath-1.0.1-py3-none-any.whl (20 kB) Collecting jsonpatch (from -r requirements.txt (line 31)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpatch/1.33/jsonpatch-1.33-py2.py3-none-any.whl (12 kB) Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/paramiko/3.4.0/paramiko-3.4.0-py3-none-any.whl (225 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 225.9/225.9 kB 27.1 MB/s eta 0:00:00 Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scp/0.14.5/scp-0.14.5-py2.py3-none-any.whl (8.7 kB) Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-pycreds/0.4.0/docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB) Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/six/1.16.0/six-1.16.0-py2.py3-none-any.whl (11 kB) Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/websocket-client/1.7.0/websocket_client-1.7.0-py3-none-any.whl (58 kB) Collecting pyparsing<4,>=2 (from pyhocon->-r requirements.txt (line 5)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pyparsing/3.1.1/pyparsing-3.1.1-py3-none-any.whl (103 kB) Collecting charset-normalizer<4,>=2 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/charset-normalizer/3.3.2/charset_normalizer-3.3.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (142 kB) Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/idna/3.6/idna-3.6-py3-none-any.whl (61 kB) Collecting urllib3<3,>=1.21.1 (from requests->-r requirements.txt (line 6)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.2.0/urllib3-2.2.0-py3-none-any.whl (120 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 120.9/120.9 kB 1.4 MB/s eta 0:00:00 Collecting certifi>=2017.4.17 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/certifi/2024.2.2/certifi-2024.2.2-py3-none-any.whl (163 kB) Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webtest/3.0.0/WebTest-3.0.0-py3-none-any.whl (31 kB) Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpointer/2.4/jsonpointer-2.4-py2.py3-none-any.whl (7.8 kB) Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-seleniumlibrary/6.2.0/robotframework_seleniumlibrary-6.2.0-py2.py3-none-any.whl (95 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 95.5/95.5 kB 15.1 MB/s eta 0:00:00 Collecting ply (from jsonpath-rw->-r requirements.txt (line 15)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ply/3.11/ply-3.11-py2.py3-none-any.whl (49 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49.6/49.6 kB 1.4 MB/s eta 0:00:00 Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/decorator/5.1.1/decorator-5.1.1-py3-none-any.whl (9.1 kB) Collecting elastic-transport<9,>=8 (from elasticsearch->-r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/8.12.0/elastic_transport-8.12.0-py3-none-any.whl (59 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 59.9/59.9 kB 9.0 MB/s eta 0:00:00 Collecting python-dateutil (from elasticsearch-dsl->-r requirements.txt (line 19)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/python-dateutil/2.8.2/python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB) Collecting pyang (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyang/2.6.0/pyang-2.6.0-py2.py3-none-any.whl (594 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 594.1/594.1 kB 16.7 MB/s eta 0:00:00 Collecting lxml (from pyangbind->-r requirements.txt (line 22)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/lxml/5.1.0/lxml-5.1.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (8.0 MB) Collecting regex (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/regex/2023.12.25/regex-2023.12.25-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (773 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 774.0/774.0 kB 17.7 MB/s eta 0:00:00 Collecting enum34 (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/enum34/1.1.10/enum34-1.1.10-py3-none-any.whl (11 kB) Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/bcrypt/4.1.2/bcrypt-4.1.2-cp39-abi3-manylinux_2_28_x86_64.whl (698 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 698.9/698.9 kB 19.0 MB/s eta 0:00:00 Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cryptography/42.0.2/cryptography-42.0.2-cp39-abi3-manylinux_2_28_x86_64.whl (4.7 MB) Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pynacl/1.5.0/PyNaCl-1.5.0-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl (856 kB) Collecting selenium>=4.3.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/selenium/4.17.2/selenium-4.17.2-py3-none-any.whl (9.9 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9.9/9.9 MB 71.2 MB/s eta 0:00:00 Collecting robotframework-pythonlibcore>=3.0.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-pythonlibcore/4.3.0/robotframework_pythonlibcore-4.3.0-py2.py3-none-any.whl (10 kB) Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webob/1.8.7/WebOb-1.8.7-py2.py3-none-any.whl (114 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 115.0/115.0 kB 16.7 MB/s eta 0:00:00 Collecting waitress>=0.8.5 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/waitress/2.1.2/waitress-2.1.2-py3-none-any.whl (57 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.7/57.7 kB 9.2 MB/s eta 0:00:00 Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/beautifulsoup4/4.12.3/beautifulsoup4-4.12.3-py3-none-any.whl (147 kB) Collecting cffi>=1.12 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cffi/1.16.0/cffi-1.16.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (443 kB) Collecting trio~=0.17 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio/0.24.0/trio-0.24.0-py3-none-any.whl (460 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 460.2/460.2 kB 44.1 MB/s eta 0:00:00 Collecting trio-websocket~=0.9 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-websocket/0.11.1/trio_websocket-0.11.1-py3-none-any.whl (17 kB) Collecting typing_extensions>=4.9.0 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/typing-extensions/4.9.0/typing_extensions-4.9.0-py3-none-any.whl (32 kB) Collecting soupsieve>1.2 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/soupsieve/2.5/soupsieve-2.5-py3-none-any.whl (36 kB) Collecting pycparser (from cffi>=1.12->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pycparser/2.21/pycparser-2.21-py2.py3-none-any.whl (118 kB) Collecting attrs>=20.1.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/attrs/23.2.0/attrs-23.2.0-py3-none-any.whl (60 kB) Collecting sortedcontainers (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sortedcontainers/2.4.0/sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB) Collecting outcome (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/outcome/1.3.0.post0/outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB) Collecting sniffio>=1.3.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sniffio/1.3.0/sniffio-1.3.0-py3-none-any.whl (10 kB) Collecting exceptiongroup (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/exceptiongroup/1.2.0/exceptiongroup-1.2.0-py3-none-any.whl (16 kB) Collecting wsproto>=0.14 (from trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/wsproto/1.2.0/wsproto-1.2.0-py3-none-any.whl (24 kB) Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]<3,>=1.26->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pysocks/1.7.1/PySocks-1.7.1-py3-none-any.whl (16 kB) Collecting h11<1,>=0.9.0 (from wsproto>=0.14->trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/h11/0.14.0/h11-0.14.0-py3-none-any.whl (58 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58.3/58.3 kB 8.6 MB/s eta 0:00:00 Building wheels for collected packages: robotframework-sshlibrary, ipaddr, pyhocon, robotframework-httplibrary, scapy, jsonpath-rw Building wheel for robotframework-sshlibrary (setup.py): started Building wheel for robotframework-sshlibrary (setup.py): finished with status 'done' Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55116 sha256=2a889453e471149b64fb807172fde38009fe4b167abe7f894d071858f4d4f1a5 Stored in directory: /home/jenkins/.cache/pip/wheels/4f/7c/b3/1dfc58277260e643335754e93ea5854bc7ba3d181575a9cea9 Building wheel for ipaddr (setup.py): started Building wheel for ipaddr (setup.py): finished with status 'done' Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18282 sha256=ce08f836a015a766d2dba9e2ce7e46323bedadae48e82b8b7a24332bcbbf7a66 Stored in directory: /home/jenkins/.cache/pip/wheels/b5/7c/08/e4a91c0b38d5ae5fea76fbb9b60ce1b5f5f8d6e69cbe801870 Building wheel for pyhocon (setup.py): started Building wheel for pyhocon (setup.py): finished with status 'done' Created wheel for pyhocon: filename=pyhocon-0.3.60-py3-none-any.whl size=20864 sha256=1d246bd05696fc6c870690a506ac536a8aad42081f2403201a3dd76904268430 Stored in directory: /home/jenkins/.cache/pip/wheels/7e/3f/4f/66e113a4b8eca7d8ff120a7fcfb53be15fc5078eb353482440 Building wheel for robotframework-httplibrary (setup.py): started Building wheel for robotframework-httplibrary (setup.py): finished with status 'done' Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=9954 sha256=8878b06fd9d4b8abe685b8f2516b6a64be6da6a5278a02111e0248c80d1d8860 Stored in directory: /home/jenkins/.cache/pip/wheels/2e/b8/87/b9b31f375281dd80f51ca94affc6e39f3e45d192e1e1f95553 Building wheel for scapy (setup.py): started Building wheel for scapy (setup.py): finished with status 'done' Created wheel for scapy: filename=scapy-2.5.0-py2.py3-none-any.whl size=1444328 sha256=1966b802cfbb1ab6ace6f06b098dfd51f919ea1a3a97fe1165553c36591163c0 Stored in directory: /home/jenkins/.cache/pip/wheels/8e/0a/14/42ef36f95fd1fbf75090db30f0cbb4ad4186b84b7a3d10dfcb Building wheel for jsonpath-rw (setup.py): started Building wheel for jsonpath-rw (setup.py): finished with status 'done' Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15127 sha256=1988243173a42d67925a1b7fd12dd3193f13c5f67b1b2ae5be35666605db97da Stored in directory: /home/jenkins/.cache/pip/wheels/22/71/20/0f098fcfc9905114ba8ed62f4b7f9b66ef9a017f99d918fc12 Successfully built robotframework-sshlibrary ipaddr pyhocon robotframework-httplibrary scapy jsonpath-rw Installing collected packages: sortedcontainers, ply, netifaces, netaddr, ipaddr, enum34, websocket-client, WebOb, waitress, urllib3, typing_extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, lxml, jsonpointer, jmespath, idna, h11, exceptiongroup, decorator, charset-normalizer, certifi, bcrypt, attrs, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, isodate, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library Successfully installed WebOb-1.8.7 attrs-23.2.0 bcrypt-4.1.2 beautifulsoup4-4.12.3 certifi-2024.2.2 cffi-1.16.0 charset-normalizer-3.3.2 cryptography-42.0.2 decorator-5.1.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.12.0 elasticsearch-8.12.0 elasticsearch-dsl-8.12.0 enum34-1.1.10 exceptiongroup-1.2.0 h11-0.14.0 idna-3.6 ipaddr-2.2.0 isodate-0.6.1 jmespath-1.0.1 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-2.4 lxml-5.1.0 netaddr-0.10.1 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-3.4.0 ply-3.11 pyang-2.6.0 pyangbind-0.8.4.post1 pycparser-2.21 pyhocon-0.3.60 pynacl-1.5.0 pyparsing-3.1.1 pysocks-1.7.1 python-dateutil-2.8.2 regex-2023.12.25 requests-2.31.0 robotframework-7.0 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.3.0 robotframework-requests-0.9.3 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.2.0 robotframework-sshlibrary-3.8.0 scapy-2.5.0 scp-0.14.5 selenium-4.17.2 six-1.16.0 sniffio-1.3.0 sortedcontainers-2.4.0 soupsieve-2.5 trio-0.24.0 trio-websocket-0.11.1 typing_extensions-4.9.0 urllib3-2.2.0 waitress-2.1.2 websocket-client-1.7.0 webtest-3.0.0 wsproto-1.2.0 + pip freeze attrs==23.2.0 bcrypt==4.1.2 beautifulsoup4==4.12.3 certifi==2024.2.2 cffi==1.16.0 charset-normalizer==3.3.2 cryptography==42.0.2 decorator==5.1.1 distlib==0.3.8 docker-py==1.10.6 docker-pycreds==0.4.0 elastic-transport==8.12.0 elasticsearch==8.12.0 elasticsearch-dsl==8.12.0 enum34==1.1.10 exceptiongroup==1.2.0 filelock==3.13.1 h11==0.14.0 idna==3.6 ipaddr==2.2.0 isodate==0.6.1 jmespath==1.0.1 jsonpatch==1.33 jsonpath-rw==1.4.0 jsonpointer==2.4 lxml==5.1.0 netaddr==0.10.1 netifaces==0.11.0 outcome==1.3.0.post0 paramiko==3.4.0 platformdirs==4.2.0 ply==3.11 pyang==2.6.0 pyangbind==0.8.4.post1 pycparser==2.21 pyhocon==0.3.60 PyNaCl==1.5.0 pyparsing==3.1.1 PySocks==1.7.1 python-dateutil==2.8.2 regex==2023.12.25 requests==2.31.0 robotframework==7.0 robotframework-httplibrary==0.4.2 robotframework-pythonlibcore==4.3.0 robotframework-requests==0.9.3 robotframework-selenium2library==3.0.0 robotframework-seleniumlibrary==6.2.0 robotframework-sshlibrary==3.8.0 scapy==2.5.0 scp==0.14.5 selenium==4.17.2 six==1.16.0 sniffio==1.3.0 sortedcontainers==2.4.0 soupsieve==2.5 trio==0.24.0 trio-websocket==0.11.1 typing_extensions==4.9.0 urllib3==2.2.0 virtualenv==20.25.0 waitress==2.1.2 WebOb==1.8.7 websocket-client==1.7.0 WebTest==3.0.0 wsproto==1.2.0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'env.properties' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-ask-all-argon] $ /bin/bash -l /tmp/jenkins14680746321208277514.sh Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/controller-csit-3node-clustering-ask-all-argon/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-WK1U from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient yq ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. botocore 1.34.34 requires urllib3<2.1,>=1.25.4; python_version >= "3.10", but you have urllib3 2.2.0 which is incompatible. lftools 0.37.8 requires openstacksdk<1.5.0, but you have openstacksdk 2.1.0 which is incompatible. lftools 0.37.8 requires urllib3<2.0.0, but you have urllib3 2.2.0 which is incompatible. lf-activate-venv(): INFO: Adding /tmp/venv-WK1U/bin to PATH + ODL_SYSTEM=() + TOOLS_SYSTEM=() + OPENSTACK_SYSTEM=() + OPENSTACK_CONTROLLERS=() + mapfile -t ADDR ++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]' ++ openstack stack show -f json -c outputs releng-controller-csit-3node-clustering-ask-all-argon-71 + for i in "${ADDR[@]}" ++ ssh 10.30.171.15 hostname -s Warning: Permanently added '10.30.171.15' (ECDSA) to the list of known hosts. + REMHOST=releng-11311-71-0-builder-0 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + for i in "${ADDR[@]}" ++ ssh 10.30.171.76 hostname -s Warning: Permanently added '10.30.171.76' (ECDSA) to the list of known hosts. + REMHOST=releng-11311-71-0-builder-1 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + for i in "${ADDR[@]}" ++ ssh 10.30.171.20 hostname -s Warning: Permanently added '10.30.171.20' (ECDSA) to the list of known hosts. + REMHOST=releng-11311-71-0-builder-2 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + echo NUM_ODL_SYSTEM=3 + echo NUM_TOOLS_SYSTEM=0 + '[' '' == yes ']' + NUM_OPENSTACK_SYSTEM=0 + echo NUM_OPENSTACK_SYSTEM=0 + '[' 0 -eq 2 ']' + echo ODL_SYSTEM_IP=10.30.171.15 ++ seq 0 2 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_1_IP=10.30.171.15 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_2_IP=10.30.171.76 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_3_IP=10.30.171.20 + echo TOOLS_SYSTEM_IP= ++ seq 0 -1 + openstack_index=0 + NUM_OPENSTACK_CONTROL_NODES=1 + echo NUM_OPENSTACK_CONTROL_NODES=1 ++ seq 0 0 + for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1))) + echo OPENSTACK_CONTROL_NODE_1_IP= + NUM_OPENSTACK_COMPUTE_NODES=-1 + echo NUM_OPENSTACK_COMPUTE_NODES=-1 + '[' -1 -ge 2 ']' ++ seq 0 -2 + NUM_OPENSTACK_HAPROXY_NODES=0 + echo NUM_OPENSTACK_HAPROXY_NODES=0 ++ seq 0 -1 + echo 'Contents of slave_addresses.txt:' Contents of slave_addresses.txt: + cat slave_addresses.txt NUM_ODL_SYSTEM=3 NUM_TOOLS_SYSTEM=0 NUM_OPENSTACK_SYSTEM=0 ODL_SYSTEM_IP=10.30.171.15 ODL_SYSTEM_1_IP=10.30.171.15 ODL_SYSTEM_2_IP=10.30.171.76 ODL_SYSTEM_3_IP=10.30.171.20 TOOLS_SYSTEM_IP= NUM_OPENSTACK_CONTROL_NODES=1 OPENSTACK_CONTROL_NODE_1_IP= NUM_OPENSTACK_COMPUTE_NODES=-1 NUM_OPENSTACK_HAPROXY_NODES=0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-ask-all-argon] $ /bin/sh /tmp/jenkins15961655025746354096.sh Preparing for JRE Version 17 Karaf artifact is karaf Karaf project is integration Java home is /usr/lib/jvm/java-17-openjdk [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'set_variables.env' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-ask-all-argon] $ /bin/bash /tmp/jenkins15209368399080208576.sh --2024-02-03 23:09:57-- http://git.opendaylight.org/gerrit/gitweb?p=integration/distribution.git;a=blob_plain;f=pom.xml;hb=refs/heads/stable/argon Resolving git.opendaylight.org (git.opendaylight.org)... 52.35.122.251, 2600:1f14:421:f500:133a:a004:b30b:69e1 Connecting to git.opendaylight.org (git.opendaylight.org)|52.35.122.251|:80... connected. HTTP request sent, awaiting response... 301 Moved Permanently Location: https://git.opendaylight.org/gerrit/gitweb?p=integration/distribution.git;a=blob_plain;f=pom.xml;hb=refs/heads/stable/argon [following] --2024-02-03 23:09:57-- https://git.opendaylight.org/gerrit/gitweb?p=integration/distribution.git;a=blob_plain;f=pom.xml;hb=refs/heads/stable/argon Connecting to git.opendaylight.org (git.opendaylight.org)|52.35.122.251|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 2620 (2.6K) [text/plain] Saving to: ‘pom.xml’ 0K .. 100% 40.7M=0s 2024-02-03 23:09:57 (40.7 MB/s) - ‘pom.xml’ saved [2620/2620] Bundle version is 0.18.4-SNAPSHOT --2024-02-03 23:09:58-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/maven-metadata.xml Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 1410 (1.4K) [application/xml] Saving to: ‘maven-metadata.xml’ 0K . 100% 33.9M=0s 2024-02-03 23:09:58 (33.9 MB/s) - ‘maven-metadata.xml’ saved [1410/1410] org.opendaylight.integration karaf 0.18.4-SNAPSHOT 20240126.210405 462 20240126210405 pom 0.18.4-20240126.210405-462 20240126210405 tar.gz 0.18.4-20240126.210405-462 20240126210405 zip 0.18.4-20240126.210405-462 20240126210405 cyclonedx xml 0.18.4-20240126.210405-462 20240126210405 cyclonedx json 0.18.4-20240126.210405-462 20240126210405 Nexus timestamp is 0.18.4-20240126.210405-462 Distribution bundle URL is https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240126.210405-462.zip Distribution bundle is karaf-0.18.4-20240126.210405-462.zip Distribution bundle version is 0.18.4-SNAPSHOT Distribution folder is karaf-0.18.4-SNAPSHOT Nexus prefix is https://nexus.opendaylight.org [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-ask-all-argon] $ /bin/bash -l /tmp/jenkins3458858928075385364.sh Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/controller-csit-3node-clustering-ask-all-argon/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-WK1U from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient lf-activate-venv(): INFO: Adding /tmp/venv-WK1U/bin to PATH Copying common-functions.sh to /tmp Copying common-functions.sh to 10.30.171.15:/tmp Warning: Permanently added '10.30.171.15' (ECDSA) to the list of known hosts. Copying common-functions.sh to 10.30.171.76:/tmp Warning: Permanently added '10.30.171.76' (ECDSA) to the list of known hosts. Copying common-functions.sh to 10.30.171.20:/tmp Warning: Permanently added '10.30.171.20' (ECDSA) to the list of known hosts. [controller-csit-3node-clustering-ask-all-argon] $ /bin/bash /tmp/jenkins8602777610633115735.sh common-functions.sh is being sourced common-functions environment: MAVENCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv CONTROLLERMEM: 2048m AKKACONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ################################################# ## Configure Cluster and Start ## ################################################# ACTUALFEATURES: odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app SPACE_SEPARATED_FEATURES: odl-integration-compatible-with-all odl-jolokia odl-restconf odl-clustering-test-app Locating script plan to use... script plan exists!!! Changing the script plan path... # Place the scripts in run order: /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/scripts/car_people_shard.sh Executing /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/scripts/car_people_shard.sh... Add car-people shards file Copy shard config to member-1 with IP address 10.30.171.15 Warning: Permanently added '10.30.171.15' (ECDSA) to the list of known hosts. Copy shard config to member-2 with IP address 10.30.171.76 Warning: Permanently added '10.30.171.76' (ECDSA) to the list of known hosts. Copy shard config to member-3 with IP address 10.30.171.20 Warning: Permanently added '10.30.171.20' (ECDSA) to the list of known hosts. Finished running script plans Configuring member-1 with IP address 10.30.171.15 Warning: Permanently added '10.30.171.15' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.15' (ECDSA) to the list of known hosts. + source /tmp/common-functions.sh karaf-0.18.4-SNAPSHOT common-functions.sh is being sourced ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.18.4-SNAPSHOT ++ export MAVENCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ export AKKACONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf ++ AKKACONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf ++ export MODULESCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240126.210405-462.zip + echo 'Changing to /tmp' + cd /tmp + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240126.210405-462.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240126.210405-462.zip --2024-02-03 23:10:08-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240126.210405-462.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 260396460 (248M) [application/zip] Saving to: ‘karaf-0.18.4-20240126.210405-462.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 81.9M 3s 3072K ........ ........ ........ ........ ........ ........ 2% 141M 2s 6144K ........ ........ ........ ........ ........ ........ 3% 166M 2s 9216K ........ ........ ........ ........ ........ ........ 4% 146M 2s 12288K ........ ........ ........ ........ ........ ........ 6% 178M 2s 15360K ........ ........ ........ ........ ........ ........ 7% 210M 2s 18432K ........ ........ ........ ........ ........ ........ 8% 227M 2s 21504K ........ ........ ........ ........ ........ ........ 9% 225M 1s 24576K ........ ........ ........ ........ ........ ........ 10% 243M 1s 27648K ........ ........ ........ ........ ........ ........ 12% 287M 1s 30720K ........ ........ ........ ........ ........ ........ 13% 325M 1s 33792K ........ ........ ........ ........ ........ ........ 14% 136M 1s 36864K ........ ........ ........ ........ ........ ........ 15% 260M 1s 39936K ........ ........ ........ ........ ........ ........ 16% 269M 1s 43008K ........ ........ ........ ........ ........ ........ 18% 283M 1s 46080K ........ ........ ........ ........ ........ ........ 19% 142M 1s 49152K ........ ........ ........ ........ ........ ........ 20% 293M 1s 52224K ........ ........ ........ ........ ........ ........ 21% 305M 1s 55296K ........ ........ ........ ........ ........ ........ 22% 346M 1s 58368K ........ ........ ........ ........ ........ ........ 24% 352M 1s 61440K ........ ........ ........ ........ ........ ........ 25% 229M 1s 64512K ........ ........ ........ ........ ........ ........ 26% 177M 1s 67584K ........ ........ ........ ........ ........ ........ 27% 337M 1s 70656K ........ ........ ........ ........ ........ ........ 28% 263M 1s 73728K ........ ........ ........ ........ ........ ........ 30% 305M 1s 76800K ........ ........ ........ ........ ........ ........ 31% 377M 1s 79872K ........ ........ ........ ........ ........ ........ 32% 356M 1s 82944K ........ ........ ........ ........ ........ ........ 33% 368M 1s 86016K ........ ........ ........ ........ ........ ........ 35% 374M 1s 89088K ........ ........ ........ ........ ........ ........ 36% 353M 1s 92160K ........ ........ ........ ........ ........ ........ 37% 341M 1s 95232K ........ ........ ........ ........ ........ ........ 38% 346M 1s 98304K ........ ........ ........ ........ ........ ........ 39% 247M 1s 101376K ........ ........ ........ ........ ........ ........ 41% 165M 1s 104448K ........ ........ ........ ........ ........ ........ 42% 215M 1s 107520K ........ ........ ........ ........ ........ ........ 43% 392M 1s 110592K ........ ........ ........ ........ ........ ........ 44% 374M 1s 113664K ........ ........ ........ ........ ........ ........ 45% 361M 1s 116736K ........ ........ ........ ........ ........ ........ 47% 355M 1s 119808K ........ ........ ........ ........ ........ ........ 48% 332M 1s 122880K ........ ........ ........ ........ ........ ........ 49% 194M 1s 125952K ........ ........ ........ ........ ........ ........ 50% 213M 1s 129024K ........ ........ ........ ........ ........ ........ 51% 284M 1s 132096K ........ ........ ........ ........ ........ ........ 53% 152M 0s 135168K ........ ........ ........ ........ ........ ........ 54% 281M 0s 138240K ........ ........ ........ ........ ........ ........ 55% 310M 0s 141312K ........ ........ ........ ........ ........ ........ 56% 186M 0s 144384K ........ ........ ........ ........ ........ ........ 57% 297M 0s 147456K ........ ........ ........ ........ ........ ........ 59% 230M 0s 150528K ........ ........ ........ ........ ........ ........ 60% 292M 0s 153600K ........ ........ ........ ........ ........ ........ 61% 286M 0s 156672K ........ ........ ........ ........ ........ ........ 62% 289M 0s 159744K ........ ........ ........ ........ ........ ........ 64% 275M 0s 162816K ........ ........ ........ ........ ........ ........ 65% 218M 0s 165888K ........ ........ ........ ........ ........ ........ 66% 290M 0s 168960K ........ ........ ........ ........ ........ ........ 67% 273M 0s 172032K ........ ........ ........ ........ ........ ........ 68% 238M 0s 175104K ........ ........ ........ ........ ........ ........ 70% 145M 0s 178176K ........ ........ ........ ........ ........ ........ 71% 257M 0s 181248K ........ ........ ........ ........ ........ ........ 72% 175M 0s 184320K ........ ........ ........ ........ ........ ........ 73% 183M 0s 187392K ........ ........ ........ ........ ........ ........ 74% 251M 0s 190464K ........ ........ ........ ........ ........ ........ 76% 286M 0s 193536K ........ ........ ........ ........ ........ ........ 77% 271M 0s 196608K ........ ........ ........ ........ ........ ........ 78% 189M 0s 199680K ........ ........ ........ ........ ........ ........ 79% 214M 0s 202752K ........ ........ ........ ........ ........ ........ 80% 265M 0s 205824K ........ ........ ........ ........ ........ ........ 82% 201M 0s 208896K ........ ........ ........ ........ ........ ........ 83% 163M 0s 211968K ........ ........ ........ ........ ........ ........ 84% 249M 0s 215040K ........ ........ ........ ........ ........ ........ 85% 260M 0s 218112K ........ ........ ........ ........ ........ ........ 86% 285M 0s 221184K ........ ........ ........ ........ ........ ........ 88% 243M 0s 224256K ........ ........ ........ ........ ........ ........ 89% 279M 0s 227328K ........ ........ ........ ........ ........ ........ 90% 191M 0s 230400K ........ ........ ........ ........ ........ ........ 91% 262M 0s 233472K ........ ........ ........ ........ ........ ........ 93% 276M 0s 236544K ........ ........ ........ ........ ........ ........ 94% 335M 0s 239616K ........ ........ ........ ........ ........ ........ 95% 307M 0s 242688K ........ ........ ........ ........ ........ ........ 96% 279M 0s 245760K ........ ........ ........ ........ ........ ........ 97% 298M 0s 248832K ........ ........ ........ ........ ........ ........ 99% 313M 0s 251904K ........ ........ ........ ........ ..... 100% 338M=1.0s 2024-02-03 23:10:10 (239 MB/s) - ‘karaf-0.18.4-20240126.210405-462.zip’ saved [260396460/260396460] Extracting the new controller... + echo 'Extracting the new controller...' + unzip -q karaf-0.18.4-20240126.210405-462.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features... + [[ True == \T\r\u\e ]] + echo 'Configuring the startup features...' + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.18.4-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.18.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.18.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/2ace7065-4c5a-4a00-966d-e6b12d2462cc.xml # # Comma separated list of features to install at startup # featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 5114a86c-98a1-4a9e-9d87-0bffe3c1d14b # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + logapi=log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg controllerdebugmap: cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' + unset IFS + echo 'controllerdebugmap: ' + '[' -n '' ']' + echo 'cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN Configure java home: /usr/lib/jvm/java-17-openjdk max memory: 3072m memconf: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + local -r java_home=/usr/lib/jvm/java-17-openjdk + local -r controllermem=3072m + local -r memconf=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + echo Configure + echo ' java home: /usr/lib/jvm/java-17-openjdk' + echo ' max memory: 3072m' + echo ' memconf: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv' + cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1 + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "17.0.6-ea" 2023-01-17 LTS OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS) OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-17-openjdk + JAVA_HOME=/usr/lib/jvm/java-17-openjdk ++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java Listing all open ports on controller system... + JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java' + echo 'Listing all open ports on controller system...' + netstat -pnatu (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 164 10.30.171.15:22 10.30.171.228:56552 ESTABLISHED - tcp 0 0 10.30.171.15:59304 199.204.45.87:443 TIME_WAIT - tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::22 :::* LISTEN - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp 0 0 10.30.171.15:68 10.30.170.4:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp6 0 0 ::1:323 :::* - udp6 0 0 :::111 :::* - Custom shard config exists!!! Copying the shard config... + '[' -f /tmp/custom_shard_config.txt ']' + echo 'Custom shard config exists!!!' + echo 'Copying the shard config...' + cp /tmp/custom_shard_config.txt /tmp/karaf-0.18.4-SNAPSHOT/bin/ Configuring cluster + echo 'Configuring cluster' + /tmp/karaf-0.18.4-SNAPSHOT/bin/configure_cluster.sh 1 10.30.171.15 10.30.171.76 10.30.171.20 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.18.4-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/7.0.11 Configuring unique name in akka.conf Configuring hostname in akka.conf Configuring data and rpc seed nodes in akka.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump akka.conf + echo 'Dump akka.conf' + cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf odl-cluster-data { akka { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.171.15" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.15:2550", "akka://opendaylight-cluster-data@10.30.171.76:2550", "akka://opendaylight-cluster-data@10.30.171.20:2550"] roles = ["member-1"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" # Use lz4 compression for LocalSnapshotStore snapshots snapshot-store.local.use-lz4-compression = false # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB snapshot-store.local.lz4-blocksize = 256KB } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car" shards = [ { name="car" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "people" shards = [ { name="people" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car-people" shards = [ { name="car-people" replicas = ["member-1", "member-2", "member-3"] } ] } ] Configuring member-2 with IP address 10.30.171.76 Warning: Permanently added '10.30.171.76' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.76' (ECDSA) to the list of known hosts. common-functions.sh is being sourced + source /tmp/common-functions.sh karaf-0.18.4-SNAPSHOT ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.18.4-SNAPSHOT ++ export MAVENCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ export AKKACONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf ++ AKKACONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf ++ export MODULESCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp + echo 'Changing to /tmp' + cd /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240126.210405-462.zip + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240126.210405-462.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240126.210405-462.zip --2024-02-03 23:10:13-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240126.210405-462.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 260396460 (248M) [application/zip] Saving to: ‘karaf-0.18.4-20240126.210405-462.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 56.6M 4s 3072K ........ ........ ........ ........ ........ ........ 2% 107M 3s 6144K ........ ........ ........ ........ ........ ........ 3% 139M 3s 9216K ........ ........ ........ ........ ........ ........ 4% 141M 2s 12288K ........ ........ ........ ........ ........ ........ 6% 182M 2s 15360K ........ ........ ........ ........ ........ ........ 7% 205M 2s 18432K ........ ........ ........ ........ ........ ........ 8% 226M 2s 21504K ........ ........ ........ ........ ........ ........ 9% 206M 2s 24576K ........ ........ ........ ........ ........ ........ 10% 223M 2s 27648K ........ ........ ........ ........ ........ ........ 12% 250M 2s 30720K ........ ........ ........ ........ ........ ........ 13% 305M 1s 33792K ........ ........ ........ ........ ........ ........ 14% 240M 1s 36864K ........ ........ ........ ........ ........ ........ 15% 326M 1s 39936K ........ ........ ........ ........ ........ ........ 16% 282M 1s 43008K ........ ........ ........ ........ ........ ........ 18% 291M 1s 46080K ........ ........ ........ ........ ........ ........ 19% 307M 1s 49152K ........ ........ ........ ........ ........ ........ 20% 298M 1s 52224K ........ ........ ........ ........ ........ ........ 21% 156M 1s 55296K ........ ........ ........ ........ ........ ........ 22% 315M 1s 58368K ........ ........ ........ ........ ........ ........ 24% 342M 1s 61440K ........ ........ ........ ........ ........ ........ 25% 192M 1s 64512K ........ ........ ........ ........ ........ ........ 26% 279M 1s 67584K ........ ........ ........ ........ ........ ........ 27% 191M 1s 70656K ........ ........ ........ ........ ........ ........ 28% 258M 1s 73728K ........ ........ ........ ........ ........ ........ 30% 194M 1s 76800K ........ ........ ........ ........ ........ ........ 31% 246M 1s 79872K ........ ........ ........ ........ ........ ........ 32% 184M 1s 82944K ........ ........ ........ ........ ........ ........ 33% 223M 1s 86016K ........ ........ ........ ........ ........ ........ 35% 316M 1s 89088K ........ ........ ........ ........ ........ ........ 36% 346M 1s 92160K ........ ........ ........ ........ ........ ........ 37% 313M 1s 95232K ........ ........ ........ ........ ........ ........ 38% 321M 1s 98304K ........ ........ ........ ........ ........ ........ 39% 341M 1s 101376K ........ ........ ........ ........ ........ ........ 41% 318M 1s 104448K ........ ........ ........ ........ ........ ........ 42% 217M 1s 107520K ........ ........ ........ ........ ........ ........ 43% 305M 1s 110592K ........ ........ ........ ........ ........ ........ 44% 351M 1s 113664K ........ ........ ........ ........ ........ ........ 45% 340M 1s 116736K ........ ........ ........ ........ ........ ........ 47% 253M 1s 119808K ........ ........ ........ ........ ........ ........ 48% 261M 1s 122880K ........ ........ ........ ........ ........ ........ 49% 274M 1s 125952K ........ ........ ........ ........ ........ ........ 50% 346M 1s 129024K ........ ........ ........ ........ ........ ........ 51% 125M 1s 132096K ........ ........ ........ ........ ........ ........ 53% 190M 1s 135168K ........ ........ ........ ........ ........ ........ 54% 272M 1s 138240K ........ ........ ........ ........ ........ ........ 55% 74.8M 1s 141312K ........ ........ ........ ........ ........ ........ 56% 317M 1s 144384K ........ ........ ........ ........ ........ ........ 57% 331M 0s 147456K ........ ........ ........ ........ ........ ........ 59% 273M 0s 150528K ........ ........ ........ ........ ........ ........ 60% 292M 0s 153600K ........ ........ ........ ........ ........ ........ 61% 381M 0s 156672K ........ ........ ........ ........ ........ ........ 62% 206M 0s 159744K ........ ........ ........ ........ ........ ........ 64% 378M 0s 162816K ........ ........ ........ ........ ........ ........ 65% 240M 0s 165888K ........ ........ ........ ........ ........ ........ 66% 172M 0s 168960K ........ ........ ........ ........ ........ ........ 67% 268M 0s 172032K ........ ........ ........ ........ ........ ........ 68% 327M 0s 175104K ........ ........ ........ ........ ........ ........ 70% 260M 0s 178176K ........ ........ ........ ........ ........ ........ 71% 269M 0s 181248K ........ ........ ........ ........ ........ ........ 72% 311M 0s 184320K ........ ........ ........ ........ ........ ........ 73% 325M 0s 187392K ........ ........ ........ ........ ........ ........ 74% 341M 0s 190464K ........ ........ ........ ........ ........ ........ 76% 326M 0s 193536K ........ ........ ........ ........ ........ ........ 77% 268M 0s 196608K ........ ........ ........ ........ ........ ........ 78% 273M 0s 199680K ........ ........ ........ ........ ........ ........ 79% 343M 0s 202752K ........ ........ ........ ........ ........ ........ 80% 312M 0s 205824K ........ ........ ........ ........ ........ ........ 82% 322M 0s 208896K ........ ........ ........ ........ ........ ........ 83% 315M 0s 211968K ........ ........ ........ ........ ........ ........ 84% 321M 0s 215040K ........ ........ ........ ........ ........ ........ 85% 300M 0s 218112K ........ ........ ........ ........ ........ ........ 86% 325M 0s 221184K ........ ........ ........ ........ ........ ........ 88% 323M 0s 224256K ........ ........ ........ ........ ........ ........ 89% 324M 0s 227328K ........ ........ ........ ........ ........ ........ 90% 294M 0s 230400K ........ ........ ........ ........ ........ ........ 91% 317M 0s 233472K ........ ........ ........ ........ ........ ........ 93% 163M 0s 236544K ........ ........ ........ ........ ........ ........ 94% 171M 0s 239616K ........ ........ ........ ........ ........ ........ 95% 256M 0s 242688K ........ ........ ........ ........ ........ ........ 96% 384M 0s 245760K ........ ........ ........ ........ ........ ........ 97% 345M 0s 248832K ........ ........ ........ ........ ........ ........ 99% 243M 0s 251904K ........ ........ ........ ........ ..... 100% 386M=1.0s 2024-02-03 23:10:14 (237 MB/s) - ‘karaf-0.18.4-20240126.210405-462.zip’ saved [260396460/260396460] Extracting the new controller... + echo 'Extracting the new controller...' + unzip -q karaf-0.18.4-20240126.210405-462.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features... + [[ True == \T\r\u\e ]] + echo 'Configuring the startup features...' + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.18.4-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.18.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.18.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/2ace7065-4c5a-4a00-966d-e6b12d2462cc.xml # # Comma separated list of features to install at startup # featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 5114a86c-98a1-4a9e-9d87-0bffe3c1d14b # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + logapi=log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' + unset IFS controllerdebugmap: + echo 'controllerdebugmap: ' + '[' -n '' ']' cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + echo 'cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN + set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + local -r java_home=/usr/lib/jvm/java-17-openjdk Configure + local -r controllermem=3072m + local -r memconf=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + echo Configure java home: /usr/lib/jvm/java-17-openjdk + echo ' java home: /usr/lib/jvm/java-17-openjdk' max memory: 3072m memconf: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + echo ' max memory: 3072m' + echo ' memconf: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv' + cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1 + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "17.0.6-ea" 2023-01-17 LTS OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS) OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-17-openjdk + JAVA_HOME=/usr/lib/jvm/java-17-openjdk ++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java + JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java' Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java Listing all open ports on controller system... + echo 'Listing all open ports on controller system...' + netstat -pnatu (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 0 10.30.171.76:58472 199.204.45.87:443 TIME_WAIT - tcp 0 164 10.30.171.76:22 10.30.171.228:43220 ESTABLISHED - tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::22 :::* LISTEN - udp 0 0 10.30.171.76:68 10.30.170.2:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - Custom shard config exists!!! Copying the shard config... + '[' -f /tmp/custom_shard_config.txt ']' + echo 'Custom shard config exists!!!' + echo 'Copying the shard config...' + cp /tmp/custom_shard_config.txt /tmp/karaf-0.18.4-SNAPSHOT/bin/ Configuring cluster + echo 'Configuring cluster' + /tmp/karaf-0.18.4-SNAPSHOT/bin/configure_cluster.sh 2 10.30.171.15 10.30.171.76 10.30.171.20 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.18.4-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/7.0.11 Configuring unique name in akka.conf Configuring hostname in akka.conf Configuring data and rpc seed nodes in akka.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump akka.conf + echo 'Dump akka.conf' + cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf odl-cluster-data { akka { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.171.76" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.15:2550", "akka://opendaylight-cluster-data@10.30.171.76:2550", "akka://opendaylight-cluster-data@10.30.171.20:2550"] roles = ["member-2"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" # Use lz4 compression for LocalSnapshotStore snapshots snapshot-store.local.use-lz4-compression = false # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB snapshot-store.local.lz4-blocksize = 256KB } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car" shards = [ { name="car" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "people" shards = [ { name="people" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car-people" shards = [ { name="car-people" replicas = ["member-1", "member-2", "member-3"] } ] } ] Configuring member-3 with IP address 10.30.171.20 Warning: Permanently added '10.30.171.20' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.20' (ECDSA) to the list of known hosts. common-functions.sh is being sourced + source /tmp/common-functions.sh karaf-0.18.4-SNAPSHOT ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.18.4-SNAPSHOT ++ export MAVENCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ export AKKACONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf ++ AKKACONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf ++ export MODULESCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf SUITES: Changing to /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240126.210405-462.zip ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' + echo 'Changing to /tmp' + cd /tmp + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240126.210405-462.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240126.210405-462.zip --2024-02-03 23:10:18-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240126.210405-462.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 260396460 (248M) [application/zip] Saving to: ‘karaf-0.18.4-20240126.210405-462.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 57.2M 4s 3072K ........ ........ ........ ........ ........ ........ 2% 98.8M 3s 6144K ........ ........ ........ ........ ........ ........ 3% 162M 3s 9216K ........ ........ ........ ........ ........ ........ 4% 190M 2s 12288K ........ ........ ........ ........ ........ ........ 6% 184M 2s 15360K ........ ........ ........ ........ ........ ........ 7% 238M 2s 18432K ........ ........ ........ ........ ........ ........ 8% 148M 2s 21504K ........ ........ ........ ........ ........ ........ 9% 247M 2s 24576K ........ ........ ........ ........ ........ ........ 10% 275M 2s 27648K ........ ........ ........ ........ ........ ........ 12% 259M 1s 30720K ........ ........ ........ ........ ........ ........ 13% 254M 1s 33792K ........ ........ ........ ........ ........ ........ 14% 299M 1s 36864K ........ ........ ........ ........ ........ ........ 15% 254M 1s 39936K ........ ........ ........ ........ ........ ........ 16% 325M 1s 43008K ........ ........ ........ ........ ........ ........ 18% 282M 1s 46080K ........ ........ ........ ........ ........ ........ 19% 258M 1s 49152K ........ ........ ........ ........ ........ ........ 20% 298M 1s 52224K ........ ........ ........ ........ ........ ........ 21% 280M 1s 55296K ........ ........ ........ ........ ........ ........ 22% 246M 1s 58368K ........ ........ ........ ........ ........ ........ 24% 323M 1s 61440K ........ ........ ........ ........ ........ ........ 25% 310M 1s 64512K ........ ........ ........ ........ ........ ........ 26% 288M 1s 67584K ........ ........ ........ ........ ........ ........ 27% 314M 1s 70656K ........ ........ ........ ........ ........ ........ 28% 323M 1s 73728K ........ ........ ........ ........ ........ ........ 30% 321M 1s 76800K ........ ........ ........ ........ ........ ........ 31% 310M 1s 79872K ........ ........ ........ ........ ........ ........ 32% 309M 1s 82944K ........ ........ ........ ........ ........ ........ 33% 295M 1s 86016K ........ ........ ........ ........ ........ ........ 35% 311M 1s 89088K ........ ........ ........ ........ ........ ........ 36% 308M 1s 92160K ........ ........ ........ ........ ........ ........ 37% 311M 1s 95232K ........ ........ ........ ........ ........ ........ 38% 319M 1s 98304K ........ ........ ........ ........ ........ ........ 39% 314M 1s 101376K ........ ........ ........ ........ ........ ........ 41% 315M 1s 104448K ........ ........ ........ ........ ........ ........ 42% 281M 1s 107520K ........ ........ ........ ........ ........ ........ 43% 281M 1s 110592K ........ ........ ........ ........ ........ ........ 44% 324M 1s 113664K ........ ........ ........ ........ ........ ........ 45% 320M 1s 116736K ........ ........ ........ ........ ........ ........ 47% 316M 1s 119808K ........ ........ ........ ........ ........ ........ 48% 320M 1s 122880K ........ ........ ........ ........ ........ ........ 49% 314M 1s 125952K ........ ........ ........ ........ ........ ........ 50% 324M 1s 129024K ........ ........ ........ ........ ........ ........ 51% 311M 0s 132096K ........ ........ ........ ........ ........ ........ 53% 308M 0s 135168K ........ ........ ........ ........ ........ ........ 54% 313M 0s 138240K ........ ........ ........ ........ ........ ........ 55% 315M 0s 141312K ........ ........ ........ ........ ........ ........ 56% 314M 0s 144384K ........ ........ ........ ........ ........ ........ 57% 319M 0s 147456K ........ ........ ........ ........ ........ ........ 59% 317M 0s 150528K ........ ........ ........ ........ ........ ........ 60% 288M 0s 153600K ........ ........ ........ ........ ........ ........ 61% 326M 0s 156672K ........ ........ ........ ........ ........ ........ 62% 306M 0s 159744K ........ ........ ........ ........ ........ ........ 64% 319M 0s 162816K ........ ........ ........ ........ ........ ........ 65% 314M 0s 165888K ........ ........ ........ ........ ........ ........ 66% 326M 0s 168960K ........ ........ ........ ........ ........ ........ 67% 306M 0s 172032K ........ ........ ........ ........ ........ ........ 68% 310M 0s 175104K ........ ........ ........ ........ ........ ........ 70% 295M 0s 178176K ........ ........ ........ ........ ........ ........ 71% 307M 0s 181248K ........ ........ ........ ........ ........ ........ 72% 304M 0s 184320K ........ ........ ........ ........ ........ ........ 73% 291M 0s 187392K ........ ........ ........ ........ ........ ........ 74% 339M 0s 190464K ........ ........ ........ ........ ........ ........ 76% 288M 0s 193536K ........ ........ ........ ........ ........ ........ 77% 298M 0s 196608K ........ ........ ........ ........ ........ ........ 78% 310M 0s 199680K ........ ........ ........ ........ ........ ........ 79% 302M 0s 202752K ........ ........ ........ ........ ........ ........ 80% 311M 0s 205824K ........ ........ ........ ........ ........ ........ 82% 270M 0s 208896K ........ ........ ........ ........ ........ ........ 83% 290M 0s 211968K ........ ........ ........ ........ ........ ........ 84% 332M 0s 215040K ........ ........ ........ ........ ........ ........ 85% 232M 0s 218112K ........ ........ ........ ........ ........ ........ 86% 391M 0s 221184K ........ ........ ........ ........ ........ ........ 88% 315M 0s 224256K ........ ........ ........ ........ ........ ........ 89% 301M 0s 227328K ........ ........ ........ ........ ........ ........ 90% 234M 0s 230400K ........ ........ ........ ........ ........ ........ 91% 299M 0s 233472K ........ ........ ........ ........ ........ ........ 93% 349M 0s 236544K ........ ........ ........ ........ ........ ........ 94% 323M 0s 239616K ........ ........ ........ ........ ........ ........ 95% 292M 0s 242688K ........ ........ ........ ........ ........ ........ 96% 279M 0s 245760K ........ ........ ........ ........ ........ ........ 97% 293M 0s 248832K ........ ........ ........ ........ ........ ........ 99% 234M 0s 251904K ........ ........ ........ ........ ..... 100% 204M=0.9s 2024-02-03 23:10:19 (267 MB/s) - ‘karaf-0.18.4-20240126.210405-462.zip’ saved [260396460/260396460] Extracting the new controller... + echo 'Extracting the new controller...' + unzip -q karaf-0.18.4-20240126.210405-462.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features... + [[ True == \T\r\u\e ]] + echo 'Configuring the startup features...' + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.18.4-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.18.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.18.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/2ace7065-4c5a-4a00-966d-e6b12d2462cc.xml # # Comma separated list of features to install at startup # featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 5114a86c-98a1-4a9e-9d87-0bffe3c1d14b # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE + logapi=log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' controllerdebugmap: + unset IFS + echo 'controllerdebugmap: ' cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + '[' -n '' ']' + echo 'cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN + set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + local -r java_home=/usr/lib/jvm/java-17-openjdk + local -r controllermem=3072m + local -r memconf=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + echo Configure Configure + echo ' java home: /usr/lib/jvm/java-17-openjdk' java home: /usr/lib/jvm/java-17-openjdk max memory: 3072m memconf: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + echo ' max memory: 3072m' + echo ' memconf: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv' + cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1 + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "17.0.6-ea" 2023-01-17 LTS OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS) OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-17-openjdk + JAVA_HOME=/usr/lib/jvm/java-17-openjdk ++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java + JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java' Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java Listing all open ports on controller system... + echo 'Listing all open ports on controller system...' + netstat -pnatu (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 164 10.30.171.20:22 10.30.171.228:35814 ESTABLISHED - tcp 0 0 10.30.171.20:52116 199.204.45.87:443 TIME_WAIT - tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::22 :::* LISTEN - tcp6 0 0 :::111 :::* LISTEN - udp 0 0 10.30.171.20:68 10.30.170.2:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - + '[' -f /tmp/custom_shard_config.txt ']' Custom shard config exists!!! + echo 'Custom shard config exists!!!' + echo 'Copying the shard config...' Copying the shard config... + cp /tmp/custom_shard_config.txt /tmp/karaf-0.18.4-SNAPSHOT/bin/ Configuring cluster + echo 'Configuring cluster' + /tmp/karaf-0.18.4-SNAPSHOT/bin/configure_cluster.sh 3 10.30.171.15 10.30.171.76 10.30.171.20 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.18.4-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/7.0.11 Configuring unique name in akka.conf Configuring hostname in akka.conf Configuring data and rpc seed nodes in akka.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump akka.conf + echo 'Dump akka.conf' + cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf odl-cluster-data { akka { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.171.20" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.15:2550", "akka://opendaylight-cluster-data@10.30.171.76:2550", "akka://opendaylight-cluster-data@10.30.171.20:2550"] roles = ["member-3"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" # Use lz4 compression for LocalSnapshotStore snapshots snapshot-store.local.use-lz4-compression = false # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB snapshot-store.local.lz4-blocksize = 256KB } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car" shards = [ { name="car" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "people" shards = [ { name="people" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car-people" shards = [ { name="car-people" replicas = ["member-1", "member-2", "member-3"] } ] } ] Locating config plan to use... Finished running config plans Starting member-1 with IP address 10.30.171.15 Warning: Permanently added '10.30.171.15' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.15' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log Starting member-2 with IP address 10.30.171.76 Warning: Permanently added '10.30.171.76' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.76' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log Starting member-3 with IP address 10.30.171.20 Warning: Permanently added '10.30.171.20' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.20' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log [controller-csit-3node-clustering-ask-all-argon] $ /bin/bash /tmp/jenkins6207044829929266462.sh common-functions.sh is being sourced common-functions environment: MAVENCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv CONTROLLERMEM: 2048m AKKACONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf SUITES: + echo '#################################################' ################################################# + echo '## Verify Cluster is UP ##' ## Verify Cluster is UP ## + echo '#################################################' ################################################# + create_post_startup_script + cat + copy_and_run_post_startup_script + seed_index=1 ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Execute the post startup script on controller 10.30.171.15' Execute the post startup script on controller 10.30.171.15 + scp /w/workspace/controller-csit-3node-clustering-ask-all-argon/post-startup-script.sh 10.30.171.15:/tmp/ Warning: Permanently added '10.30.171.15' (ECDSA) to the list of known hosts. + ssh 10.30.171.15 'bash /tmp/post-startup-script.sh 1' Warning: Permanently added '10.30.171.15' (ECDSA) to the list of known hosts. tcp6 0 0 :::8101 :::* LISTEN Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2024-02-03T23:11:30,018 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 301 - org.opendaylight.infrautils.ready-api - 5.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2024-02-03T23:11:30,018 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 301 - org.opendaylight.infrautils.ready-api - 5.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 0 10.30.171.15:22 10.30.171.228:45108 ESTABLISHED - tcp6 0 0 :::12345 :::* LISTEN 5836/java tcp6 0 0 127.0.0.1:44444 :::* LISTEN 5836/java tcp6 0 0 :::6653 :::* LISTEN 5836/java tcp6 0 0 :::4189 :::* LISTEN 5836/java tcp6 0 0 :::1790 :::* LISTEN 5836/java tcp6 0 0 :::8101 :::* LISTEN 5836/java tcp6 0 0 :::6633 :::* LISTEN 5836/java tcp6 0 0 127.0.0.1:1099 :::* LISTEN 5836/java tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 :::6640 :::* LISTEN 5836/java tcp6 0 0 127.0.0.1:42545 :::* LISTEN 5836/java tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::8181 :::* LISTEN 5836/java tcp6 0 0 10.30.171.15:2550 :::* LISTEN 5836/java tcp6 0 0 :::22 :::* LISTEN - tcp6 0 0 127.0.0.1:60174 127.0.0.1:1099 TIME_WAIT - tcp6 0 0 10.30.171.15:34040 10.30.171.20:2550 ESTABLISHED 5836/java tcp6 0 0 10.30.171.15:37566 10.30.171.76:2550 ESTABLISHED 5836/java tcp6 0 0 10.30.171.15:34024 10.30.171.20:2550 ESTABLISHED 5836/java tcp6 0 0 10.30.171.15:2550 10.30.171.76:38350 ESTABLISHED 5836/java tcp6 0 0 127.0.0.1:43216 127.0.0.1:44444 TIME_WAIT - tcp6 32 0 10.30.171.15:40744 199.204.45.87:443 CLOSE_WAIT 5836/java tcp6 0 0 10.30.171.15:37554 10.30.171.76:2550 ESTABLISHED 5836/java tcp6 0 0 127.0.0.1:43224 127.0.0.1:44444 TIME_WAIT - tcp6 0 0 10.30.171.15:2550 10.30.171.76:38344 ESTABLISHED 5836/java tcp6 0 0 10.30.171.15:2550 10.30.171.20:59606 ESTABLISHED 5836/java tcp6 0 0 10.30.171.15:2550 10.30.171.20:59590 ESTABLISHED 5836/java tcp6 0 0 127.0.0.1:60170 127.0.0.1:1099 TIME_WAIT - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp 0 0 10.30.171.15:68 10.30.170.4:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp6 0 0 ::1:323 :::* - udp6 0 0 :::4342 :::* 5836/java udp6 0 0 :::111 :::* - looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 1 == 0 ']' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Execute the post startup script on controller 10.30.171.76' Execute the post startup script on controller 10.30.171.76 + scp /w/workspace/controller-csit-3node-clustering-ask-all-argon/post-startup-script.sh 10.30.171.76:/tmp/ Warning: Permanently added '10.30.171.76' (ECDSA) to the list of known hosts. + ssh 10.30.171.76 'bash /tmp/post-startup-script.sh 2' Warning: Permanently added '10.30.171.76' (ECDSA) to the list of known hosts. tcp6 0 0 :::8101 :::* LISTEN Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2024-02-03T23:11:29,894 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 301 - org.opendaylight.infrautils.ready-api - 5.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2024-02-03T23:11:29,894 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 301 - org.opendaylight.infrautils.ready-api - 5.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 164 10.30.171.76:22 10.30.171.228:56770 ESTABLISHED - tcp6 0 0 :::8101 :::* LISTEN 5825/java tcp6 0 0 :::6633 :::* LISTEN 5825/java tcp6 0 0 127.0.0.1:1099 :::* LISTEN 5825/java tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 :::6640 :::* LISTEN 5825/java tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::8181 :::* LISTEN 5825/java tcp6 0 0 10.30.171.76:2550 :::* LISTEN 5825/java tcp6 0 0 :::22 :::* LISTEN - tcp6 0 0 127.0.0.1:44444 :::* LISTEN 5825/java tcp6 0 0 :::6653 :::* LISTEN 5825/java tcp6 0 0 :::1790 :::* LISTEN 5825/java tcp6 0 0 127.0.0.1:44863 :::* LISTEN 5825/java tcp6 0 0 10.30.171.76:57868 10.30.171.20:2550 ESTABLISHED 5825/java tcp6 0 0 127.0.0.1:50642 127.0.0.1:44444 TIME_WAIT - tcp6 0 0 10.30.171.76:38344 10.30.171.15:2550 ESTABLISHED 5825/java tcp6 0 0 10.30.171.76:2550 10.30.171.15:37566 ESTABLISHED 5825/java tcp6 0 0 10.30.171.76:38350 10.30.171.15:2550 ESTABLISHED 5825/java tcp6 32 0 10.30.171.76:55862 199.204.45.87:443 CLOSE_WAIT 5825/java tcp6 0 0 10.30.171.76:2550 10.30.171.15:37554 ESTABLISHED 5825/java tcp6 0 0 10.30.171.76:57866 10.30.171.20:2550 ESTABLISHED 5825/java tcp6 0 0 127.0.0.1:40812 127.0.0.1:1099 TIME_WAIT - tcp6 0 0 10.30.171.76:2550 10.30.171.20:53690 ESTABLISHED 5825/java tcp6 0 0 127.0.0.1:50640 127.0.0.1:44444 TIME_WAIT - tcp6 0 0 10.30.171.76:2550 10.30.171.20:53696 ESTABLISHED 5825/java udp 0 0 10.30.171.76:68 10.30.170.2:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - udp6 0 0 :::4342 :::* 5825/java looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 2 == 0 ']' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Execute the post startup script on controller 10.30.171.20' Execute the post startup script on controller 10.30.171.20 + scp /w/workspace/controller-csit-3node-clustering-ask-all-argon/post-startup-script.sh 10.30.171.20:/tmp/ Warning: Permanently added '10.30.171.20' (ECDSA) to the list of known hosts. + ssh 10.30.171.20 'bash /tmp/post-startup-script.sh 3' Warning: Permanently added '10.30.171.20' (ECDSA) to the list of known hosts. tcp6 0 0 :::8101 :::* LISTEN Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2024-02-03T23:11:26,520 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 301 - org.opendaylight.infrautils.ready-api - 5.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2024-02-03T23:11:26,520 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 301 - org.opendaylight.infrautils.ready-api - 5.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 164 10.30.171.20:22 10.30.171.228:42398 ESTABLISHED - tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::8181 :::* LISTEN 5823/java tcp6 0 0 10.30.171.20:2550 :::* LISTEN 5823/java tcp6 0 0 :::22 :::* LISTEN - tcp6 0 0 127.0.0.1:40727 :::* LISTEN 5823/java tcp6 0 0 127.0.0.1:44444 :::* LISTEN 5823/java tcp6 0 0 :::6653 :::* LISTEN 5823/java tcp6 0 0 :::1790 :::* LISTEN 5823/java tcp6 0 0 :::8101 :::* LISTEN 5823/java tcp6 0 0 :::6633 :::* LISTEN 5823/java tcp6 0 0 127.0.0.1:1099 :::* LISTEN 5823/java tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 :::6640 :::* LISTEN 5823/java tcp6 0 0 10.30.171.20:2550 10.30.171.76:57868 ESTABLISHED 5823/java tcp6 0 0 10.30.171.20:2550 10.30.171.15:34040 ESTABLISHED 5823/java tcp6 0 0 10.30.171.20:2550 10.30.171.15:34024 ESTABLISHED 5823/java tcp6 0 0 127.0.0.1:46722 127.0.0.1:44444 TIME_WAIT - tcp6 0 0 10.30.171.20:53690 10.30.171.76:2550 ESTABLISHED 5823/java tcp6 0 0 10.30.171.20:59590 10.30.171.15:2550 ESTABLISHED 5823/java tcp6 0 0 127.0.0.1:40624 127.0.0.1:1099 TIME_WAIT - tcp6 0 0 10.30.171.20:2550 10.30.171.76:57866 ESTABLISHED 5823/java tcp6 0 0 10.30.171.20:59606 10.30.171.15:2550 ESTABLISHED 5823/java tcp6 0 0 10.30.171.20:53696 10.30.171.76:2550 ESTABLISHED 5823/java tcp6 32 0 10.30.171.20:46066 199.204.45.87:443 CLOSE_WAIT 5823/java udp 0 0 10.30.171.20:68 10.30.170.2:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::4342 :::* 5823/java udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 0 == 0 ']' + seed_index=1 + dump_controller_threads ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.171.15 'sudo ps aux' Warning: Permanently added '10.30.171.15' (ECDSA) to the list of known hosts. ++ tr -s ' ' ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-argon/ps_before.log ++ grep -v grep ++ cut -f2 '-d ' + pid=5836 + echo 'karaf main: org.apache.karaf.main.Main, pid:5836' karaf main: org.apache.karaf.main.Main, pid:5836 + ssh 10.30.171.15 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5836' Warning: Permanently added '10.30.171.15' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.171.76 'sudo ps aux' Warning: Permanently added '10.30.171.76' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-argon/ps_before.log ++ grep -v grep ++ tr -s ' ' ++ cut -f2 '-d ' + pid=5825 + echo 'karaf main: org.apache.karaf.main.Main, pid:5825' karaf main: org.apache.karaf.main.Main, pid:5825 + ssh 10.30.171.76 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5825' Warning: Permanently added '10.30.171.76' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.171.20 'sudo ps aux' Warning: Permanently added '10.30.171.20' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-argon/ps_before.log ++ grep -v grep ++ cut -f2 '-d ' ++ tr -s ' ' + pid=5823 + echo 'karaf main: org.apache.karaf.main.Main, pid:5823' karaf main: org.apache.karaf.main.Main, pid:5823 + ssh 10.30.171.20 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5823' Warning: Permanently added '10.30.171.20' (ECDSA) to the list of known hosts. + '[' 0 -gt 0 ']' + echo 'Generating controller variables...' Generating controller variables... ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.15' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.15 -v ODL_SYSTEM_2_IP:10.30.171.76' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.15 -v ODL_SYSTEM_2_IP:10.30.171.76 -v ODL_SYSTEM_3_IP:10.30.171.20' + echo 'Generating mininet variables...' Generating mininet variables... ++ seq 1 0 + get_test_suites SUITES + local __suite_list=SUITES + echo 'Locating test plan to use...' Locating test plan to use... + testplan_filepath=/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/testplans/controller-clustering-ask-argon.txt + '[' '!' -f /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/testplans/controller-clustering-ask-argon.txt ']' + testplan_filepath=/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/testplans/controller-clustering-ask.txt + '[' disabled '!=' disabled ']' + echo 'Changing the testplan path...' Changing the testplan path... + sed s:integration:/w/workspace/controller-csit-3node-clustering-ask-all-argon: /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/testplans/controller-clustering-ask.txt + cat testplan.txt # Place the suites in run order: /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot + '[' -z '' ']' ++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt ++ tr '\012' ' ' + suite_list='/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ' + eval 'SUITES='\''/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '\''' ++ SUITES='/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ' + echo 'Starting Robot test suites /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ...' Starting Robot test suites /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ... + robot -N controller-clustering-ask.txt --removekeywords wuks -e exclude -e skip_if_argon -v BUNDLEFOLDER:karaf-0.18.4-SNAPSHOT -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240126.210405-462.zip -v CONTROLLER:10.30.171.15 -v CONTROLLER1:10.30.171.76 -v CONTROLLER2:10.30.171.20 -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-17-openjdk -v JDKVERSION:openjdk17 -v JENKINS_WORKSPACE:/w/workspace/controller-csit-3node-clustering-ask-all-argon -v MININET: -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:3 -v NUM_TOOLS_SYSTEM:0 -v ODL_STREAM:argon -v ODL_SYSTEM_IP:10.30.171.15 -v ODL_SYSTEM_1_IP:10.30.171.15 -v ODL_SYSTEM_2_IP:10.30.171.76 -v ODL_SYSTEM_3_IP:10.30.171.20 -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP: -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ============================================================================== controller-clustering-ask.txt ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Rpc Provider Precedence :: DOMRpcBroker testi... ============================================================================== Register_Rpc_On_Each_Node :: Register global rpc on each node of t... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_precedence_register_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_register_rpc_on_each_node&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.15:8181/restconf/operations/odl-mdsal-lowlevel-control:register-constant ------------------------------------------------------------------------------ Invoke_Rpc_On_Each_Node :: Verify that the rpc response comes from... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.15:8181/restconf/operations/odl-mdsal-lowlevel-target:get-constant ------------------------------------------------------------------------------ Unregister_Rpc_On_Node :: Unregister the rpc on one of the cluster... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_precedence_unregister_rpc_on_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_unregister_rpc_on_node&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.15:8181/restconf/operations/odl-mdsal-lowlevel-control:unregister-constant ------------------------------------------------------------------------------ Invoke_Rpc_On_Node_With_Unregistered_Rpc :: Invoke rcp on the node... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_node_with_unregistered_rpc" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_node_with_unregistered_rpc&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.15:8181/restconf/operations/odl-mdsal-lowlevel-target:get-constant ------------------------------------------------------------------------------ Invoke_Rpc_On_Remaining_Nodes :: Verify that the rpc response come... | PASS | ------------------------------------------------------------------------------ Reregister_Rpc_On_Node :: Reregister the rpc. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_precedence_reregister_rpc_on_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_reregister_rpc_on_node&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.15:8181/restconf/operations/odl-mdsal-lowlevel-control:register-constant ------------------------------------------------------------------------------ Invoke_Rpc_On_Each_Node_Again :: Verify that the rpc response come... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node_again" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node_again&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.15:8181/restconf/operations/odl-mdsal-lowlevel-target:get-constant ------------------------------------------------------------------------------ Unregister_Rpc_On_Each_Node :: Unregister rpc on every node. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_precedence_unregister_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_unregister_rpc_on_each_node&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.15:8181/restconf/operations/odl-mdsal-lowlevel-control:unregister-constant ------------------------------------------------------------------------------ controller-clustering-ask.txt.Rpc Provider Precedence :: DOMRpcBro... | FAIL | 8 tests, 1 passed, 7 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Rpc Provider Partition And Heal :: DOMRpcBrok... ============================================================================== Register_Rpc_On_Two_Nodes :: Register rpc on two nodes of the odl ... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_partition_and_heal_register_rpc_on_two_nodes" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_register_rpc_on_two_nodes&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.15:8181/restconf/operations/odl-mdsal-lowlevel-control:register-constant ------------------------------------------------------------------------------ Invoke_Rpc_On_Each_Node :: Invoke get-constant rpc on every node o... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node&order=bug_status" Keyword 'Verify_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: HTTPError: 404 Client Error: Not Found for url: http://10.30.171.15:8181/restconf/operations/odl-mdsal-lowlevel-target:get-constant ------------------------------------------------------------------------------ Isolate_One_Node :: Isolate one node with registered rpc. From the... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_partition_and_heal_isolate_one_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_isolate_one_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Invoke_Rpc_On_Nonisolated_Nodes :: Invoke rpc on non-islolated nodes. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_nonisolated_nodes" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_nonisolated_nodes&order=bug_status" Keyword 'DrbCommons.Verify_Constant_On_Active_Nodes' failed after retrying for 1 minute. The last error was: Keyword 'Verify_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: HTTPError: 404 Client Error: Not Found for url: http://10.30.171.15:8181/restconf/operations/odl-mdsal-lowlevel-target:get-constant ------------------------------------------------------------------------------ Rejoin_Isolated_Member :: Rejoin isolated node | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_partition_and_heal_rejoin_isolated_member" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_rejoin_isolated_member&order=bug_status" Variable '${isolated_idx}' not found. ------------------------------------------------------------------------------ Invoke_Rpc_On_Each_Node_Again :: Invoke rpc get-constant on every ... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node_again" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node_again&order=bug_status" Keyword 'Verify_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: HTTPError: 404 Client Error: Not Found for url: http://10.30.171.15:8181/restconf/operations/odl-mdsal-lowlevel-target:get-constant ------------------------------------------------------------------------------ Unregister_Rpc_On_Each_Node :: Inregister rpc on both nodes. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_partition_and_heal_unregister_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_unregister_rpc_on_each_node&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.15:8181/restconf/operations/odl-mdsal-lowlevel-control:unregister-constant ------------------------------------------------------------------------------ controller-clustering-ask.txt.Rpc Provider Partition And Heal :: D... | FAIL | 7 tests, 0 passed, 7 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Action Provider Precedence :: DOMRpcBroker te... ============================================================================== Register_Rpc_On_Each_Node :: Register routed rpc on each node of t... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_precedence_register_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_register_rpc_on_each_node&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.15:8181/restconf/operations/odl-mdsal-lowlevel-control:register-bound-constant ------------------------------------------------------------------------------ Invoke_Rpc_On_Each_Node :: Verify that the rpc response comes from... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.15:8181/restconf/operations/odl-mdsal-lowlevel-target:get-contexted-constant ------------------------------------------------------------------------------ Unregister_Rpc_On_Node :: Unregister the rpc on one of the cluster... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_precedence_unregister_rpc_on_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_unregister_rpc_on_node&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.15:8181/restconf/operations/odl-mdsal-lowlevel-control:unregister-bound-constant ------------------------------------------------------------------------------ Invoke_Rpc_On_Node_With_Unregistered_Rpc :: Invoke rcp on the node... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_node_with_unregistered_rpc" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_node_with_unregistered_rpc&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.15:8181/restconf/operations/odl-mdsal-lowlevel-target:get-contexted-constant ------------------------------------------------------------------------------ Invoke_Rpc_On_Remaining_Nodes :: Verify that the rpc response come... | PASS | ------------------------------------------------------------------------------ Reregister_Rpc_On_Node :: Reregister the rpc. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_precedence_reregister_rpc_on_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_reregister_rpc_on_node&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.15:8181/restconf/operations/odl-mdsal-lowlevel-control:register-bound-constant ------------------------------------------------------------------------------ Invoke_Rpc_On_Each_Node_Again :: Verify that the rpc response come... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node_again" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node_again&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.15:8181/restconf/operations/odl-mdsal-lowlevel-target:get-contexted-constant ------------------------------------------------------------------------------ Unregister_Rpc_On_Each_Node :: Unregister rpc on every node. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_precedence_unregister_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_unregister_rpc_on_each_node&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.15:8181/restconf/operations/odl-mdsal-lowlevel-control:unregister-bound-constant ------------------------------------------------------------------------------ controller-clustering-ask.txt.Action Provider Precedence :: DOMRpc... | FAIL | 8 tests, 1 passed, 7 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Action Provider Partition And Heal :: DOMRpcB... ============================================================================== Register_Rpc_On_Two_Nodes :: Register rpc on two nodes of the odl ... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_partition_and_heal_register_rpc_on_two_nodes" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_register_rpc_on_two_nodes&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.15:8181/restconf/operations/odl-mdsal-lowlevel-control:register-bound-constant ------------------------------------------------------------------------------ Invoke_Rpc_On_Each_Node :: Invoke get-contexted-constant rpc on ev... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node&order=bug_status" Keyword 'Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: HTTPError: 404 Client Error: Not Found for url: http://10.30.171.15:8181/restconf/operations/odl-mdsal-lowlevel-target:get-contexted-constant ------------------------------------------------------------------------------ Isolate_One_Node :: Isolate one node with registered rpc. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_partition_and_heal_isolate_one_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_isolate_one_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Invoke_Rpc_On_Remaining_Nodes :: Invoke rpc on non-islolated nodes... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_remaining_nodes" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_remaining_nodes&order=bug_status" Keyword 'DrbCommons.Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 1 minute. The last error was: Keyword 'Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: HTTPError: 404 Client Error: Not Found for url: http://10.30.171.15:8181/restconf/operations/odl-mdsal-lowlevel-target:get-contexted-constant ------------------------------------------------------------------------------ Rejoin_Isolated_Member :: Rejoin isolated node | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_partition_and_heal_rejoin_isolated_member" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_rejoin_isolated_member&order=bug_status" Variable '${isolated_idx}' not found. ------------------------------------------------------------------------------ Invoke_Rpc_On_Each_Node_Again :: Invoke rpc get-contexted-constant... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node_again" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node_again&order=bug_status" Keyword 'Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: HTTPError: 404 Client Error: Not Found for url: http://10.30.171.15:8181/restconf/operations/odl-mdsal-lowlevel-target:get-contexted-constant ------------------------------------------------------------------------------ Unregister_Rpc_On_Each_Node :: Inregister rpc on both nodes. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_partition_and_heal_unregister_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_unregister_rpc_on_each_node&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.15:8181/restconf/operations/odl-mdsal-lowlevel-control:unregister-bound-constant ------------------------------------------------------------------------------ controller-clustering-ask.txt.Action Provider Partition And Heal :... | FAIL | 7 tests, 0 passed, 7 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Master Stability :: Cluster Singleton testing... ============================================================================== Register_Singleton_Constant_On_Each_Node_And_Verify :: Register a ... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_master_stability_register_singleton_constant_on_each_node_and_verify" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_register_singleton_constant_on_each_node_and_verify&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.15:8181/restconf/operations/odl-mdsal-lowlevel-control:register-singleton-constant ------------------------------------------------------------------------------ Unregister_Singleton_Constant_On_Non_Master_Node :: Unregister the... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_non_master_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_non_master_node&order=bug_status" Variable '@{cs_candidates}' not found. Did you mean: @{cs_exp_candidates} ------------------------------------------------------------------------------ Monitor_Stability_While_Unregistered :: Verify that the owner rema... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_master_stability_monitor_stability_while_unregistered" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_monitor_stability_while_unregistered&order=bug_status" Variable '${cs_owner}' not found. ------------------------------------------------------------------------------ Reregister_Singleton_Constant :: Re-register the unregistered cand... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_master_stability_reregister_singleton_constant" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_reregister_singleton_constant&order=bug_status" Variable '${unregistered_node}' not found. ------------------------------------------------------------------------------ Verify_Stability_After_Reregistration :: Verify that the owner rem... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_master_stability_verify_stability_after_reregistration" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_verify_stability_after_reregistration&order=bug_status" Variable '${cs_owner}' not found. ------------------------------------------------------------------------------ Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_each_node&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.15:8181/restconf/operations/odl-mdsal-lowlevel-control:unregister-singleton-constant ------------------------------------------------------------------------------ controller-clustering-ask.txt.Master Stability :: Cluster Singleto... | FAIL | 6 tests, 0 passed, 6 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Partition And Heal :: Cluster Singleton testi... ============================================================================== Register_Singleton_Constant_On_Each_Node :: Register a candidate a... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_partition_and_heal_register_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_register_singleton_constant_on_each_node&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.15:8181/restconf/operations/odl-mdsal-lowlevel-control:register-singleton-constant ------------------------------------------------------------------------------ Verify_Singleton_Constant_On_Each_Node :: Store the owner and cand... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_partition_and_heal_verify_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_verify_singleton_constant_on_each_node&order=bug_status" Could not parse owner and candidates for device get-singleton-constant-service'] ------------------------------------------------------------------------------ Isolate_Owner_Node :: Isolate the cluster node which is the owner.... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_partition_and_heal_isolate_owner_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_isolate_owner_node&order=bug_status" Variable '${cs_owner}' not found. ------------------------------------------------------------------------------ Monitor_Stability_While_Isolated :: Monitor the stability of the s... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_partition_and_heal_monitor_stability_while_isolated" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_monitor_stability_while_isolated&order=bug_status" Invalid IF condition: Evaluating expression '"${index}" == "${cs_isolated_index}"' failed: Variable '${cs_isolated_index}' not found. ------------------------------------------------------------------------------ Rejoin_Isolated_node :: Rejoin isolated node. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_partition_and_heal_rejoin_isolated_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_rejoin_isolated_node&order=bug_status" Variable '${cs_isolated_index}' not found. ------------------------------------------------------------------------------ Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_partition_and_heal_unregister_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_unregister_singleton_constant_on_each_node&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.15:8181/restconf/operations/odl-mdsal-lowlevel-control:unregister-singleton-constant ------------------------------------------------------------------------------ controller-clustering-ask.txt.Partition And Heal :: Cluster Single... | FAIL | 6 tests, 0 passed, 6 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Chasing The Leader :: Cluster Singleton testi... ============================================================================== Register_Candidates :: Register a candidate application on each no... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_chasing_the_leader_register_candidates" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_chasing_the_leader_register_candidates&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.15:8181/restconf/operations/odl-mdsal-lowlevel-control:register-flapping-singleton ------------------------------------------------------------------------------ Do_Nothing :: Do nothing for the time of the test duration, becaus... | PASS | ------------------------------------------------------------------------------ Unregister_Candidates_And_Validate_Criteria :: Unregister the test... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_chasing_the_leader_unregister_candidates_and_validate_criteria" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_chasing_the_leader_unregister_candidates_and_validate_criteria&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.15:8181/restconf/operations/odl-mdsal-lowlevel-control:unregister-flapping-singleton ------------------------------------------------------------------------------ controller-clustering-ask.txt.Chasing The Leader :: Cluster Single... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Global Rpc Kill :: Controller functional HA t... ============================================================================== Get_Basic_Rpc_Test_Owner :: Find a service owner and successors. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_Before_Stopping_On_Owner :: Run rpc on the service owner. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_Before_Stop_On_Successors :: Run rpc on non owher cluster nodes. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Stop_Current_Owner_Member :: Stop cluster node which is the owner. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Verify_New_Basic_Rpc_Test_Owner_Elected :: Verify new owner of the... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_On_Remained_Cluster_Nodes :: Run rpc on remained cluster nodes. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Restart_Stopped_Member :: Restart stopped node | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Verify_New_Owner_Remained_After_Rejoin :: Verify no owner change h... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_New_Owner :: Run rpc on the new service owner ... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_Old_Owner :: Run rpc on rejoined cluster node. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_All :: Run rpc again on all nodes. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ controller-clustering-ask.txt.Global Rpc Kill :: Controller functi... | FAIL | Suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . 11 tests, 0 passed, 11 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Global Rpc Freeze :: Controller functional HA... ============================================================================== Get_Basic_Rpc_Test_Owner :: Find a service owner and successors. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_Before_Freezing_On_Owner :: Run rpc on the service owner. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_Before_Freeze_On_Successors :: Run rpc on non owher cluster no... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Freeze_Current_Owner_Member :: Stop cluster node which is the owner. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Verify_New_Basic_Rpc_Test_Owner_Elected :: Verify new owner of the... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_On_Remained_Cluster_Nodes :: Run rpc on remained cluster nodes. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Unfreeze_Frozen_Member :: Restart frozen node | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_New_Owner :: Run rpc on the new service owner ... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_Old_Owner :: Run rpc on rejoined cluster node. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_All :: Run rpc again on all nodes. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ controller-clustering-ask.txt.Global Rpc Freeze :: Controller func... | FAIL | Suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . 10 tests, 0 passed, 10 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Global Rpc Isolate :: Controller functional H... ============================================================================== Get_Basic_Rpc_Test_Owner :: Find a service owner and successors. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_Before_Isolation_On_Owner :: Run rpc on the service owner. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_Before_Isolation_On_Successors :: Run rpc on non owher cluster... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Isolate_Current_Owner_Member :: Isolating cluster node which is th... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Verify_New_Basic_Rpc_Test_Owner_Elected :: Verify new owner of the... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_On_Isolated_Node :: Run rpc on isolated cluster node. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_On_Non_Isolated_Cluster_Nodes :: Run rpc on remained cluster n... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rejoin_Isolated_Member :: Rejoin isolated node | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_New_Owner :: Run rpc on the new service owner ... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_Old_Owner :: Run rpc on rejoined cluster node. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_All :: Run rpc again on all nodes. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ controller-clustering-ask.txt.Global Rpc Isolate :: Controller fun... | FAIL | Suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . 11 tests, 0 passed, 11 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Carpeople Crud :: Suite for performing basic ... ============================================================================== [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. Add_Cars_To_Leader :: Add 30 cars to car Leader by one big PUT. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Added_Cars_On_Leader :: GET response from Leader should match ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Added_Cars_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Add_People_To_First_Follower :: Add 30 people to people first Foll... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Added_People_On_Leader :: GET response from Leader should matc... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Added_People_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Leader :: Buy some cars on car-people Leader, loop of ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Followers :: On each Follower buy corresponding ID seg... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Added_CarPeople_On_Leader :: GET car-person mappings from Lead... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Added_CarPeople_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_CarPeople_On_Leader :: DELETE car-people container. No ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_People_On_Leader :: DELETE people container. No verific... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_Cars_On_Leader :: DELETE cars container. No verificatio... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Carpeople Crud :: Suite for performi... | FAIL | Suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) 13 tests, 0 passed, 13 failed ============================================================================== controller-clustering-ask.txt.Car Failover Crud :: Suite mixing basic opera... ============================================================================== [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Stop_Original_Car_Leader :: Stop the car Leader to cause a new lea... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Start_Old_Car_Leader :: Start the stopped member without deleting ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Car Failover Crud :: Suite mixing ba... | FAIL | Suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) 16 tests, 0 passed, 16 failed ============================================================================== controller-clustering-ask.txt.Car Persistence Recovery :: This test restart... ============================================================================== [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. Add_Cars_On_Leader_And_Verify :: Single big PUT to datastore to ad... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Stop_All_Members :: Stop all controllers. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Start_All_Members :: Start all controllers (should restore the per... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Memorize_Leader_And_Followers :: Locate current Leader of car Shard. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Cars_On_Leader :: GET cars from Leader, should match the PUT d... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Cars_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_Cars_On_Leader :: Delete cars on the new Leader. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Car Persistence Recovery :: This tes... | FAIL | Suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) 7 tests, 0 passed, 7 failed ============================================================================== controller-clustering-ask.txt.Buycar Failover :: This test focuses on testi... ============================================================================== [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Reboot_People_Leader :: Previous people Leader is rebooted. We sho... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Leader_After_Reboot_And_Verify :: Buy some cars on the... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Follower_After_Reboot_And_Verify :: Buy some cars on t... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_People :: DELETE people container. No verification beyo... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Buycar Failover :: This test focuses... | FAIL | Suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) 10 tests, 0 passed, 10 failed ============================================================================== controller-clustering-ask.txt.Entity Isolate :: Suite for performing member... ============================================================================== [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. Check All Shards Before Isolate :: Check all shards in controller. | FAIL | Parent suite setup failed: Dictionary does not contain key 'value'. ------------------------------------------------------------------------------ Isolate Entity Leader :: Isolate the entity-ownership Leader to ca... | FAIL | Parent suite setup failed: Dictionary does not contain key 'value'. ------------------------------------------------------------------------------ Check All Shards After Isolate :: Check all shards in controller. | FAIL | Parent suite setup failed: Dictionary does not contain key 'value'. ------------------------------------------------------------------------------ Rejoin Entity Leader :: Rejoin the entity-ownership Leader. | FAIL | Parent suite setup failed: Dictionary does not contain key 'value'. ------------------------------------------------------------------------------ Check All Shards After Rejoin :: Check all shards in controller. | FAIL | Parent suite setup failed: Dictionary does not contain key 'value'. ------------------------------------------------------------------------------ controller-clustering-ask.txt.Entity Isolate :: Suite for performi... | FAIL | Suite setup failed: Dictionary does not contain key 'value'. 5 tests, 0 passed, 5 failed ============================================================================== controller-clustering-ask.txt.Buycar Failover Isolation :: This test focuse... ============================================================================== [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Isolate_and_Rejoin_People_Leader :: Previous people Leader is isol... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Leader_After_Rejoin_And_Verify :: Buy some cars on the... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Follower_After_Rejoin_And_Verify :: Buy some cars on t... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_People :: DELETE people container. No verification beyo... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Buycar Failover Isolation :: This te... | FAIL | Suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) 10 tests, 0 passed, 10 failed ============================================================================== controller-clustering-ask.txt.Car Failover Crud Isolation :: Suite mixing b... ============================================================================== [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Isolate_Original_Car_Leader :: Isolate the car Leader to cause a n... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Rejoin_Old_Car_Leader :: Rejoin the isolated member without deleti... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Car Failover Crud Isolation :: Suite... | FAIL | Suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) 16 tests, 0 passed, 16 failed ============================================================================== controller-clustering-ask.txt.Car Outage Corners :: Cluster suite for testi... ============================================================================== [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. Stop_Majority_Of_The_Followers :: Stop half plus one car Follower ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Attempt_To_Add_Cars_To_Leader :: Adding cars should fail, as major... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Start_Tipping_Follower :: Start one Follower member without persis... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Add_Cars_On_Tipping_Follower :: Add cars on the tipping Follower. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Cars_On_Existing_Members :: On each up member: GET cars, shoul... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Start_Other_Followers :: Start other followers without persisted d... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Cars_On_New_Follower_Leader :: GET cars from a new follower to... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_Cars_On_Leader :: Delete cars on Leader. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Car Outage Corners :: Cluster suite ... | FAIL | Suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.20', port=8181): Read timed out. (read timeout=5.0) 8 tests, 0 passed, 8 failed ============================================================================== controller-clustering-ask.txt | FAIL | 195 tests, 14 passed, 181 failed ============================================================================== Output: /w/workspace/controller-csit-3node-clustering-ask-all-argon/output.xml Log: /w/workspace/controller-csit-3node-clustering-ask-all-argon/log.html Report: /w/workspace/controller-csit-3node-clustering-ask-all-argon/report.html + true + echo 'Examining the files in data/log and checking filesize' Examining the files in data/log and checking filesize + ssh 10.30.171.15 'ls -altr /tmp/karaf-0.18.4-SNAPSHOT/data/log/' Warning: Permanently added '10.30.171.15' (ECDSA) to the list of known hosts. total 70020 drwxrwxr-x. 2 jenkins jenkins 48 Feb 3 23:10 . -rw-rw-r--. 1 jenkins jenkins 1720 Feb 3 23:10 karaf_console.log drwxrwxr-x. 9 jenkins jenkins 149 Feb 4 02:33 .. -rw-rw-r--. 1 jenkins jenkins 42941333 Feb 4 02:48 karaf.log + ssh 10.30.171.15 'du -hs /tmp/karaf-0.18.4-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.171.15' (ECDSA) to the list of known hosts. 4.0K /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log 69M /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log + ssh 10.30.171.76 'ls -altr /tmp/karaf-0.18.4-SNAPSHOT/data/log/' Warning: Permanently added '10.30.171.76' (ECDSA) to the list of known hosts. total 73156 drwxrwxr-x. 2 jenkins jenkins 48 Feb 3 23:10 . -rw-rw-r--. 1 jenkins jenkins 1720 Feb 3 23:10 karaf_console.log drwxrwxr-x. 9 jenkins jenkins 149 Feb 4 02:33 .. -rw-rw-r--. 1 jenkins jenkins 46243114 Feb 4 02:48 karaf.log + ssh 10.30.171.76 'du -hs /tmp/karaf-0.18.4-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.171.76' (ECDSA) to the list of known hosts. 4.0K /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log 72M /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log + ssh 10.30.171.20 'ls -altr /tmp/karaf-0.18.4-SNAPSHOT/data/log/' Warning: Permanently added '10.30.171.20' (ECDSA) to the list of known hosts. total 65660 drwxrwxr-x. 2 jenkins jenkins 48 Feb 3 23:10 . -rw-rw-r--. 1 jenkins jenkins 190297 Feb 3 23:39 karaf_console.log drwxrwxr-x. 4 jenkins jenkins 28 Feb 4 02:33 .. -rw-rw-r--. 1 jenkins jenkins 54494449 Feb 4 02:48 karaf.log + ssh 10.30.171.20 'du -hs /tmp/karaf-0.18.4-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.171.20' (ECDSA) to the list of known hosts. 188K /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log 64M /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log + set +e ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.171.15 'sudo ps aux' Warning: Permanently added '10.30.171.15' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-argon/ps_after.log ++ grep -v grep ++ cut -f2 '-d ' ++ tr -s ' ' + pid=31686 + echo 'karaf main: org.apache.karaf.main.Main, pid:31686' karaf main: org.apache.karaf.main.Main, pid:31686 + ssh 10.30.171.15 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 31686' Warning: Permanently added '10.30.171.15' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.171.15 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.171.15' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.171.76 'sudo ps aux' Warning: Permanently added '10.30.171.76' (ECDSA) to the list of known hosts. ++ tr -s ' ' ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-argon/ps_after.log ++ grep -v grep ++ cut -f2 '-d ' + pid=30768 + echo 'karaf main: org.apache.karaf.main.Main, pid:30768' karaf main: org.apache.karaf.main.Main, pid:30768 + ssh 10.30.171.76 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 30768' Warning: Permanently added '10.30.171.76' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.171.76 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.171.76' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.171.20 'sudo ps aux' Warning: Permanently added '10.30.171.20' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-argon/ps_after.log ++ grep -v grep ++ tr -s ' ' ++ cut -f2 '-d ' + pid=5823 + echo 'karaf main: org.apache.karaf.main.Main, pid:5823' karaf main: org.apache.karaf.main.Main, pid:5823 + ssh 10.30.171.20 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5823' Warning: Permanently added '10.30.171.20' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.171.20 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.171.20' (ECDSA) to the list of known hosts. + sleep 5 ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Compressing karaf.log 1' Compressing karaf.log 1 + ssh 10.30.171.15 gzip --best /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.171.15' (ECDSA) to the list of known hosts. gzip: /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log: file size changed while zipping + echo 'Fetching compressed karaf.log 1' Fetching compressed karaf.log 1 + scp 10.30.171.15:/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log.gz odl1_karaf.log.gz Warning: Permanently added '10.30.171.15' (ECDSA) to the list of known hosts. + ssh 10.30.171.15 rm -f /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.171.15' (ECDSA) to the list of known hosts. + scp 10.30.171.15:/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log odl1_karaf_console.log Warning: Permanently added '10.30.171.15' (ECDSA) to the list of known hosts. + ssh 10.30.171.15 rm -f /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.171.15' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-1 + scp '10.30.171.15:/tmp/karaf-0.18.4-SNAPSHOT/data/log/*.log' gclogs-1/ Warning: Permanently added '10.30.171.15' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.18.4-SNAPSHOT/data/log/*.log: No such file or directory + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Compressing karaf.log 2' Compressing karaf.log 2 + ssh 10.30.171.76 gzip --best /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.171.76' (ECDSA) to the list of known hosts. gzip: /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log: file size changed while zipping + echo 'Fetching compressed karaf.log 2' Fetching compressed karaf.log 2 + scp 10.30.171.76:/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log.gz odl2_karaf.log.gz Warning: Permanently added '10.30.171.76' (ECDSA) to the list of known hosts. + ssh 10.30.171.76 rm -f /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.171.76' (ECDSA) to the list of known hosts. + scp 10.30.171.76:/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log odl2_karaf_console.log Warning: Permanently added '10.30.171.76' (ECDSA) to the list of known hosts. + ssh 10.30.171.76 rm -f /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.171.76' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-2 + scp '10.30.171.76:/tmp/karaf-0.18.4-SNAPSHOT/data/log/*.log' gclogs-2/ Warning: Permanently added '10.30.171.76' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.18.4-SNAPSHOT/data/log/*.log: No such file or directory + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Compressing karaf.log 3' Compressing karaf.log 3 + ssh 10.30.171.20 gzip --best /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.171.20' (ECDSA) to the list of known hosts. gzip: /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log: file size changed while zipping + echo 'Fetching compressed karaf.log 3' Fetching compressed karaf.log 3 + scp 10.30.171.20:/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log.gz odl3_karaf.log.gz Warning: Permanently added '10.30.171.20' (ECDSA) to the list of known hosts. + ssh 10.30.171.20 rm -f /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.171.20' (ECDSA) to the list of known hosts. + scp 10.30.171.20:/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log odl3_karaf_console.log Warning: Permanently added '10.30.171.20' (ECDSA) to the list of known hosts. + ssh 10.30.171.20 rm -f /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.171.20' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-3 + scp '10.30.171.20:/tmp/karaf-0.18.4-SNAPSHOT/data/log/*.log' gclogs-3/ Warning: Permanently added '10.30.171.20' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.18.4-SNAPSHOT/data/log/*.log: No such file or directory + echo 'Examine copied files' Examine copied files + ls -lt total 58396 drwxrwxr-x. 2 jenkins jenkins 6 Feb 4 02:48 gclogs-3 -rw-rw-r--. 1 jenkins jenkins 190297 Feb 4 02:48 odl3_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 1345988 Feb 4 02:48 odl3_karaf.log.gz drwxrwxr-x. 2 jenkins jenkins 6 Feb 4 02:48 gclogs-2 -rw-rw-r--. 1 jenkins jenkins 1720 Feb 4 02:48 odl2_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 1657815 Feb 4 02:48 odl2_karaf.log.gz drwxrwxr-x. 2 jenkins jenkins 6 Feb 4 02:48 gclogs-1 -rw-rw-r--. 1 jenkins jenkins 1720 Feb 4 02:48 odl1_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 1461721 Feb 4 02:48 odl1_karaf.log.gz -rw-rw-r--. 1 jenkins jenkins 168448 Feb 4 02:48 karaf_3_5823_threads_after.log -rw-rw-r--. 1 jenkins jenkins 16266 Feb 4 02:48 ps_after.log -rw-rw-r--. 1 jenkins jenkins 161888 Feb 4 02:48 karaf_2_30768_threads_after.log -rw-rw-r--. 1 jenkins jenkins 160845 Feb 4 02:48 karaf_1_31686_threads_after.log -rw-rw-r--. 1 jenkins jenkins 304083 Feb 4 02:48 report.html -rw-rw-r--. 1 jenkins jenkins 3566318 Feb 4 02:48 log.html -rw-rw-r--. 1 jenkins jenkins 50114112 Feb 4 02:48 output.xml -rw-rw-r--. 1 jenkins jenkins 4033 Feb 3 23:11 testplan.txt -rw-rw-r--. 1 jenkins jenkins 178428 Feb 3 23:11 karaf_3_5823_threads_before.log -rw-rw-r--. 1 jenkins jenkins 16660 Feb 3 23:11 ps_before.log -rw-rw-r--. 1 jenkins jenkins 173887 Feb 3 23:11 karaf_2_5825_threads_before.log -rw-rw-r--. 1 jenkins jenkins 182988 Feb 3 23:11 karaf_1_5836_threads_before.log -rw-rw-r--. 1 jenkins jenkins 3106 Feb 3 23:10 post-startup-script.sh -rw-rw-r--. 1 jenkins jenkins 252 Feb 3 23:10 startup-script.sh -rw-rw-r--. 1 jenkins jenkins 3452 Feb 3 23:10 configuration-script.sh -rw-rw-r--. 1 jenkins jenkins 695 Feb 3 23:10 custom_shard_config.txt -rw-rw-r--. 1 jenkins jenkins 132 Feb 3 23:10 scriptplan.txt -rw-rw-r--. 1 jenkins jenkins 337 Feb 3 23:09 detect_variables.env -rw-rw-r--. 1 jenkins jenkins 2620 Feb 3 23:09 pom.xml -rw-rw-r--. 1 jenkins jenkins 86 Feb 3 23:09 set_variables.env -rw-rw-r--. 1 jenkins jenkins 310 Feb 3 23:09 slave_addresses.txt -rw-rw-r--. 1 jenkins jenkins 570 Feb 3 23:09 requirements.txt -rw-rw-r--. 1 jenkins jenkins 26 Feb 3 23:09 env.properties -rw-rw-r--. 1 jenkins jenkins 335 Feb 3 23:06 stack-parameters.yaml drwxrwxr-x. 7 jenkins jenkins 4096 Feb 3 23:05 test drwxrwxr-x. 2 jenkins jenkins 6 Feb 3 23:05 test@tmp -rw-rw-r--. 1 jenkins jenkins 1410 Jan 26 21:04 maven-metadata.xml + true [controller-csit-3node-clustering-ask-all-argon] $ /bin/sh /tmp/jenkins12126499947445983158.sh Cleaning up Robot installation... $ ssh-agent -k unset SSH_AUTH_SOCK; unset SSH_AGENT_PID; echo Agent pid 5363 killed; [ssh-agent] Stopped. Recording plot data Robot results publisher started... INFO: Checking test criticality is deprecated and will be dropped in a future release! -Parsing output xml: Done! -Copying log files to build dir: Done! -Assigning results to build: Done! -Checking thresholds: Done! Done publishing Robot results. Build step 'Publish Robot Framework test results' changed build result to UNSTABLE [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-clustering-ask-all-argon] $ /bin/bash /tmp/jenkins4352736043106386425.sh Archiving csit artifacts mv: cannot stat '*_1.png': No such file or directory mv: cannot stat '/tmp/odl1_*': No such file or directory mv: cannot stat '*_2.png': No such file or directory mv: cannot stat '/tmp/odl2_*': No such file or directory mv: cannot stat '*_3.png': No such file or directory mv: cannot stat '/tmp/odl3_*': No such file or directory % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 808k 0 808k 0 0 4752k 0 --:--:-- --:--:-- --:--:-- 4725k 100 4780k 0 4780k 0 0 5157k 0 --:--:-- --:--:-- --:--:-- 5151k Archive: robot-plugin.zip inflating: ./archives/robot-plugin/log.html inflating: ./archives/robot-plugin/output.xml inflating: ./archives/robot-plugin/report.html mv: cannot stat '*.log.gz': No such file or directory mv: cannot stat '*.csv': No such file or directory mv: cannot stat '*.png': No such file or directory [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-clustering-ask-all-argon] $ /bin/bash /tmp/jenkins9475878413962227434.sh [PostBuildScript] - [INFO] Executing post build scripts. [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_CLOUD=vex OS_STACK_NAME=releng-controller-csit-3node-clustering-ask-all-argon-71 [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-clustering-ask-all-argon] $ /bin/bash /tmp/jenkins14411439137872492901.sh ---> openstack-stack-delete.sh Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/controller-csit-3node-clustering-ask-all-argon/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-WK1U from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient lf-activate-venv(): INFO: Adding /tmp/venv-WK1U/bin to PATH INFO: Retrieving stack cost for: releng-controller-csit-3node-clustering-ask-all-argon-71 DEBUG: Successfully retrieved stack cost: total: 1.32 INFO: Deleting stack releng-controller-csit-3node-clustering-ask-all-argon-71 Successfully deleted stack releng-controller-csit-3node-clustering-ask-all-argon-71 [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-clustering-ask-all-argon] $ /bin/bash /tmp/jenkins14132210688941204575.sh ---> sysstat.sh [controller-csit-3node-clustering-ask-all-argon] $ /bin/bash /tmp/jenkins13915611360714193083.sh ---> package-listing.sh ++ tr '[:upper:]' '[:lower:]' ++ facter osfamily + OS_FAMILY=redhat + workspace=/w/workspace/controller-csit-3node-clustering-ask-all-argon + START_PACKAGES=/tmp/packages_start.txt + END_PACKAGES=/tmp/packages_end.txt + DIFF_PACKAGES=/tmp/packages_diff.txt + PACKAGES=/tmp/packages_start.txt + '[' /w/workspace/controller-csit-3node-clustering-ask-all-argon ']' + PACKAGES=/tmp/packages_end.txt + case "${OS_FAMILY}" in + sort + rpm -qa + '[' -f /tmp/packages_start.txt ']' + '[' -f /tmp/packages_end.txt ']' + diff /tmp/packages_start.txt /tmp/packages_end.txt + '[' /w/workspace/controller-csit-3node-clustering-ask-all-argon ']' + mkdir -p /w/workspace/controller-csit-3node-clustering-ask-all-argon/archives/ + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/controller-csit-3node-clustering-ask-all-argon/archives/ [controller-csit-3node-clustering-ask-all-argon] $ /bin/bash /tmp/jenkins9519467955905445646.sh ---> capture-instance-metadata.sh Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/controller-csit-3node-clustering-ask-all-argon/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-WK1U from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-WK1U/bin to PATH INFO: Running in OpenStack, capturing instance metadata [controller-csit-3node-clustering-ask-all-argon] $ /bin/bash /tmp/jenkins17166580179559303291.sh provisioning config files... Could not find credentials [logs] for controller-csit-3node-clustering-ask-all-argon #71 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/controller-csit-3node-clustering-ask-all-argon@tmp/config2304844778598659649tmp Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] Run condition [Regular expression match] enabling perform for step [Provide Configuration files] provisioning config files... copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content SERVER_ID=logs [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-ask-all-argon] $ /bin/bash /tmp/jenkins11354395217695555363.sh ---> create-netrc.sh WARN: Log server credential not found. [controller-csit-3node-clustering-ask-all-argon] $ /bin/bash /tmp/jenkins2673066513649686740.sh ---> python-tools-install.sh Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/controller-csit-3node-clustering-ask-all-argon/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-WK1U from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-WK1U/bin to PATH [controller-csit-3node-clustering-ask-all-argon] $ /bin/bash /tmp/jenkins7474358351604538684.sh ---> sudo-logs.sh Archiving 'sudo' log.. [controller-csit-3node-clustering-ask-all-argon] $ /bin/bash /tmp/jenkins9333616459696400229.sh ---> job-cost.sh Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/controller-csit-3node-clustering-ask-all-argon/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-WK1U from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. lftools 0.37.8 requires openstacksdk<1.5.0, but you have openstacksdk 2.1.0 which is incompatible. lf-activate-venv(): INFO: Adding /tmp/venv-WK1U/bin to PATH DEBUG: total: 1.32 INFO: Retrieving Stack Cost... INFO: Retrieving Pricing Info for: v3-standard-2 INFO: Archiving Costs [controller-csit-3node-clustering-ask-all-argon] $ /bin/bash -l /tmp/jenkins6102201857834318947.sh ---> logs-deploy.sh Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/controller-csit-3node-clustering-ask-all-argon/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-WK1U from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. python-openstackclient 6.5.0 requires openstacksdk>=2.0.0, but you have openstacksdk 1.4.0 which is incompatible. lf-activate-venv(): INFO: Adding /tmp/venv-WK1U/bin to PATH WARNING: Nexus logging server not set INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/controller-csit-3node-clustering-ask-all-argon/71/ INFO: archiving logs to S3 ---> uname -a: Linux prd-centos8-robot-2c-8g-2516.novalocal 4.18.0-532.el8.x86_64 #1 SMP Thu Dec 21 12:11:59 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux ---> lscpu: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 1 Socket(s): 2 NUMA node(s): 1 Vendor ID: AuthenticAMD CPU family: 23 Model: 49 Model name: AMD EPYC-Rome Processor Stepping: 0 CPU MHz: 2799.998 BogoMIPS: 5599.99 Virtualization: AMD-V Hypervisor vendor: KVM Virtualization type: full L1d cache: 32K L1i cache: 32K L2 cache: 512K L3 cache: 16384K NUMA node0 CPU(s): 0,1 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities ---> nproc: 2 ---> df -h: Filesystem Size Used Avail Use% Mounted on devtmpfs 3.8G 0 3.8G 0% /dev tmpfs 3.8G 0 3.8G 0% /dev/shm tmpfs 3.8G 17M 3.8G 1% /run tmpfs 3.8G 0 3.8G 0% /sys/fs/cgroup /dev/vda1 40G 9.4G 31G 24% / tmpfs 770M 0 770M 0% /run/user/1001 ---> free -m: total used free shared buff/cache available Mem: 7697 667 4612 19 2417 6732 Swap: 1023 0 1023 ---> ip addr: 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: mtu 1458 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:11:62:b8 brd ff:ff:ff:ff:ff:ff altname enp0s3 altname ens3 inet 10.30.171.228/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0 valid_lft 72834sec preferred_lft 72834sec inet6 fe80::f816:3eff:fe11:62b8/64 scope link valid_lft forever preferred_lft forever ---> sar -b -r -n DEV: Linux 4.18.0-532.el8.x86_64 (prd-centos8-robot-2c-8g-2516.novalocal) 02/04/2024 _x86_64_ (2 CPU) 12:00:01 AM tps rtps wtps bread/s bwrtn/s 12:01:01 AM 0.98 0.02 0.97 0.13 201.83 12:02:01 AM 0.52 0.07 0.45 1.73 20.24 12:03:01 AM 0.18 0.00 0.18 0.00 8.80 12:04:01 AM 0.20 0.00 0.20 0.00 24.40 12:05:01 AM 0.18 0.00 0.18 0.00 5.05 12:06:01 AM 0.20 0.00 0.20 0.00 3.00 12:07:01 AM 0.25 0.03 0.22 4.53 5.46 12:08:01 AM 0.57 0.03 0.53 2.80 13.40 12:09:01 AM 0.30 0.00 0.30 0.00 7.05 12:10:01 AM 0.12 0.00 0.12 0.00 1.18 12:11:01 AM 0.22 0.00 0.22 0.00 2.47 12:12:02 AM 0.25 0.00 0.25 0.00 10.80 12:13:01 AM 0.14 0.00 0.14 0.00 4.95 12:14:01 AM 0.25 0.00 0.25 0.00 9.27 12:15:01 AM 0.27 0.00 0.27 0.00 6.93 12:16:01 AM 0.17 0.00 0.17 0.00 3.90 12:17:01 AM 0.18 0.00 0.18 0.00 7.75 12:18:01 AM 0.12 0.00 0.12 0.00 6.93 12:19:01 AM 0.13 0.00 0.13 0.00 13.61 12:20:01 AM 0.20 0.00 0.20 0.00 16.43 12:21:01 AM 0.22 0.00 0.22 0.00 14.86 12:22:01 AM 0.35 0.00 0.35 0.00 13.20 12:23:01 AM 0.18 0.00 0.18 0.00 14.55 12:24:01 AM 0.23 0.00 0.23 0.00 12.81 12:25:01 AM 0.13 0.00 0.13 0.00 19.60 12:26:01 AM 1.12 0.30 0.82 6.40 22.03 12:27:01 AM 0.12 0.00 0.12 0.00 1.72 12:28:01 AM 0.27 0.00 0.27 0.00 5.33 12:29:01 AM 0.20 0.00 0.20 0.00 2.30 12:30:01 AM 0.12 0.00 0.12 0.00 3.45 12:31:01 AM 0.17 0.00 0.17 0.00 2.33 12:32:01 AM 0.22 0.00 0.22 0.00 8.17 12:33:01 AM 0.12 0.00 0.12 0.00 2.95 12:34:01 AM 0.17 0.00 0.17 0.00 21.08 12:35:01 AM 0.23 0.00 0.23 0.00 4.52 12:36:01 AM 0.18 0.00 0.18 0.00 2.42 12:37:01 AM 0.13 0.00 0.13 0.00 0.93 12:38:01 AM 0.13 0.00 0.13 0.00 34.53 12:39:01 AM 0.15 0.00 0.15 0.00 42.18 12:40:01 AM 0.15 0.00 0.15 0.00 2.95 12:41:01 AM 0.15 0.00 0.15 0.00 24.08 12:42:01 AM 0.32 0.00 0.32 0.00 9.50 12:43:01 AM 0.18 0.00 0.18 0.00 14.81 12:44:01 AM 0.13 0.00 0.13 0.00 7.21 12:45:01 AM 0.17 0.00 0.17 0.00 14.41 12:46:01 AM 0.32 0.00 0.32 0.00 18.55 12:47:01 AM 0.15 0.00 0.15 0.00 14.26 12:48:01 AM 0.13 0.00 0.13 0.00 22.53 12:49:01 AM 0.12 0.00 0.12 0.00 5.87 12:50:01 AM 0.23 0.00 0.23 0.00 5.83 12:51:01 AM 0.20 0.00 0.20 0.00 2.72 12:52:01 AM 0.17 0.00 0.17 0.00 4.80 12:53:01 AM 0.12 0.00 0.12 0.00 1.17 12:54:01 AM 0.12 0.00 0.12 0.00 3.48 12:55:01 AM 0.85 0.00 0.85 0.00 12.71 12:56:01 AM 0.30 0.00 0.30 0.00 10.20 12:57:01 AM 0.13 0.00 0.13 0.00 3.10 12:58:01 AM 0.20 0.00 0.20 0.00 7.13 12:59:01 AM 0.13 0.00 0.13 0.00 2.80 01:00:01 AM 0.13 0.00 0.13 0.00 4.40 01:01:01 AM 0.38 0.03 0.35 0.27 11.00 01:02:01 AM 0.23 0.00 0.23 0.00 12.41 01:03:01 AM 0.22 0.00 0.22 0.00 17.05 01:04:01 AM 0.13 0.00 0.13 0.00 14.13 01:05:01 AM 0.13 0.00 0.13 0.00 7.61 01:06:01 AM 0.48 0.00 0.48 0.00 22.49 01:07:01 AM 0.15 0.00 0.15 0.00 10.01 01:08:01 AM 0.32 0.00 0.32 0.00 28.58 01:09:01 AM 0.38 0.00 0.38 0.00 8.40 01:10:01 AM 0.37 0.00 0.37 0.00 4.22 01:11:01 AM 0.52 0.00 0.52 0.00 9.46 01:12:01 AM 0.37 0.00 0.37 0.00 4.13 01:13:01 AM 0.28 0.00 0.28 0.00 2.92 01:14:01 AM 0.37 0.00 0.37 0.00 6.67 01:15:01 AM 0.25 0.00 0.25 0.00 2.08 01:16:01 AM 0.25 0.00 0.25 0.00 8.27 01:17:01 AM 0.17 0.00 0.17 0.00 3.58 01:18:01 AM 0.17 0.00 0.17 0.00 7.58 01:19:01 AM 0.15 0.00 0.15 0.00 3.72 01:20:01 AM 0.23 0.00 0.23 0.00 6.63 01:21:01 AM 0.23 0.00 0.23 0.00 8.45 01:22:01 AM 0.22 0.00 0.22 0.00 15.44 01:23:01 AM 0.13 0.00 0.13 0.00 8.38 01:24:01 AM 0.13 0.00 0.13 0.00 14.93 01:25:01 AM 0.15 0.00 0.15 0.00 14.13 01:26:02 AM 0.17 0.00 0.17 0.00 14.06 01:27:01 AM 0.37 0.00 0.37 0.00 13.17 01:28:01 AM 0.18 0.00 0.18 0.00 25.22 01:29:01 AM 0.12 0.00 0.12 0.00 5.47 01:30:01 AM 0.12 0.00 0.12 0.00 1.20 01:31:01 AM 0.22 0.00 0.22 0.00 4.83 01:32:01 AM 0.18 0.00 0.18 0.00 2.95 01:33:01 AM 0.12 0.00 0.12 0.00 1.30 01:34:01 AM 0.22 0.00 0.22 0.00 6.11 01:35:01 AM 0.20 0.00 0.20 0.00 2.25 01:36:01 AM 0.23 0.00 0.23 0.00 9.33 01:37:01 AM 0.33 0.00 0.33 0.00 6.35 01:38:01 AM 0.13 0.00 0.13 0.00 2.13 01:39:01 AM 0.13 0.00 0.13 0.00 2.65 01:40:01 AM 0.18 0.00 0.18 0.00 8.55 01:41:01 AM 0.32 0.00 0.32 0.00 18.85 01:42:01 AM 0.38 0.00 0.38 0.00 15.65 01:43:01 AM 0.50 0.00 0.50 0.00 17.44 01:44:01 AM 0.50 0.00 0.50 0.00 15.71 01:45:01 AM 0.50 0.00 0.50 0.00 16.51 01:46:01 AM 0.52 0.00 0.52 0.00 16.78 01:47:01 AM 0.28 0.00 0.28 0.00 21.05 01:48:01 AM 0.33 0.00 0.33 0.00 3.73 01:49:01 AM 0.35 0.00 0.35 0.00 3.87 01:50:01 AM 0.17 0.00 0.17 0.00 4.77 01:51:01 AM 0.23 0.00 0.23 0.00 3.22 01:52:01 AM 0.25 0.00 0.25 0.00 5.63 01:53:01 AM 0.15 0.00 0.15 0.00 1.48 01:54:01 AM 0.12 0.00 0.12 0.00 7.18 01:55:01 AM 0.17 0.00 0.17 0.00 5.77 01:56:01 AM 0.13 0.00 0.13 0.00 10.83 01:57:01 AM 0.22 0.00 0.22 0.00 15.11 01:58:01 AM 0.22 0.00 0.22 0.00 8.52 01:59:01 AM 0.18 0.00 0.18 0.00 14.43 02:00:01 AM 0.40 0.00 0.40 0.00 18.96 02:01:01 AM 0.37 0.00 0.37 0.00 16.14 02:02:01 AM 0.55 0.00 0.55 0.00 27.85 02:03:01 AM 0.12 0.00 0.12 0.00 5.07 02:04:01 AM 0.13 0.00 0.13 0.00 1.43 02:05:01 AM 0.13 0.00 0.13 0.00 1.50 02:06:01 AM 0.22 0.00 0.22 0.00 5.47 02:07:01 AM 0.15 0.00 0.15 0.00 1.33 02:08:01 AM 0.12 0.00 0.12 0.00 3.60 02:09:01 AM 0.13 0.00 0.13 0.00 1.30 02:10:01 AM 0.12 0.00 0.12 0.00 6.68 02:11:01 AM 0.32 0.00 0.32 0.00 9.38 02:12:01 AM 0.27 0.00 0.27 0.00 12.06 02:13:01 AM 0.15 0.00 0.15 0.00 16.68 02:14:01 AM 0.58 0.00 0.58 0.00 17.10 02:15:01 AM 0.53 0.00 0.53 0.00 16.81 02:16:01 AM 0.53 0.00 0.53 0.00 16.03 02:17:01 AM 0.68 0.00 0.68 0.00 19.36 02:18:01 AM 0.38 0.00 0.38 0.00 23.34 02:19:01 AM 0.32 0.00 0.32 0.00 7.07 02:20:01 AM 0.12 0.00 0.12 0.00 1.17 02:21:01 AM 0.17 0.00 0.17 0.00 4.03 02:22:01 AM 0.17 0.00 0.17 0.00 2.50 02:23:01 AM 0.12 0.00 0.12 0.00 3.47 02:24:01 AM 0.12 0.00 0.12 0.00 1.70 02:25:01 AM 0.12 0.00 0.12 0.00 0.92 02:26:01 AM 0.23 0.00 0.23 0.00 12.38 02:27:01 AM 0.20 0.00 0.20 0.00 7.88 02:28:01 AM 0.12 0.00 0.12 0.00 14.20 02:29:01 AM 0.80 0.00 0.80 0.00 19.23 02:30:01 AM 0.23 0.00 0.23 0.00 18.75 02:31:01 AM 0.55 0.00 0.55 0.00 17.14 02:32:01 AM 0.65 0.00 0.65 0.00 18.73 02:33:01 AM 0.48 0.00 0.48 0.00 22.93 02:34:01 AM 0.33 0.00 0.33 0.00 14.26 02:35:01 AM 0.31 0.00 0.31 0.00 3.10 02:36:01 AM 0.32 0.00 0.32 0.00 3.32 02:37:01 AM 0.37 0.00 0.37 0.00 5.77 02:38:01 AM 0.33 0.00 0.33 0.00 3.35 02:39:01 AM 0.38 0.00 0.38 0.00 8.00 02:40:01 AM 0.15 0.00 0.15 0.00 1.45 02:41:01 AM 0.13 0.00 0.13 0.00 1.48 02:42:01 AM 0.23 0.02 0.22 0.13 24.81 02:43:01 AM 0.30 0.00 0.30 0.00 19.98 02:44:01 AM 0.12 0.00 0.12 0.00 15.74 02:45:01 AM 0.17 0.00 0.17 0.00 18.96 02:46:01 AM 0.28 0.00 0.28 0.00 13.61 02:47:01 AM 0.20 0.00 0.20 0.00 19.08 02:48:01 AM 0.10 0.00 0.10 0.00 16.26 02:49:01 AM 6.50 0.20 6.30 31.05 316.64 02:50:01 AM 38.95 0.43 38.52 44.39 3805.48 Average: 0.52 0.01 0.51 0.54 35.44 12:00:01 AM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 12:01:01 AM 4772864 6997932 3109592 39.45 2688 2394384 757212 8.48 356764 2375168 104 12:02:01 AM 4773112 6998596 3109344 39.45 2688 2394800 757212 8.48 356784 2375108 48 12:03:01 AM 4772424 6998328 3110032 39.46 2688 2395212 757212 8.48 356784 2375676 272 12:04:01 AM 4772080 6998460 3110376 39.46 2688 2395688 757212 8.48 356784 2376216 96 12:05:01 AM 4772112 6998496 3110344 39.46 2688 2395692 757212 8.48 356784 2376152 16 12:06:01 AM 4772012 6998396 3110444 39.46 2688 2395700 757212 8.48 356784 2376220 16 12:07:01 AM 4771716 6998296 3110740 39.46 2688 2395888 754344 8.45 356784 2376616 8 12:08:01 AM 4771944 6998756 3110512 39.46 2688 2396116 755396 8.46 356888 2376404 4 12:09:01 AM 4771596 6998488 3110860 39.47 2688 2396196 755396 8.46 356888 2376616 4 12:10:01 AM 4770976 6997868 3111480 39.47 2688 2396196 772384 8.65 356888 2376964 4 12:11:01 AM 4771004 6998072 3111452 39.47 2688 2396372 752912 8.43 356888 2376884 180 12:12:02 AM 4771116 6998248 3111340 39.47 2688 2396436 752912 8.43 356888 2376948 24 12:13:01 AM 4770584 6997904 3111872 39.48 2688 2396624 752912 8.43 356888 2377468 104 12:14:01 AM 4770344 6997776 3112112 39.48 2688 2396736 752912 8.43 356888 2377584 24 12:15:01 AM 4770392 6997956 3112064 39.48 2688 2396868 752912 8.43 356896 2377504 44 12:16:01 AM 4769372 6997052 3113084 39.49 2688 2396984 752912 8.43 356904 2378732 104 12:17:01 AM 4769336 6997248 3113120 39.49 2688 2397224 752912 8.43 356912 2378684 152 12:18:01 AM 4769148 6997244 3113308 39.50 2688 2397424 752912 8.43 356912 2378888 168 12:19:01 AM 4768800 6997256 3113656 39.50 2688 2397776 752912 8.43 356912 2379388 140 12:20:01 AM 4768176 6996988 3114280 39.51 2688 2398124 747344 8.37 356912 2379884 48 12:21:01 AM 4767144 6996312 3115312 39.52 2688 2398488 747344 8.37 356912 2380912 24 12:22:01 AM 4768212 6997736 3114244 39.51 2688 2398828 747344 8.37 356912 2380044 96 12:23:01 AM 4767412 6997256 3115044 39.52 2688 2399180 747344 8.37 356912 2380652 64 12:24:01 AM 4766060 6996396 3116396 39.54 2688 2399640 762720 8.54 356912 2382080 216 12:25:01 AM 4766652 6997412 3115804 39.53 2688 2400064 762720 8.54 356912 2381460 80 12:26:01 AM 4766504 6997460 3115952 39.53 2688 2400260 762720 8.54 357012 2381644 4 12:27:01 AM 4766032 6996992 3116424 39.54 2688 2400272 762720 8.54 357012 2381864 16 12:28:01 AM 4766196 6997232 3116260 39.53 2688 2400340 762720 8.54 357012 2381784 4 12:29:01 AM 4766292 6997328 3116164 39.53 2688 2400340 762720 8.54 357012 2381668 4 12:30:01 AM 4765760 6996876 3116696 39.54 2688 2400420 762720 8.54 357012 2382096 4 12:31:01 AM 4766280 6997400 3116176 39.53 2688 2400424 762720 8.54 357012 2381820 4 12:32:01 AM 4766068 6997364 3116388 39.54 2688 2400600 762720 8.54 357012 2381908 4 12:33:01 AM 4765848 6997212 3116608 39.54 2688 2400668 762720 8.54 357012 2382112 24 12:34:01 AM 4765352 6997284 3117104 39.54 2688 2401236 762720 8.54 357012 2382508 4 12:35:01 AM 4765300 6997288 3117156 39.55 2688 2401292 762720 8.54 357012 2382648 4 12:36:01 AM 4765544 6997536 3116912 39.54 2688 2401296 762720 8.54 357012 2382516 4 12:37:01 AM 4765264 6997296 3117192 39.55 2688 2401336 762720 8.54 357012 2382604 48 12:38:01 AM 4764340 6997520 3118116 39.56 2688 2402540 762720 8.54 357012 2383636 244 12:39:01 AM 4763372 6997608 3119084 39.57 2688 2403540 762720 8.54 357012 2384696 4 12:40:01 AM 4762424 6997048 3120032 39.58 2688 2403936 783536 8.77 357012 2385436 348 12:41:01 AM 4762256 6997220 3120200 39.58 2688 2404268 753564 8.44 357012 2385816 16 12:42:01 AM 4761616 6996804 3120840 39.59 2688 2404492 753564 8.44 357012 2386572 84 12:43:01 AM 4760184 6995712 3122272 39.61 2688 2404840 753564 8.44 357012 2387704 48 12:44:01 AM 4759992 6995876 3122464 39.61 2688 2405188 753564 8.44 357012 2387992 216 12:45:01 AM 4759544 6995756 3122912 39.62 2688 2405532 753564 8.44 357012 2388388 168 12:46:01 AM 4759152 6995728 3123304 39.62 2688 2405888 753564 8.44 357040 2388816 112 12:47:01 AM 4759856 6996772 3122600 39.61 2688 2406236 753564 8.44 357040 2388096 64 12:48:01 AM 4758536 6996180 3123920 39.63 2688 2406948 753564 8.44 357040 2389432 128 12:49:01 AM 4758452 6996212 3124004 39.63 2688 2407064 753564 8.44 357040 2389580 92 12:50:01 AM 4758316 6996080 3124140 39.63 2688 2407068 776616 8.70 357040 2389700 4 12:51:01 AM 4758308 6996160 3124148 39.63 2688 2407148 776616 8.70 357040 2389732 88 12:52:01 AM 4758300 6996156 3124156 39.63 2688 2407152 776616 8.70 357040 2389784 4 12:53:01 AM 4758316 6996172 3124140 39.63 2688 2407152 776616 8.70 357040 2389668 4 12:54:01 AM 4757964 6995900 3124492 39.64 2688 2407232 760092 8.51 357040 2389864 4 12:55:01 AM 4758192 6996136 3124264 39.64 2688 2407240 760088 8.51 366916 2379884 4 12:56:01 AM 4757924 6996052 3124532 39.64 2688 2407424 760088 8.51 366916 2380136 16 12:57:01 AM 4757436 6995700 3125020 39.65 2688 2407560 760088 8.51 366916 2380556 104 12:58:01 AM 4757664 6995996 3124792 39.64 2688 2407628 760088 8.51 366916 2380284 20 12:59:01 AM 4758432 6996828 3124024 39.63 2688 2407724 760088 8.51 366916 2379600 56 01:00:01 AM 4756764 6995248 3125692 39.65 2688 2407788 760088 8.51 366916 2380616 16 01:01:01 AM 4757020 6995712 3125436 39.65 2688 2407988 743704 8.33 366920 2380780 48 01:02:01 AM 4757436 6996468 3125020 39.65 2688 2408336 759172 8.50 366928 2380612 124 01:03:01 AM 4756616 6996012 3125840 39.66 2688 2408700 759172 8.50 366928 2381508 48 01:04:01 AM 4755968 6995716 3126488 39.66 2688 2409044 759172 8.50 366928 2382072 12 01:05:01 AM 4755920 6996008 3126536 39.66 2688 2409392 759172 8.50 366928 2382208 164 01:06:01 AM 4755728 6996160 3126728 39.67 2688 2409736 759172 8.50 366924 2382616 80 01:07:01 AM 4755328 6996116 3127128 39.67 2688 2410100 759172 8.50 366924 2382904 180 01:08:01 AM 4754348 6995712 3128108 39.68 2688 2410676 759172 8.50 366924 2383744 4 01:09:01 AM 4754228 6995724 3128228 39.69 2688 2410792 759172 8.50 366924 2383876 8 01:10:01 AM 4755168 6996668 3127288 39.67 2688 2410796 759172 8.50 366928 2383036 4 01:11:01 AM 4755476 6997056 3126980 39.67 2688 2410872 759172 8.50 366932 2382836 4 01:12:01 AM 4755488 6997072 3126968 39.67 2688 2410876 759172 8.50 366932 2382772 4 01:13:01 AM 4755132 6996716 3127324 39.67 2688 2410876 759172 8.50 366932 2382888 4 01:14:01 AM 4755292 6996956 3127164 39.67 2688 2410956 759172 8.50 366932 2382852 4 01:15:01 AM 4755208 6996876 3127248 39.67 2688 2410960 759172 8.50 366932 2382856 4 01:16:01 AM 4754952 6996804 3127504 39.68 2688 2411144 739072 8.28 366932 2383108 16 01:17:01 AM 4754840 6996828 3127616 39.68 2688 2411280 739072 8.28 366940 2383296 104 01:18:01 AM 4754964 6997032 3127492 39.68 2688 2411360 739072 8.28 366948 2383252 16 01:19:01 AM 4754696 6996868 3127760 39.68 2688 2411464 739072 8.28 366948 2383344 64 01:20:01 AM 4754444 6996672 3128012 39.68 2688 2411528 758804 8.50 366948 2383652 16 01:21:01 AM 4754364 6996788 3128092 39.68 2688 2411716 740304 8.29 366952 2383660 16 01:22:01 AM 4754436 6997172 3128020 39.68 2688 2412076 758088 8.49 366952 2383680 4 01:23:01 AM 4753652 6996764 3128804 39.69 2688 2412412 758088 8.49 366952 2384524 156 01:24:01 AM 4753652 6997124 3128804 39.69 2688 2412772 758088 8.49 366952 2384408 100 01:25:01 AM 4753376 6997184 3129080 39.70 2688 2413116 758088 8.49 366952 2384744 48 01:26:02 AM 4752460 6996628 3129996 39.71 2688 2413476 758088 8.49 366952 2385800 24 01:27:01 AM 4751460 6995980 3130996 39.72 2688 2413812 758088 8.49 366952 2386748 120 01:28:01 AM 4752004 6997116 3130452 39.71 2688 2414420 758088 8.49 366952 2386172 24 01:29:01 AM 4751844 6997096 3130612 39.72 2688 2414544 758088 8.49 366952 2386312 4 01:30:01 AM 4751532 6996784 3130924 39.72 2688 2414544 772092 8.65 366952 2386544 4 01:31:01 AM 4751740 6997076 3130716 39.72 2688 2414624 772092 8.65 366952 2386392 4 01:32:01 AM 4751740 6997076 3130716 39.72 2688 2414624 772092 8.65 366952 2386396 4 01:33:01 AM 4751492 6996908 3130964 39.72 2688 2414704 772092 8.65 366952 2386632 88 01:34:01 AM 4751336 6996760 3131120 39.72 2688 2414712 755684 8.46 366952 2386772 4 01:35:01 AM 4751692 6997212 3130764 39.72 2688 2414832 755684 8.46 366952 2386524 128 01:36:01 AM 4751340 6996988 3131116 39.72 2688 2414936 755684 8.46 366952 2386732 4 01:37:01 AM 4751352 6997112 3131104 39.72 2688 2415048 755684 8.46 366952 2386776 24 01:38:01 AM 4751320 6997088 3131136 39.72 2688 2415056 755684 8.46 366952 2386784 4 01:39:01 AM 4751124 6997076 3131332 39.73 2688 2415240 755684 8.46 366952 2386956 148 01:40:01 AM 4750612 6996752 3131844 39.73 2688 2415428 755684 8.46 366952 2387308 144 01:41:01 AM 4750060 6996544 3132396 39.74 2688 2415788 755684 8.46 366952 2388076 32 01:42:01 AM 4749596 6996436 3132860 39.74 2688 2416128 771520 8.64 366952 2388432 24 01:43:01 AM 4748704 6995892 3133752 39.76 2688 2416484 771520 8.64 366952 2389196 16 01:44:01 AM 4748624 6996156 3133832 39.76 2688 2416824 771520 8.64 366952 2389452 28 01:45:01 AM 4748336 6996220 3134120 39.76 2688 2417184 771520 8.64 366952 2389920 32 01:46:01 AM 4748652 6996900 3133804 39.76 2688 2417548 771520 8.64 366952 2389356 40 01:47:01 AM 4748504 6997280 3133952 39.76 2688 2418060 756072 8.47 366952 2389816 4 01:48:01 AM 4748400 6997176 3134056 39.76 2688 2418060 756072 8.47 366952 2389816 4 01:49:01 AM 4748068 6996856 3134388 39.76 2688 2418072 756072 8.47 366952 2389944 4 01:50:01 AM 4747820 6996680 3134636 39.77 2688 2418144 746780 8.36 366952 2390016 4 01:51:01 AM 4747972 6996840 3134484 39.77 2688 2418152 746780 8.36 366952 2390092 4 01:52:01 AM 4748060 6997004 3134396 39.76 2688 2418228 746780 8.36 366952 2390104 4 01:53:01 AM 4747952 6996896 3134504 39.77 2688 2418228 746780 8.36 366952 2390124 12 01:54:01 AM 4747564 6996696 3134892 39.77 2688 2418416 746780 8.36 366952 2390292 16 01:55:01 AM 4747540 6996824 3134916 39.77 2688 2418568 746780 8.36 366952 2390428 32 01:56:01 AM 4746704 6996296 3135752 39.78 2688 2418876 764164 8.56 366956 2391404 56 01:57:01 AM 4746408 6996348 3136048 39.79 2688 2419232 764164 8.56 366952 2391708 16 01:58:01 AM 4745864 6996156 3136592 39.79 2688 2419576 764164 8.56 366952 2392180 176 01:59:01 AM 4745432 6996064 3137024 39.80 2688 2419932 764164 8.56 366952 2392796 152 02:00:01 AM 4744672 6995660 3137784 39.81 2688 2420280 747140 8.37 366952 2393212 24 02:01:01 AM 4744492 6995840 3137964 39.81 2688 2420632 747140 8.37 366952 2393296 16 02:02:01 AM 4744748 6996752 3137708 39.81 2688 2421284 747140 8.37 366956 2393452 24 02:03:01 AM 4744080 6996184 3138376 39.81 2688 2421384 747140 8.37 366956 2393832 8 02:04:01 AM 4744480 6996584 3137976 39.81 2688 2421384 747140 8.37 366956 2393588 4 02:05:01 AM 4744212 6996400 3138244 39.81 2688 2421468 747140 8.37 366956 2393864 88 02:06:01 AM 4744344 6996532 3138112 39.81 2688 2421468 747140 8.37 366956 2393744 8 02:07:01 AM 4744224 6996420 3138232 39.81 2688 2421476 747140 8.37 366956 2393800 16 02:08:01 AM 4744404 6996676 3138052 39.81 2688 2421552 747140 8.37 366956 2393760 4 02:09:01 AM 4744440 6996712 3138016 39.81 2688 2421552 747140 8.37 366956 2393760 4 02:10:01 AM 4743536 6995992 3138920 39.82 2688 2421736 767176 8.59 366956 2394340 16 02:11:01 AM 4743292 6995924 3139164 39.82 2688 2421908 749748 8.39 366956 2394468 4 02:12:01 AM 4742860 6995860 3139596 39.83 2688 2422292 765604 8.57 366956 2395148 136 02:13:01 AM 4742184 6995536 3140272 39.84 2688 2422636 765604 8.57 366956 2395752 24 02:14:01 AM 4741880 6995580 3140576 39.84 2688 2422992 765604 8.57 366956 2395984 24 02:15:01 AM 4741608 6995660 3140848 39.85 2688 2423336 765604 8.57 366956 2396316 4 02:16:01 AM 4741412 6995816 3141044 39.85 2688 2423696 765604 8.57 366956 2396712 40 02:17:01 AM 4741196 6995948 3141260 39.85 2688 2424032 765604 8.57 366956 2397108 16 02:18:01 AM 4740376 6995716 3142080 39.86 2688 2424612 765604 8.57 366956 2397816 4 02:19:01 AM 4740396 6995808 3142060 39.86 2688 2424684 765604 8.57 366956 2397888 4 02:20:01 AM 4739776 6995188 3142680 39.87 2688 2424684 758276 8.49 366956 2398144 12 02:21:01 AM 4740092 6995584 3142364 39.87 2688 2424764 758276 8.49 366956 2398160 8 02:22:01 AM 4741176 6996672 3141280 39.85 2688 2424768 758276 8.49 366956 2396932 4 02:23:01 AM 4740988 6996564 3141468 39.85 2688 2424848 758276 8.49 366956 2397152 16 02:24:01 AM 4741012 6996588 3141444 39.85 2688 2424848 758276 8.49 366956 2397156 4 02:25:01 AM 4740740 6996464 3141716 39.86 2688 2425024 758276 8.49 366956 2397268 180 02:26:01 AM 4740748 6996636 3141708 39.86 2688 2425184 758276 8.49 366956 2397384 56 02:27:01 AM 4740472 6996568 3141984 39.86 2688 2425376 758276 8.49 366956 2397552 72 02:28:01 AM 4738144 6994592 3144312 39.89 2688 2425728 758000 8.49 366956 2399760 24 02:29:01 AM 4739520 6996320 3142936 39.87 2688 2426080 769648 8.62 367776 2397452 168 02:30:01 AM 4739172 6996308 3143284 39.88 2688 2426424 756336 8.47 367776 2397904 40 02:31:01 AM 4738908 6996388 3143548 39.88 2688 2426768 756336 8.47 367776 2398204 32 02:32:01 AM 4738612 6996436 3143844 39.88 2688 2427112 756336 8.47 367776 2398596 24 02:33:01 AM 4737108 6995496 3145348 39.90 2688 2427712 756336 8.47 367776 2399812 64 02:34:01 AM 4737424 6996164 3145032 39.90 2688 2428008 756336 8.47 367776 2399708 4 02:35:01 AM 4737416 6996156 3145040 39.90 2688 2428008 756336 8.47 367776 2399708 4 02:36:01 AM 4737392 6996144 3145064 39.90 2688 2428020 756336 8.47 367776 2399904 4 02:37:01 AM 4737536 6996356 3144920 39.90 2688 2428088 756336 8.47 367776 2399788 4 02:38:01 AM 4737532 6996352 3144924 39.90 2688 2428088 756336 8.47 367776 2399788 4 02:39:01 AM 4737488 6996392 3144968 39.90 2688 2428172 756336 8.47 367776 2399872 4 02:40:01 AM 4737036 6995940 3145420 39.90 2688 2428172 748432 8.38 367776 2399988 4 02:41:01 AM 4737032 6996116 3145424 39.90 2688 2428352 748432 8.38 367776 2400236 184 02:42:01 AM 4734788 6994360 3147668 39.93 2688 2428840 764240 8.56 367780 2402280 4 02:43:01 AM 4733816 6993872 3148640 39.94 2688 2429324 780276 8.74 367780 2403048 4 02:44:01 AM 4730916 6991460 3151540 39.98 2688 2429812 813044 9.10 367780 2405796 48 02:45:01 AM 4729688 6990720 3152768 40.00 2688 2430300 829428 9.29 367780 2406740 16 02:46:01 AM 4728476 6989876 3153980 40.01 2688 2430652 863084 9.66 367780 2407512 48 02:47:01 AM 4725912 6987800 3156544 40.05 2688 2431140 895820 10.03 367780 2410192 24 02:48:01 AM 4724668 6987040 3157788 40.06 2688 2431620 912220 10.21 367780 2410976 48 02:49:01 AM 4671628 6858324 3210828 40.73 2688 2359188 803780 9.00 422096 2425872 80944 02:50:01 AM 4730768 6901800 3151688 39.98 2688 2345300 793388 8.88 608392 2188452 2884 Average: 4752366 6995071 3130090 39.71 2688 2412047 761496 8.53 365614 2387211 541 12:00:01 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 12:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:01:01 AM eth0 9.53 9.73 2.12 1.87 0.00 0.00 0.00 0.00 12:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:02:01 AM eth0 10.96 9.31 2.14 1.74 0.00 0.00 0.00 0.00 12:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:03:01 AM eth0 13.60 11.30 2.95 2.33 0.00 0.00 0.00 0.00 12:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:04:01 AM eth0 11.36 10.08 2.62 1.95 0.00 0.00 0.00 0.00 12:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:05:01 AM eth0 3.36 0.17 0.41 0.07 0.00 0.00 0.00 0.00 12:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:06:01 AM eth0 9.13 0.30 1.56 0.26 0.00 0.00 0.00 0.00 12:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:07:01 AM eth0 1.28 0.53 0.14 0.09 0.00 0.00 0.00 0.00 12:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:08:01 AM eth0 0.62 0.00 0.03 0.00 0.00 0.00 0.00 0.00 12:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:09:01 AM eth0 0.68 0.55 0.11 0.09 0.00 0.00 0.00 0.00 12:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:10:01 AM eth0 0.47 0.02 0.02 0.00 0.00 0.00 0.00 0.00 12:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:11:01 AM eth0 7.55 7.38 1.58 0.97 0.00 0.00 0.00 0.00 12:12:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:12:02 AM eth0 5.41 3.85 0.84 0.34 0.00 0.00 0.00 0.00 12:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:13:01 AM eth0 6.35 5.30 1.48 0.70 0.00 0.00 0.00 0.00 12:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:14:01 AM eth0 7.72 4.98 1.12 0.62 0.00 0.00 0.00 0.00 12:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:15:01 AM eth0 12.78 8.07 1.67 0.61 0.00 0.00 0.00 0.00 12:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:16:01 AM eth0 5.12 4.35 1.02 0.61 0.00 0.00 0.00 0.00 12:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:17:01 AM eth0 7.36 7.25 1.21 0.88 0.00 0.00 0.00 0.00 12:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:18:01 AM eth0 9.82 9.78 1.77 1.20 0.00 0.00 0.00 0.00 12:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:19:01 AM eth0 9.35 9.38 1.99 1.75 0.00 0.00 0.00 0.00 12:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:20:01 AM eth0 11.28 9.46 2.33 1.93 0.00 0.00 0.00 0.00 12:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:21:01 AM eth0 9.60 9.73 2.11 1.87 0.00 0.00 0.00 0.00 12:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:22:01 AM eth0 9.42 9.40 1.99 1.74 0.00 0.00 0.00 0.00 12:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:23:01 AM eth0 9.61 9.63 2.07 1.81 0.00 0.00 0.00 0.00 12:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:24:01 AM eth0 11.90 12.18 2.56 2.30 0.00 0.00 0.00 0.00 12:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:25:01 AM eth0 8.85 8.40 2.02 1.46 0.00 0.00 0.00 0.00 12:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:26:01 AM eth0 0.93 0.12 0.36 0.07 0.00 0.00 0.00 0.00 12:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:27:01 AM eth0 0.47 0.25 0.26 0.20 0.00 0.00 0.00 0.00 12:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:28:01 AM eth0 0.63 0.52 0.10 0.09 0.00 0.00 0.00 0.00 12:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:29:01 AM eth0 0.15 0.00 0.01 0.00 0.00 0.00 0.00 0.00 12:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:30:01 AM eth0 0.70 0.55 0.11 0.09 0.00 0.00 0.00 0.00 12:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:31:01 AM eth0 0.28 0.08 0.08 0.06 0.00 0.00 0.00 0.00 12:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:32:01 AM eth0 8.20 7.88 1.60 0.95 0.00 0.00 0.00 0.00 12:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:33:01 AM eth0 3.85 3.73 0.91 0.52 0.00 0.00 0.00 0.00 12:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:34:01 AM eth0 5.75 5.20 1.24 0.59 0.00 0.00 0.00 0.00 12:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:35:01 AM eth0 1.48 0.70 0.43 0.27 0.00 0.00 0.00 0.00 12:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:36:01 AM eth0 0.60 0.08 0.13 0.06 0.00 0.00 0.00 0.00 12:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:37:01 AM eth0 4.37 4.27 0.66 0.30 0.00 0.00 0.00 0.00 12:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:38:01 AM eth0 1.42 1.67 0.16 0.40 0.00 0.00 0.00 0.00 12:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:39:01 AM eth0 5.03 4.73 0.79 0.52 0.00 0.00 0.00 0.00 12:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:40:01 AM eth0 4.93 4.87 0.78 0.49 0.00 0.00 0.00 0.00 12:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:41:01 AM eth0 11.38 10.83 2.37 1.40 0.00 0.00 0.00 0.00 12:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:42:01 AM eth0 6.18 5.97 1.26 1.09 0.00 0.00 0.00 0.00 12:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:43:01 AM eth0 9.70 9.93 2.28 2.01 0.00 0.00 0.00 0.00 12:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:44:01 AM eth0 9.55 9.26 2.08 1.79 0.00 0.00 0.00 0.00 12:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:45:01 AM eth0 9.63 9.83 2.28 2.00 0.00 0.00 0.00 0.00 12:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:46:01 AM eth0 9.20 9.38 2.03 1.80 0.00 0.00 0.00 0.00 12:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:47:01 AM eth0 9.36 9.63 2.03 1.80 0.00 0.00 0.00 0.00 12:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:48:01 AM eth0 18.36 18.53 4.12 3.39 0.00 0.00 0.00 0.00 12:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:49:01 AM eth0 0.65 0.60 0.13 0.10 0.00 0.00 0.00 0.00 12:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:50:01 AM eth0 0.33 0.05 0.02 0.00 0.00 0.00 0.00 0.00 12:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:51:01 AM eth0 0.65 0.52 0.18 0.15 0.00 0.00 0.00 0.00 12:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:52:01 AM eth0 0.23 0.08 0.01 0.00 0.00 0.00 0.00 0.00 12:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:53:01 AM eth0 0.20 0.00 0.01 0.00 0.00 0.00 0.00 0.00 12:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:54:01 AM eth0 0.58 0.50 0.10 0.09 0.00 0.00 0.00 0.00 12:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:55:01 AM eth0 0.10 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:56:01 AM eth0 8.22 7.68 1.68 0.99 0.00 0.00 0.00 0.00 12:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:57:01 AM eth0 7.01 6.38 1.54 0.72 0.00 0.00 0.00 0.00 12:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:58:01 AM eth0 3.35 3.22 0.59 0.27 0.00 0.00 0.00 0.00 12:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:59:01 AM eth0 7.12 6.88 1.19 0.57 0.00 0.00 0.00 0.00 01:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:00:01 AM eth0 4.67 4.02 0.74 0.32 0.00 0.00 0.00 0.00 01:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:01:01 AM eth0 6.85 6.51 1.98 1.01 0.00 0.00 0.00 0.00 01:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:02:01 AM eth0 10.41 10.51 2.31 8.41 0.00 0.00 0.00 0.00 01:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:03:01 AM eth0 9.40 9.70 2.03 1.81 0.00 0.00 0.00 0.00 01:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:04:01 AM eth0 10.63 10.35 2.39 8.72 0.00 0.00 0.00 0.00 01:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:05:01 AM eth0 9.43 9.66 2.03 1.81 0.00 0.00 0.00 0.00 01:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:06:01 AM eth0 9.93 9.35 2.12 1.80 0.00 0.00 0.00 0.00 01:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:07:01 AM eth0 12.56 9.65 2.32 1.81 0.00 0.00 0.00 0.00 01:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:08:01 AM eth0 18.36 14.91 4.22 3.06 0.00 0.00 0.00 0.00 01:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:09:01 AM eth0 1.98 1.08 1.01 0.68 0.00 0.00 0.00 0.00 01:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:10:01 AM eth0 1.00 0.00 0.10 0.00 0.00 0.00 0.00 0.00 01:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:11:01 AM eth0 3.42 0.58 0.50 0.15 0.00 0.00 0.00 0.00 01:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:12:01 AM eth0 5.18 0.02 0.65 0.00 0.00 0.00 0.00 0.00 01:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:13:01 AM eth0 0.60 0.02 0.03 0.00 0.00 0.00 0.00 0.00 01:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:14:01 AM eth0 1.02 0.53 0.12 0.09 0.00 0.00 0.00 0.00 01:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:15:01 AM eth0 0.40 0.00 0.02 0.00 0.00 0.00 0.00 0.00 01:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:16:01 AM eth0 8.28 7.97 1.63 1.02 0.00 0.00 0.00 0.00 01:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:17:01 AM eth0 7.10 5.85 1.25 0.50 0.00 0.00 0.00 0.00 01:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:18:01 AM eth0 2.77 2.03 0.53 0.21 0.00 0.00 0.00 0.00 01:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:19:01 AM eth0 4.67 4.50 1.02 0.44 0.00 0.00 0.00 0.00 01:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:20:01 AM eth0 4.35 3.38 0.99 0.47 0.00 0.00 0.00 0.00 01:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:21:01 AM eth0 5.63 5.60 1.28 0.77 0.00 0.00 0.00 0.00 01:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:22:01 AM eth0 11.06 9.76 2.19 1.81 0.00 0.00 0.00 0.00 01:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:23:01 AM eth0 10.58 9.82 2.43 2.05 0.00 0.00 0.00 0.00 01:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:24:01 AM eth0 9.45 9.43 1.99 1.75 0.00 0.00 0.00 0.00 01:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:25:01 AM eth0 9.23 9.30 1.96 1.74 0.00 0.00 0.00 0.00 01:26:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:26:02 AM eth0 11.96 9.78 2.41 1.87 0.00 0.00 0.00 0.00 01:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:27:01 AM eth0 9.52 9.41 2.00 1.76 0.00 0.00 0.00 0.00 01:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:28:01 AM eth0 15.18 14.91 3.39 2.72 0.00 0.00 0.00 0.00 01:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:29:01 AM eth0 0.95 0.85 0.18 0.16 0.00 0.00 0.00 0.00 01:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:30:01 AM eth0 0.38 0.00 0.02 0.00 0.00 0.00 0.00 0.00 01:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:31:01 AM eth0 0.80 0.63 0.18 0.15 0.00 0.00 0.00 0.00 01:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:32:01 AM eth0 1.88 0.05 0.45 0.00 0.00 0.00 0.00 0.00 01:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:33:01 AM eth0 4.63 1.02 1.01 0.54 0.00 0.00 0.00 0.00 01:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:34:01 AM eth0 1.37 0.62 0.79 0.59 0.00 0.00 0.00 0.00 01:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:35:01 AM eth0 4.25 2.90 0.87 0.54 0.00 0.00 0.00 0.00 01:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:36:01 AM eth0 13.15 7.18 2.21 0.66 0.00 0.00 0.00 0.00 01:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:37:01 AM eth0 4.18 3.02 0.59 0.27 0.00 0.00 0.00 0.00 01:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:38:01 AM eth0 1.10 0.38 0.09 0.06 0.00 0.00 0.00 0.00 01:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:39:01 AM eth0 7.88 6.60 1.48 0.78 0.00 0.00 0.00 0.00 01:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:40:01 AM eth0 9.05 8.46 1.91 1.25 0.00 0.00 0.00 0.00 01:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:41:01 AM eth0 9.68 9.48 2.08 1.81 0.00 0.00 0.00 0.00 01:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:42:01 AM eth0 12.03 9.48 2.38 1.79 0.00 0.00 0.00 0.00 01:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:43:01 AM eth0 11.05 10.03 2.90 2.33 0.00 0.00 0.00 0.00 01:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:44:01 AM eth0 9.50 9.23 2.03 1.73 0.00 0.00 0.00 0.00 01:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:45:01 AM eth0 12.81 9.68 2.50 1.81 0.00 0.00 0.00 0.00 01:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:46:01 AM eth0 13.73 10.48 2.67 2.03 0.00 0.00 0.00 0.00 01:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:47:01 AM eth0 10.88 10.36 2.45 1.86 0.00 0.00 0.00 0.00 01:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:48:01 AM eth0 0.47 0.00 0.02 0.00 0.00 0.00 0.00 0.00 01:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:49:01 AM eth0 0.63 0.43 0.10 0.08 0.00 0.00 0.00 0.00 01:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:50:01 AM eth0 0.52 0.13 0.03 0.01 0.00 0.00 0.00 0.00 01:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:51:01 AM eth0 0.43 0.12 0.09 0.07 0.00 0.00 0.00 0.00 01:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:52:01 AM eth0 3.17 0.52 0.41 0.09 0.00 0.00 0.00 0.00 01:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:53:01 AM eth0 1.98 0.33 0.46 0.26 0.00 0.00 0.00 0.00 01:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:54:01 AM eth0 9.43 7.67 1.96 1.12 0.00 0.00 0.00 0.00 01:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:55:01 AM eth0 7.58 6.60 1.71 0.95 0.00 0.00 0.00 0.00 01:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:56:01 AM eth0 11.96 8.30 2.24 1.58 0.00 0.00 0.00 0.00 01:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:57:01 AM eth0 9.63 9.63 2.04 1.80 0.00 0.00 0.00 0.00 01:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:58:01 AM eth0 9.27 9.27 1.96 1.73 0.00 0.00 0.00 0.00 01:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:59:01 AM eth0 9.96 9.76 2.11 1.81 0.00 0.00 0.00 0.00 02:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:00:01 AM eth0 9.15 9.25 1.96 1.73 0.00 0.00 0.00 0.00 02:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:01:01 AM eth0 9.61 9.81 2.11 1.87 0.00 0.00 0.00 0.00 02:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:02:01 AM eth0 19.49 16.58 4.05 3.01 0.00 0.00 0.00 0.00 02:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:03:01 AM eth0 2.38 1.18 0.93 0.68 0.00 0.00 0.00 0.00 02:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:04:01 AM eth0 0.60 0.00 0.05 0.00 0.00 0.00 0.00 0.00 02:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:05:01 AM eth0 1.20 0.72 0.45 0.34 0.00 0.00 0.00 0.00 02:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:06:01 AM eth0 3.17 0.10 0.46 0.06 0.00 0.00 0.00 0.00 02:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:07:01 AM eth0 5.90 0.05 0.73 0.00 0.00 0.00 0.00 0.00 02:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:08:01 AM eth0 1.25 0.45 0.18 0.08 0.00 0.00 0.00 0.00 02:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:09:01 AM eth0 0.78 0.10 0.20 0.01 0.00 0.00 0.00 0.00 02:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:10:01 AM eth0 8.18 7.92 1.57 0.99 0.00 0.00 0.00 0.00 02:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:11:01 AM eth0 8.52 7.20 1.78 1.03 0.00 0.00 0.00 0.00 02:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:12:01 AM eth0 11.00 10.56 2.65 2.28 0.00 0.00 0.00 0.00 02:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:13:01 AM eth0 11.08 9.77 2.49 2.05 0.00 0.00 0.00 0.00 02:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:14:01 AM eth0 9.70 9.83 2.25 1.96 0.00 0.00 0.00 0.00 02:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:15:01 AM eth0 9.26 9.43 1.99 1.77 0.00 0.00 0.00 0.00 02:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:16:01 AM eth0 10.25 9.68 2.17 1.84 0.00 0.00 0.00 0.00 02:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:17:01 AM eth0 11.28 9.38 2.27 1.74 0.00 0.00 0.00 0.00 02:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:18:01 AM eth0 14.55 14.43 3.25 2.61 0.00 0.00 0.00 0.00 02:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:19:01 AM eth0 0.73 0.50 0.11 0.09 0.00 0.00 0.00 0.00 02:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:20:01 AM eth0 0.75 0.28 0.27 0.20 0.00 0.00 0.00 0.00 02:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:21:01 AM eth0 0.80 0.58 0.18 0.15 0.00 0.00 0.00 0.00 02:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:22:01 AM eth0 0.78 0.02 0.05 0.00 0.00 0.00 0.00 0.00 02:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:23:01 AM eth0 2.47 0.87 0.61 0.35 0.00 0.00 0.00 0.00 02:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:24:01 AM eth0 0.78 0.40 0.51 0.38 0.00 0.00 0.00 0.00 02:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:25:01 AM eth0 7.40 7.33 1.51 0.92 0.00 0.00 0.00 0.00 02:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:26:01 AM eth0 8.43 6.33 2.11 0.99 0.00 0.00 0.00 0.00 02:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:27:01 AM eth0 6.40 5.13 1.19 0.95 0.00 0.00 0.00 0.00 02:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:28:01 AM eth0 9.53 9.58 2.03 1.80 0.00 0.00 0.00 0.00 02:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:29:01 AM eth0 9.25 9.33 1.97 1.74 0.00 0.00 0.00 0.00 02:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:30:01 AM eth0 9.28 9.25 1.96 1.73 0.00 0.00 0.00 0.00 02:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:31:01 AM eth0 9.35 9.38 2.04 1.80 0.00 0.00 0.00 0.00 02:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:32:01 AM eth0 9.75 9.28 2.02 1.74 0.00 0.00 0.00 0.00 02:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:33:01 AM eth0 15.80 14.98 4.13 3.21 0.00 0.00 0.00 0.00 02:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:34:01 AM eth0 5.88 5.70 1.09 0.96 0.00 0.00 0.00 0.00 02:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:35:01 AM eth0 0.22 0.00 0.01 0.00 0.00 0.00 0.00 0.00 02:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:36:01 AM eth0 4.30 0.10 0.37 0.06 0.00 0.00 0.00 0.00 02:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:37:01 AM eth0 0.65 0.55 0.12 0.09 0.00 0.00 0.00 0.00 02:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:38:01 AM eth0 0.22 0.00 0.01 0.00 0.00 0.00 0.00 0.00 02:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:39:01 AM eth0 0.65 0.50 0.10 0.09 0.00 0.00 0.00 0.00 02:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:40:01 AM eth0 0.28 0.05 0.01 0.00 0.00 0.00 0.00 0.00 02:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:41:01 AM eth0 7.45 7.35 1.56 0.97 0.00 0.00 0.00 0.00 02:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:42:01 AM eth0 6.85 6.63 4.35 0.94 0.00 0.00 0.00 0.00 02:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:43:01 AM eth0 6.98 6.30 4.57 1.00 0.00 0.00 0.00 0.00 02:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:44:01 AM eth0 8.28 8.23 4.34 0.94 0.00 0.00 0.00 0.00 02:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:45:01 AM eth0 10.18 9.40 4.92 1.36 0.00 0.00 0.00 0.00 02:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:46:01 AM eth0 10.06 9.78 3.40 1.27 0.00 0.00 0.00 0.00 02:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:47:01 AM eth0 9.97 9.45 4.59 1.12 0.00 0.00 0.00 0.00 02:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:48:01 AM eth0 10.70 10.01 4.94 1.40 0.00 0.00 0.00 0.00 02:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:49:01 AM eth0 104.91 77.88 237.29 245.95 0.00 0.00 0.00 0.00 02:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:50:01 AM eth0 16.26 16.56 13.74 7.36 0.00 0.00 0.00 0.00 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 Average: eth0 7.04 6.03 2.90 2.52 0.00 0.00 0.00 0.00 ---> sar -P ALL: Linux 4.18.0-532.el8.x86_64 (prd-centos8-robot-2c-8g-2516.novalocal) 02/04/2024 _x86_64_ (2 CPU) 12:00:01 AM CPU %user %nice %system %iowait %steal %idle 12:01:01 AM all 4.55 0.03 0.39 0.04 0.05 94.95 12:01:01 AM 0 3.45 0.00 0.27 0.07 0.05 96.16 12:01:01 AM 1 5.64 0.05 0.50 0.02 0.05 93.74 12:02:01 AM all 4.30 0.00 0.23 0.00 0.03 95.45 12:02:01 AM 0 1.52 0.00 0.18 0.00 0.02 98.28 12:02:01 AM 1 7.07 0.00 0.27 0.00 0.05 92.61 12:03:01 AM all 5.35 0.00 0.25 0.00 0.05 94.35 12:03:01 AM 0 2.21 0.00 0.23 0.00 0.05 97.51 12:03:01 AM 1 8.50 0.00 0.27 0.00 0.05 91.18 12:04:01 AM all 4.12 0.00 0.20 0.00 0.03 95.64 12:04:01 AM 0 2.36 0.00 0.20 0.00 0.03 97.40 12:04:01 AM 1 5.88 0.00 0.20 0.00 0.03 93.88 12:05:01 AM all 0.37 0.00 0.08 0.00 0.09 99.47 12:05:01 AM 0 0.30 0.00 0.10 0.00 0.13 99.47 12:05:01 AM 1 0.43 0.00 0.05 0.00 0.05 99.47 12:06:01 AM all 0.33 0.00 0.08 0.00 0.02 99.57 12:06:01 AM 0 0.08 0.00 0.07 0.00 0.02 99.83 12:06:01 AM 1 0.58 0.00 0.10 0.00 0.02 99.30 12:07:01 AM all 0.52 0.00 0.09 0.00 0.07 99.32 12:07:01 AM 0 0.27 0.00 0.08 0.00 0.07 99.58 12:07:01 AM 1 0.77 0.00 0.10 0.00 0.07 99.07 12:08:01 AM all 0.36 0.00 0.11 0.01 0.02 99.51 12:08:01 AM 0 0.15 0.00 0.13 0.00 0.02 99.70 12:08:01 AM 1 0.57 0.00 0.08 0.02 0.02 99.32 12:09:01 AM all 0.55 0.00 0.07 0.00 0.03 99.36 12:09:01 AM 0 0.18 0.00 0.08 0.00 0.03 99.70 12:09:01 AM 1 0.92 0.00 0.05 0.00 0.02 99.02 12:10:01 AM all 0.31 0.00 0.07 0.00 0.02 99.61 12:10:01 AM 0 0.10 0.00 0.08 0.00 0.02 99.80 12:10:01 AM 1 0.52 0.00 0.05 0.00 0.02 99.42 12:11:01 AM all 4.58 0.00 0.53 0.00 0.03 94.85 12:11:01 AM 0 0.77 0.00 0.13 0.00 0.03 99.06 12:11:01 AM 1 8.51 0.00 0.95 0.00 0.03 90.51 12:11:01 AM CPU %user %nice %system %iowait %steal %idle 12:12:02 AM all 6.22 0.00 0.90 0.00 0.05 92.83 12:12:02 AM 0 6.34 0.00 1.01 0.00 0.05 92.59 12:12:02 AM 1 6.09 0.00 0.79 0.00 0.05 93.06 12:13:01 AM all 6.75 0.00 0.99 0.00 0.05 92.21 12:13:01 AM 0 8.39 0.00 1.37 0.00 0.05 90.18 12:13:01 AM 1 5.19 0.00 0.62 0.00 0.05 94.13 12:14:01 AM all 7.42 0.00 0.94 0.00 0.07 91.57 12:14:01 AM 0 0.52 0.00 0.13 0.00 0.05 99.30 12:14:01 AM 1 14.84 0.00 1.82 0.00 0.09 83.25 12:15:01 AM all 7.26 0.00 1.04 0.00 0.06 91.63 12:15:01 AM 0 2.60 0.00 0.37 0.00 0.07 96.96 12:15:01 AM 1 12.13 0.00 1.74 0.00 0.05 86.07 12:16:01 AM all 7.18 0.00 1.01 0.00 0.05 91.75 12:16:01 AM 0 2.46 0.00 0.37 0.00 0.03 97.13 12:16:01 AM 1 12.11 0.00 1.68 0.00 0.07 86.14 12:17:01 AM all 6.90 0.00 0.97 0.00 0.05 92.08 12:17:01 AM 0 9.05 0.00 1.31 0.00 0.05 89.58 12:17:01 AM 1 4.86 0.00 0.65 0.00 0.05 94.44 12:18:01 AM all 6.96 0.00 0.84 0.00 0.05 92.15 12:18:01 AM 0 0.77 0.00 0.17 0.00 0.03 99.03 12:18:01 AM 1 13.48 0.00 1.55 0.00 0.07 84.91 12:19:01 AM all 4.46 0.00 0.17 0.00 0.04 95.33 12:19:01 AM 0 3.20 0.00 0.15 0.00 0.05 96.60 12:19:01 AM 1 5.72 0.00 0.18 0.00 0.03 94.06 12:20:01 AM all 4.40 0.00 0.23 0.00 0.03 95.33 12:20:01 AM 0 2.17 0.00 0.17 0.00 0.02 97.64 12:20:01 AM 1 6.64 0.00 0.30 0.00 0.05 93.01 12:21:01 AM all 4.61 0.00 0.19 0.00 0.05 95.14 12:21:01 AM 0 2.59 0.00 0.15 0.00 0.05 97.21 12:21:01 AM 1 6.64 0.00 0.23 0.00 0.05 93.08 12:22:01 AM all 4.40 0.00 0.21 0.00 0.04 95.35 12:22:01 AM 0 5.97 0.00 0.25 0.00 0.03 93.75 12:22:01 AM 1 2.84 0.00 0.17 0.00 0.05 96.94 12:22:01 AM CPU %user %nice %system %iowait %steal %idle 12:23:01 AM all 4.59 0.00 0.19 0.00 0.04 95.17 12:23:01 AM 0 2.58 0.00 0.15 0.00 0.03 97.24 12:23:01 AM 1 6.62 0.00 0.23 0.00 0.05 93.10 12:24:01 AM all 5.47 0.00 0.23 0.00 0.04 94.26 12:24:01 AM 0 4.61 0.00 0.22 0.00 0.03 95.14 12:24:01 AM 1 6.33 0.00 0.23 0.00 0.05 93.38 12:25:01 AM all 3.27 0.00 0.17 0.00 0.03 96.53 12:25:01 AM 0 1.82 0.00 0.13 0.00 0.03 98.01 12:25:01 AM 1 4.72 0.00 0.20 0.00 0.03 95.05 12:26:01 AM all 0.33 0.01 0.09 0.02 0.03 99.53 12:26:01 AM 0 0.10 0.00 0.08 0.02 0.03 99.77 12:26:01 AM 1 0.55 0.02 0.10 0.02 0.02 99.30 12:27:01 AM all 0.37 0.00 0.08 0.00 0.02 99.53 12:27:01 AM 0 0.12 0.00 0.10 0.00 0.02 99.77 12:27:01 AM 1 0.62 0.00 0.07 0.00 0.02 99.30 12:28:01 AM all 0.51 0.00 0.07 0.00 0.03 99.40 12:28:01 AM 0 0.45 0.00 0.07 0.00 0.02 99.47 12:28:01 AM 1 0.57 0.00 0.07 0.00 0.03 99.33 12:29:01 AM all 0.35 0.00 0.07 0.00 0.03 99.56 12:29:01 AM 0 0.12 0.00 0.07 0.00 0.03 99.78 12:29:01 AM 1 0.58 0.00 0.07 0.00 0.02 99.33 12:30:01 AM all 0.52 0.00 0.08 0.00 0.02 99.39 12:30:01 AM 0 0.48 0.00 0.05 0.00 0.02 99.45 12:30:01 AM 1 0.55 0.00 0.10 0.00 0.02 99.33 12:31:01 AM all 0.33 0.00 0.08 0.00 0.02 99.57 12:31:01 AM 0 0.13 0.00 0.08 0.00 0.02 99.77 12:31:01 AM 1 0.53 0.00 0.08 0.00 0.02 99.37 12:32:01 AM all 4.51 0.00 0.53 0.00 0.04 94.92 12:32:01 AM 0 3.65 0.00 0.39 0.00 0.03 95.93 12:32:01 AM 1 5.38 0.00 0.66 0.00 0.05 93.91 12:33:01 AM all 6.73 0.00 0.92 0.00 0.05 92.30 12:33:01 AM 0 4.62 0.00 0.76 0.00 0.05 94.56 12:33:01 AM 1 8.84 0.00 1.08 0.00 0.05 90.03 12:33:01 AM CPU %user %nice %system %iowait %steal %idle 12:34:01 AM all 7.32 0.00 0.80 0.00 0.06 91.82 12:34:01 AM 0 10.04 0.00 1.29 0.00 0.07 88.60 12:34:01 AM 1 4.77 0.00 0.34 0.00 0.05 94.84 12:35:01 AM all 4.39 0.00 0.62 0.00 0.03 94.95 12:35:01 AM 0 0.15 0.00 0.18 0.00 0.03 99.63 12:35:01 AM 1 8.80 0.00 1.08 0.00 0.03 90.09 12:36:01 AM all 0.25 0.00 0.10 0.00 0.02 99.63 12:36:01 AM 0 0.17 0.00 0.12 0.00 0.02 99.70 12:36:01 AM 1 0.33 0.00 0.08 0.00 0.02 99.57 12:37:01 AM all 2.66 0.00 0.35 0.00 0.04 96.96 12:37:01 AM 0 0.23 0.00 0.12 0.00 0.05 99.60 12:37:01 AM 1 5.12 0.00 0.58 0.00 0.03 94.27 12:38:01 AM all 7.52 0.00 0.37 0.00 0.03 92.07 12:38:01 AM 0 3.41 0.00 0.12 0.00 0.02 96.46 12:38:01 AM 1 11.72 0.00 0.63 0.00 0.05 87.59 12:39:01 AM all 7.27 0.00 0.50 0.00 0.04 92.19 12:39:01 AM 0 4.87 0.00 0.12 0.00 0.03 94.98 12:39:01 AM 1 9.75 0.00 0.90 0.00 0.05 89.30 12:40:01 AM all 6.56 0.00 0.85 0.00 0.07 92.52 12:40:01 AM 0 10.20 0.00 1.30 0.00 0.09 88.42 12:40:01 AM 1 3.15 0.00 0.42 0.00 0.05 96.38 12:41:01 AM all 8.25 0.00 1.01 0.00 0.05 90.69 12:41:01 AM 0 3.19 0.00 0.48 0.00 0.05 96.28 12:41:01 AM 1 13.49 0.00 1.57 0.00 0.05 84.89 12:42:01 AM all 6.71 0.00 0.68 0.00 0.05 92.56 12:42:01 AM 0 3.92 0.00 0.15 0.00 0.03 95.90 12:42:01 AM 1 9.61 0.00 1.23 0.00 0.07 89.08 12:43:01 AM all 4.59 0.00 0.22 0.00 0.04 95.15 12:43:01 AM 0 3.48 0.00 0.20 0.00 0.05 96.27 12:43:01 AM 1 5.69 0.00 0.23 0.00 0.03 94.04 12:44:01 AM all 4.37 0.00 0.17 0.00 0.04 95.42 12:44:01 AM 0 6.26 0.00 0.18 0.00 0.03 93.52 12:44:01 AM 1 2.49 0.00 0.15 0.00 0.05 97.31 12:44:01 AM CPU %user %nice %system %iowait %steal %idle 12:45:01 AM all 4.64 0.00 0.20 0.00 0.04 95.12 12:45:01 AM 0 6.45 0.00 0.22 0.00 0.05 93.28 12:45:01 AM 1 2.83 0.00 0.18 0.00 0.03 96.96 12:46:01 AM all 4.41 0.00 0.18 0.00 0.05 95.36 12:46:01 AM 0 5.18 0.00 0.18 0.00 0.05 94.59 12:46:01 AM 1 3.64 0.00 0.18 0.00 0.05 96.12 12:47:01 AM all 4.61 0.00 0.21 0.00 0.04 95.14 12:47:01 AM 0 6.92 0.00 0.24 0.00 0.05 92.80 12:47:01 AM 1 2.31 0.00 0.18 0.00 0.03 97.48 12:48:01 AM all 7.63 0.00 0.27 0.00 0.04 92.06 12:48:01 AM 0 6.37 0.00 0.29 0.00 0.05 93.29 12:48:01 AM 1 8.89 0.00 0.25 0.00 0.03 90.82 12:49:01 AM all 0.68 0.00 0.08 0.00 0.03 99.22 12:49:01 AM 0 0.80 0.00 0.05 0.00 0.03 99.11 12:49:01 AM 1 0.55 0.00 0.10 0.00 0.03 99.32 12:50:01 AM all 0.19 0.00 0.09 0.00 0.03 99.69 12:50:01 AM 0 0.08 0.00 0.08 0.00 0.02 99.82 12:50:01 AM 1 0.30 0.00 0.10 0.00 0.03 99.57 12:51:01 AM all 0.50 0.00 0.08 0.00 0.02 99.40 12:51:01 AM 0 0.15 0.00 0.10 0.00 0.02 99.73 12:51:01 AM 1 0.85 0.00 0.07 0.00 0.02 99.07 12:52:01 AM all 0.28 0.00 0.08 0.00 0.02 99.63 12:52:01 AM 0 0.47 0.00 0.07 0.00 0.02 99.45 12:52:01 AM 1 0.08 0.00 0.08 0.00 0.02 99.82 12:53:01 AM all 0.30 0.00 0.07 0.00 0.03 99.61 12:53:01 AM 0 0.47 0.00 0.07 0.00 0.02 99.45 12:53:01 AM 1 0.13 0.00 0.07 0.00 0.03 99.77 12:54:01 AM all 0.45 0.00 0.08 0.00 0.02 99.46 12:54:01 AM 0 0.40 0.00 0.05 0.00 0.02 99.53 12:54:01 AM 1 0.50 0.00 0.10 0.00 0.02 99.38 12:55:01 AM all 0.33 0.15 0.13 0.00 0.03 99.37 12:55:01 AM 0 0.13 0.00 0.12 0.00 0.03 99.72 12:55:01 AM 1 0.53 0.30 0.13 0.00 0.02 99.02 12:55:01 AM CPU %user %nice %system %iowait %steal %idle 12:56:01 AM all 5.75 0.00 0.64 0.00 0.04 93.57 12:56:01 AM 0 2.51 0.00 0.15 0.00 0.03 97.31 12:56:01 AM 1 9.12 0.00 1.15 0.00 0.05 89.68 12:57:01 AM all 6.23 0.00 1.08 0.00 0.06 92.63 12:57:01 AM 0 8.05 0.00 1.47 0.00 0.07 90.40 12:57:01 AM 1 4.50 0.00 0.70 0.00 0.05 94.75 12:58:01 AM all 7.42 0.00 1.07 0.00 0.04 91.47 12:58:01 AM 0 0.25 0.00 0.13 0.00 0.03 99.58 12:58:01 AM 1 15.12 0.00 2.08 0.00 0.05 82.75 12:59:01 AM all 6.09 0.00 1.05 0.00 0.06 92.80 12:59:01 AM 0 9.72 0.00 1.61 0.00 0.07 88.60 12:59:01 AM 1 2.73 0.00 0.54 0.00 0.05 96.68 01:00:01 AM all 7.28 0.00 1.08 0.00 0.07 91.58 01:00:01 AM 0 0.50 0.00 0.13 0.00 0.05 99.31 01:00:01 AM 1 14.48 0.00 2.08 0.00 0.09 83.34 01:01:01 AM all 7.14 0.00 0.92 0.00 0.05 91.89 01:01:01 AM 0 6.03 0.00 0.93 0.00 0.05 92.99 01:01:01 AM 1 8.23 0.00 0.90 0.00 0.05 90.83 01:02:01 AM all 5.18 0.00 0.31 0.00 0.05 94.46 01:02:01 AM 0 5.38 0.00 0.44 0.00 0.05 94.13 01:02:01 AM 1 4.98 0.00 0.18 0.00 0.05 94.78 01:03:01 AM all 4.37 0.00 0.18 0.00 0.04 95.41 01:03:01 AM 0 1.98 0.00 0.15 0.00 0.05 97.82 01:03:01 AM 1 6.77 0.00 0.20 0.00 0.03 93.00 01:04:01 AM all 4.16 0.00 0.19 0.00 0.05 95.60 01:04:01 AM 0 5.71 0.00 0.20 0.00 0.05 94.04 01:04:01 AM 1 2.61 0.00 0.18 0.00 0.05 97.16 01:05:01 AM all 4.34 0.00 0.18 0.00 0.04 95.44 01:05:01 AM 0 5.66 0.00 0.18 0.00 0.05 94.10 01:05:01 AM 1 3.01 0.00 0.18 0.00 0.03 96.77 01:06:01 AM all 4.50 0.00 0.19 0.00 0.05 95.26 01:06:01 AM 0 3.25 0.00 0.22 0.00 0.05 96.49 01:06:01 AM 1 5.75 0.00 0.17 0.00 0.05 94.04 01:06:01 AM CPU %user %nice %system %iowait %steal %idle 01:07:01 AM all 4.66 0.00 0.23 0.00 0.04 95.07 01:07:01 AM 0 3.17 0.00 0.22 0.00 0.03 96.58 01:07:01 AM 1 6.15 0.00 0.25 0.00 0.05 93.55 01:08:01 AM all 5.89 0.00 0.25 0.00 0.03 93.83 01:08:01 AM 0 6.92 0.00 0.22 0.00 0.03 92.83 01:08:01 AM 1 4.86 0.00 0.28 0.00 0.03 94.83 01:09:01 AM all 0.69 0.00 0.09 0.00 0.03 99.19 01:09:01 AM 0 0.53 0.00 0.07 0.00 0.02 99.38 01:09:01 AM 1 0.85 0.00 0.12 0.00 0.03 99.00 01:10:01 AM all 0.33 0.00 0.06 0.00 0.03 99.58 01:10:01 AM 0 0.08 0.00 0.08 0.00 0.03 99.80 01:10:01 AM 1 0.58 0.00 0.03 0.00 0.02 99.37 01:11:01 AM all 0.48 0.00 0.12 0.00 0.03 99.38 01:11:01 AM 0 0.15 0.00 0.12 0.00 0.02 99.72 01:11:01 AM 1 0.80 0.00 0.12 0.00 0.03 99.05 01:12:01 AM all 0.31 0.00 0.08 0.00 0.03 99.59 01:12:01 AM 0 0.50 0.00 0.08 0.00 0.03 99.38 01:12:01 AM 1 0.12 0.00 0.07 0.00 0.02 99.80 01:13:01 AM all 0.34 0.00 0.06 0.00 0.02 99.58 01:13:01 AM 0 0.52 0.00 0.05 0.00 0.02 99.42 01:13:01 AM 1 0.17 0.00 0.07 0.00 0.02 99.75 01:14:01 AM all 0.52 0.00 0.08 0.00 0.03 99.38 01:14:01 AM 0 0.58 0.00 0.08 0.00 0.02 99.32 01:14:01 AM 1 0.45 0.00 0.07 0.00 0.03 99.45 01:15:01 AM all 0.27 0.00 0.06 0.00 0.02 99.66 01:15:01 AM 0 0.40 0.00 0.03 0.00 0.02 99.55 01:15:01 AM 1 0.13 0.00 0.08 0.00 0.02 99.77 01:16:01 AM all 6.32 0.00 0.76 0.00 0.05 92.87 01:16:01 AM 0 10.55 0.00 1.42 0.00 0.07 87.96 01:16:01 AM 1 2.30 0.00 0.13 0.00 0.03 97.53 01:17:01 AM all 7.52 0.00 1.12 0.00 0.05 91.30 01:17:01 AM 0 12.31 0.00 1.87 0.00 0.07 85.75 01:17:01 AM 1 2.98 0.00 0.42 0.00 0.03 96.56 01:17:01 AM CPU %user %nice %system %iowait %steal %idle 01:18:01 AM all 7.44 0.00 1.08 0.00 0.05 91.43 01:18:01 AM 0 7.11 0.00 1.00 0.00 0.05 91.84 01:18:01 AM 1 7.78 0.00 1.16 0.00 0.05 91.01 01:19:01 AM all 7.43 0.00 0.93 0.00 0.04 91.59 01:19:01 AM 0 4.95 0.00 0.65 0.00 0.03 94.37 01:19:01 AM 1 9.98 0.00 1.23 0.00 0.05 88.74 01:20:01 AM all 7.18 0.00 1.06 0.00 0.06 91.71 01:20:01 AM 0 9.27 0.00 1.33 0.00 0.07 89.33 01:20:01 AM 1 5.11 0.00 0.79 0.00 0.05 94.04 01:21:01 AM all 8.01 0.00 1.04 0.00 0.05 90.90 01:21:01 AM 0 7.53 0.00 1.14 0.00 0.05 91.27 01:21:01 AM 1 8.49 0.00 0.93 0.00 0.05 90.52 01:22:01 AM all 5.57 0.00 0.30 0.00 0.05 94.08 01:22:01 AM 0 7.27 0.00 0.37 0.00 0.05 92.31 01:22:01 AM 1 3.88 0.00 0.23 0.00 0.05 95.83 01:23:01 AM all 4.60 0.00 0.18 0.00 0.04 95.19 01:23:01 AM 0 2.59 0.00 0.13 0.00 0.03 97.24 01:23:01 AM 1 6.60 0.00 0.22 0.00 0.05 93.13 01:24:01 AM all 4.49 0.00 0.19 0.00 0.04 95.28 01:24:01 AM 0 3.11 0.00 0.18 0.00 0.03 96.67 01:24:01 AM 1 5.86 0.00 0.20 0.00 0.05 93.89 01:25:01 AM all 4.58 0.00 0.21 0.00 0.05 95.16 01:25:01 AM 0 3.13 0.00 0.18 0.00 0.05 96.64 01:25:01 AM 1 6.03 0.00 0.23 0.00 0.05 93.69 01:26:02 AM all 4.67 0.00 0.20 0.00 0.05 95.08 01:26:02 AM 0 3.17 0.00 0.17 0.00 0.05 96.62 01:26:02 AM 1 6.18 0.00 0.23 0.00 0.05 93.54 01:27:01 AM all 4.56 0.00 0.20 0.00 0.03 95.21 01:27:01 AM 0 4.87 0.00 0.20 0.00 0.03 94.89 01:27:01 AM 1 4.26 0.00 0.19 0.00 0.03 95.52 01:28:01 AM all 6.27 0.00 0.25 0.00 0.05 93.43 01:28:01 AM 0 3.65 0.00 0.20 0.00 0.05 96.10 01:28:01 AM 1 8.90 0.00 0.30 0.00 0.05 90.75 01:28:01 AM CPU %user %nice %system %iowait %steal %idle 01:29:01 AM all 0.60 0.00 0.09 0.00 0.03 99.28 01:29:01 AM 0 0.75 0.00 0.08 0.00 0.02 99.15 01:29:01 AM 1 0.45 0.00 0.10 0.00 0.03 99.42 01:30:01 AM all 0.34 0.00 0.07 0.00 0.02 99.57 01:30:01 AM 0 0.10 0.00 0.08 0.00 0.02 99.80 01:30:01 AM 1 0.58 0.00 0.05 0.00 0.02 99.35 01:31:01 AM all 0.52 0.00 0.08 0.00 0.03 99.37 01:31:01 AM 0 0.55 0.00 0.10 0.00 0.03 99.32 01:31:01 AM 1 0.48 0.00 0.07 0.00 0.02 99.43 01:32:01 AM all 0.36 0.00 0.06 0.00 0.02 99.57 01:32:01 AM 0 0.13 0.00 0.07 0.00 0.02 99.78 01:32:01 AM 1 0.58 0.00 0.05 0.00 0.02 99.35 01:33:01 AM all 0.58 0.00 0.08 0.00 0.03 99.31 01:33:01 AM 0 0.37 0.00 0.08 0.00 0.03 99.52 01:33:01 AM 1 0.80 0.00 0.08 0.00 0.02 99.10 01:34:01 AM all 0.36 0.00 0.08 0.00 0.02 99.55 01:34:01 AM 0 0.23 0.00 0.08 0.00 0.02 99.67 01:34:01 AM 1 0.48 0.00 0.07 0.00 0.02 99.43 01:35:01 AM all 1.52 0.00 0.09 0.00 0.03 98.36 01:35:01 AM 0 0.27 0.00 0.10 0.00 0.03 99.60 01:35:01 AM 1 2.77 0.00 0.08 0.00 0.02 97.13 01:36:01 AM all 7.50 0.00 1.07 0.00 0.08 91.35 01:36:01 AM 0 5.12 0.00 0.70 0.00 0.05 94.13 01:36:01 AM 1 9.94 0.00 1.46 0.00 0.11 88.50 01:37:01 AM all 7.49 0.00 0.93 0.00 0.06 91.52 01:37:01 AM 0 8.32 0.00 0.92 0.00 0.07 90.69 01:37:01 AM 1 6.66 0.00 0.95 0.00 0.05 92.34 01:38:01 AM all 1.81 0.00 0.30 0.00 0.04 97.85 01:38:01 AM 0 0.60 0.00 0.12 0.00 0.05 99.23 01:38:01 AM 1 3.04 0.00 0.49 0.00 0.03 96.44 01:39:01 AM all 6.67 0.00 0.76 0.00 0.05 92.52 01:39:01 AM 0 11.38 0.00 1.21 0.00 0.07 87.34 01:39:01 AM 1 2.13 0.00 0.34 0.00 0.03 97.50 01:39:01 AM CPU %user %nice %system %iowait %steal %idle 01:40:01 AM all 7.41 0.00 0.90 0.00 0.06 91.63 01:40:01 AM 0 11.10 0.00 1.41 0.00 0.07 87.42 01:40:01 AM 1 3.87 0.00 0.42 0.00 0.05 95.66 01:41:01 AM all 4.46 0.00 0.18 0.00 0.04 95.31 01:41:01 AM 0 4.11 0.00 0.18 0.00 0.03 95.68 01:41:01 AM 1 4.82 0.00 0.18 0.00 0.05 94.95 01:42:01 AM all 4.52 0.00 0.20 0.01 0.04 95.23 01:42:01 AM 0 5.83 0.00 0.22 0.02 0.05 93.88 01:42:01 AM 1 3.21 0.00 0.18 0.00 0.03 96.57 01:43:01 AM all 4.50 0.00 0.21 0.00 0.04 95.25 01:43:01 AM 0 5.48 0.00 0.23 0.00 0.05 94.24 01:43:01 AM 1 3.53 0.00 0.18 0.00 0.03 96.26 01:44:01 AM all 4.47 0.00 0.20 0.00 0.05 95.28 01:44:01 AM 0 3.35 0.00 0.22 0.00 0.05 96.38 01:44:01 AM 1 5.59 0.00 0.18 0.00 0.05 94.17 01:45:01 AM all 4.61 0.00 0.18 0.00 0.05 95.17 01:45:01 AM 0 4.44 0.00 0.18 0.00 0.05 95.33 01:45:01 AM 1 4.77 0.00 0.17 0.00 0.05 95.01 01:46:01 AM all 4.88 0.00 0.22 0.00 0.05 94.85 01:46:01 AM 0 7.53 0.00 0.27 0.00 0.05 92.15 01:46:01 AM 1 2.24 0.00 0.17 0.00 0.05 97.54 01:47:01 AM all 4.29 0.00 0.20 0.00 0.04 95.47 01:47:01 AM 0 5.18 0.00 0.20 0.00 0.05 94.57 01:47:01 AM 1 3.41 0.00 0.20 0.00 0.03 96.36 01:48:01 AM all 0.31 0.00 0.07 0.00 0.02 99.61 01:48:01 AM 0 0.55 0.00 0.07 0.00 0.02 99.37 01:48:01 AM 1 0.07 0.00 0.07 0.00 0.02 99.85 01:49:01 AM all 0.48 0.00 0.08 0.00 0.02 99.42 01:49:01 AM 0 0.48 0.00 0.08 0.00 0.02 99.41 01:49:01 AM 1 0.48 0.00 0.07 0.00 0.02 99.43 01:50:01 AM all 0.27 0.00 0.06 0.00 0.02 99.66 01:50:01 AM 0 0.49 0.00 0.10 0.00 0.03 99.38 01:50:01 AM 1 0.05 0.00 0.02 0.00 0.00 99.93 01:50:01 AM CPU %user %nice %system %iowait %steal %idle 01:51:01 AM all 0.33 0.00 0.08 0.01 0.02 99.57 01:51:01 AM 0 0.55 0.00 0.05 0.00 0.02 99.38 01:51:01 AM 1 0.10 0.00 0.10 0.02 0.02 99.77 01:52:01 AM all 0.51 0.00 0.09 0.00 0.02 99.38 01:52:01 AM 0 0.58 0.00 0.08 0.00 0.03 99.30 01:52:01 AM 1 0.43 0.00 0.10 0.00 0.00 99.47 01:53:01 AM all 0.35 0.00 0.08 0.00 0.02 99.56 01:53:01 AM 0 0.60 0.00 0.07 0.00 0.02 99.32 01:53:01 AM 1 0.10 0.00 0.08 0.00 0.02 99.80 01:54:01 AM all 5.39 0.00 0.67 0.00 0.04 93.90 01:54:01 AM 0 3.13 0.00 0.46 0.00 0.03 96.38 01:54:01 AM 1 7.68 0.00 0.89 0.00 0.05 91.37 01:55:01 AM all 7.95 0.00 1.04 0.00 0.06 90.95 01:55:01 AM 0 5.58 0.00 0.75 0.00 0.05 93.61 01:55:01 AM 1 10.36 0.00 1.33 0.00 0.07 88.24 01:56:01 AM all 5.88 0.00 0.58 0.00 0.04 93.50 01:56:01 AM 0 7.87 0.00 0.94 0.00 0.05 91.14 01:56:01 AM 1 3.94 0.00 0.22 0.00 0.03 95.81 01:57:01 AM all 4.47 0.00 0.21 0.00 0.18 95.14 01:57:01 AM 0 3.30 0.00 0.18 0.00 0.07 96.45 01:57:01 AM 1 5.64 0.00 0.23 0.00 0.28 93.84 01:58:01 AM all 4.32 0.00 0.19 0.00 0.04 95.44 01:58:01 AM 0 3.43 0.00 0.18 0.00 0.03 96.35 01:58:01 AM 1 5.21 0.00 0.20 0.00 0.05 94.54 01:59:01 AM all 4.42 0.00 0.21 0.00 0.03 95.33 01:59:01 AM 0 2.06 0.00 0.20 0.00 0.03 97.70 01:59:01 AM 1 6.79 0.00 0.22 0.00 0.03 92.96 02:00:01 AM all 4.40 0.00 0.18 0.00 0.05 95.38 02:00:01 AM 0 3.11 0.00 0.17 0.00 0.05 96.67 02:00:01 AM 1 5.68 0.00 0.18 0.00 0.05 94.09 02:01:01 AM all 4.60 0.00 0.21 0.00 0.05 95.14 02:01:01 AM 0 3.08 0.00 0.18 0.00 0.05 96.69 02:01:01 AM 1 6.13 0.00 0.23 0.00 0.05 93.58 02:01:01 AM CPU %user %nice %system %iowait %steal %idle 02:02:01 AM all 6.80 0.00 0.28 0.00 0.04 92.89 02:02:01 AM 0 9.56 0.00 0.30 0.00 0.05 90.08 02:02:01 AM 1 4.03 0.00 0.25 0.00 0.03 95.68 02:03:01 AM all 0.63 0.00 0.10 0.00 0.03 99.25 02:03:01 AM 0 0.67 0.00 0.12 0.00 0.02 99.20 02:03:01 AM 1 0.58 0.00 0.08 0.00 0.03 99.30 02:04:01 AM all 0.32 0.00 0.05 0.00 0.02 99.62 02:04:01 AM 0 0.08 0.00 0.05 0.00 0.02 99.85 02:04:01 AM 1 0.55 0.00 0.05 0.00 0.02 99.38 02:05:01 AM all 0.49 0.00 0.09 0.00 0.02 99.40 02:05:01 AM 0 0.50 0.00 0.10 0.00 0.02 99.38 02:05:01 AM 1 0.48 0.00 0.08 0.00 0.02 99.42 02:06:01 AM all 0.29 0.00 0.05 0.00 0.03 99.63 02:06:01 AM 0 0.12 0.00 0.05 0.00 0.03 99.80 02:06:01 AM 1 0.47 0.00 0.05 0.00 0.02 99.47 02:07:01 AM all 0.36 0.00 0.09 0.00 0.03 99.52 02:07:01 AM 0 0.15 0.00 0.10 0.00 0.02 99.73 02:07:01 AM 1 0.57 0.00 0.08 0.00 0.03 99.32 02:08:01 AM all 0.42 0.00 0.07 0.00 0.03 99.49 02:08:01 AM 0 0.45 0.00 0.10 0.00 0.05 99.40 02:08:01 AM 1 0.38 0.00 0.03 0.00 0.00 99.58 02:09:01 AM all 0.32 0.00 0.06 0.00 0.02 99.61 02:09:01 AM 0 0.59 0.00 0.07 0.00 0.02 99.33 02:09:01 AM 1 0.05 0.00 0.05 0.00 0.02 99.88 02:10:01 AM all 7.15 0.00 0.95 0.00 0.05 91.85 02:10:01 AM 0 0.48 0.00 0.20 0.00 0.03 99.28 02:10:01 AM 1 14.20 0.00 1.73 0.00 0.07 83.99 02:11:01 AM all 7.85 0.00 1.04 0.00 0.05 91.06 02:11:01 AM 0 0.70 0.00 0.23 0.00 0.03 99.03 02:11:01 AM 1 15.52 0.00 1.90 0.00 0.07 82.52 02:12:01 AM all 5.38 0.00 0.28 0.00 0.06 94.28 02:12:01 AM 0 3.45 0.00 0.18 0.00 0.05 96.31 02:12:01 AM 1 7.33 0.00 0.37 0.00 0.07 92.23 02:12:01 AM CPU %user %nice %system %iowait %steal %idle 02:13:01 AM all 4.61 0.00 0.21 0.00 0.04 95.14 02:13:01 AM 0 5.21 0.00 0.25 0.00 0.05 94.49 02:13:01 AM 1 4.02 0.00 0.17 0.00 0.03 95.78 02:14:01 AM all 4.45 0.00 0.17 0.00 0.03 95.34 02:14:01 AM 0 3.63 0.00 0.17 0.00 0.03 96.17 02:14:01 AM 1 5.28 0.00 0.17 0.00 0.03 94.52 02:15:01 AM all 4.47 0.00 0.20 0.00 0.04 95.29 02:15:01 AM 0 1.44 0.00 0.15 0.00 0.03 98.38 02:15:01 AM 1 7.51 0.00 0.25 0.00 0.05 92.19 02:16:01 AM all 4.64 0.00 0.18 0.00 0.05 95.14 02:16:01 AM 0 2.78 0.00 0.17 0.00 0.05 97.01 02:16:01 AM 1 6.50 0.00 0.18 0.00 0.05 93.26 02:17:01 AM all 4.45 0.00 0.18 0.00 0.03 95.33 02:17:01 AM 0 3.57 0.00 0.18 0.00 0.03 96.22 02:17:01 AM 1 5.33 0.00 0.18 0.00 0.03 94.45 02:18:01 AM all 5.89 0.00 0.24 0.00 0.06 93.81 02:18:01 AM 0 7.01 0.00 0.23 0.00 0.07 92.69 02:18:01 AM 1 4.77 0.00 0.25 0.00 0.05 94.93 02:19:01 AM all 0.54 0.00 0.06 0.00 0.02 99.38 02:19:01 AM 0 0.40 0.00 0.03 0.00 0.02 99.55 02:19:01 AM 1 0.68 0.00 0.08 0.00 0.02 99.22 02:20:01 AM all 0.36 0.00 0.08 0.00 0.03 99.54 02:20:01 AM 0 0.50 0.00 0.07 0.00 0.02 99.42 02:20:01 AM 1 0.22 0.00 0.08 0.00 0.03 99.67 02:21:01 AM all 0.54 0.00 0.08 0.00 0.02 99.36 02:21:01 AM 0 0.45 0.00 0.08 0.00 0.02 99.45 02:21:01 AM 1 0.63 0.00 0.08 0.00 0.02 99.27 02:22:01 AM all 0.30 0.00 0.06 0.00 0.02 99.62 02:22:01 AM 0 0.08 0.00 0.03 0.00 0.02 99.87 02:22:01 AM 1 0.52 0.00 0.08 0.00 0.02 99.38 02:23:01 AM all 0.56 0.00 0.10 0.00 0.02 99.32 02:23:01 AM 0 0.54 0.00 0.12 0.00 0.02 99.33 02:23:01 AM 1 0.58 0.00 0.08 0.00 0.02 99.32 02:23:01 AM CPU %user %nice %system %iowait %steal %idle 02:24:01 AM all 0.35 0.00 0.08 0.00 0.02 99.56 02:24:01 AM 0 0.10 0.00 0.08 0.00 0.02 99.80 02:24:01 AM 1 0.60 0.00 0.07 0.00 0.02 99.32 02:25:01 AM all 3.44 0.00 0.30 0.00 0.08 96.18 02:25:01 AM 0 3.51 0.00 0.41 0.00 0.02 96.06 02:25:01 AM 1 3.37 0.00 0.20 0.00 0.13 96.30 02:26:01 AM all 7.88 0.00 1.02 0.00 0.07 91.02 02:26:01 AM 0 8.90 0.00 1.07 0.00 0.09 89.94 02:26:01 AM 1 6.88 0.00 0.98 0.00 0.05 92.09 02:27:01 AM all 6.64 0.00 0.63 0.00 0.07 92.66 02:27:01 AM 0 4.96 0.00 0.49 0.00 0.03 94.51 02:27:01 AM 1 8.34 0.00 0.78 0.00 0.10 90.78 02:28:01 AM all 4.67 0.00 0.21 0.00 0.04 95.07 02:28:01 AM 0 2.48 0.00 0.17 0.00 0.03 97.32 02:28:01 AM 1 6.88 0.00 0.25 0.00 0.05 92.82 02:29:01 AM all 4.56 0.18 0.23 0.01 0.04 94.98 02:29:01 AM 0 2.79 0.02 0.22 0.02 0.05 96.90 02:29:01 AM 1 6.33 0.34 0.25 0.00 0.03 93.05 02:30:01 AM all 4.63 0.00 0.20 0.00 0.04 95.12 02:30:01 AM 0 3.74 0.00 0.20 0.00 0.03 96.03 02:30:01 AM 1 5.53 0.00 0.20 0.00 0.05 94.22 02:31:01 AM all 4.43 0.00 0.23 0.04 0.03 95.27 02:31:01 AM 0 4.13 0.00 0.23 0.08 0.03 95.52 02:31:01 AM 1 4.73 0.00 0.22 0.00 0.03 95.02 02:32:01 AM all 4.48 0.00 0.18 0.00 0.07 95.27 02:32:01 AM 0 2.78 0.00 0.15 0.00 0.07 97.00 02:32:01 AM 1 6.19 0.00 0.22 0.00 0.07 93.53 02:33:01 AM all 6.84 0.00 0.27 0.00 0.04 92.85 02:33:01 AM 0 4.27 0.00 0.25 0.00 0.03 95.45 02:33:01 AM 1 9.43 0.00 0.29 0.00 0.05 90.23 02:34:01 AM all 2.23 0.00 0.13 0.00 0.03 97.61 02:34:01 AM 0 0.82 0.00 0.13 0.00 0.03 99.01 02:34:01 AM 1 3.65 0.00 0.13 0.00 0.02 96.20 02:34:01 AM CPU %user %nice %system %iowait %steal %idle 02:35:01 AM all 0.31 0.00 0.08 0.00 0.02 99.59 02:35:01 AM 0 0.25 0.00 0.10 0.00 0.02 99.63 02:35:01 AM 1 0.36 0.00 0.07 0.00 0.02 99.56 02:36:01 AM all 0.38 0.00 0.08 0.00 0.03 99.52 02:36:01 AM 0 0.37 0.00 0.08 0.00 0.03 99.52 02:36:01 AM 1 0.38 0.00 0.07 0.00 0.02 99.53 02:37:01 AM all 0.54 0.00 0.08 0.00 0.02 99.37 02:37:01 AM 0 0.75 0.00 0.08 0.00 0.02 99.15 02:37:01 AM 1 0.33 0.00 0.07 0.00 0.02 99.58 02:38:01 AM all 0.31 0.00 0.08 0.00 0.03 99.59 02:38:01 AM 0 0.38 0.00 0.10 0.00 0.03 99.48 02:38:01 AM 1 0.23 0.00 0.05 0.00 0.02 99.70 02:39:01 AM all 0.53 0.00 0.08 0.00 0.03 99.37 02:39:01 AM 0 0.57 0.00 0.08 0.00 0.02 99.33 02:39:01 AM 1 0.48 0.00 0.08 0.00 0.03 99.40 02:40:01 AM all 0.33 0.00 0.08 0.00 0.03 99.56 02:40:01 AM 0 0.12 0.00 0.10 0.00 0.03 99.75 02:40:01 AM 1 0.55 0.00 0.07 0.00 0.02 99.37 02:41:01 AM all 5.05 0.00 0.56 0.00 0.04 94.35 02:41:01 AM 0 2.17 0.00 0.18 0.00 0.03 97.61 02:41:01 AM 1 8.03 0.00 0.95 0.00 0.05 90.97 02:42:01 AM all 7.50 0.00 0.81 0.02 0.07 91.61 02:42:01 AM 0 3.88 0.00 0.37 0.03 0.05 95.67 02:42:01 AM 1 11.26 0.00 1.27 0.00 0.09 87.39 02:43:01 AM all 7.65 0.00 0.82 0.00 0.07 91.47 02:43:01 AM 0 6.17 0.00 0.67 0.00 0.05 93.11 02:43:01 AM 1 9.14 0.00 0.97 0.00 0.09 89.80 02:44:01 AM all 7.66 0.00 0.89 0.00 0.07 91.38 02:44:01 AM 0 9.98 0.00 1.06 0.00 0.07 88.90 02:44:01 AM 1 5.37 0.00 0.72 0.00 0.07 93.84 02:45:01 AM all 7.53 0.00 0.92 0.00 0.07 91.49 02:45:01 AM 0 2.54 0.00 0.42 0.00 0.07 96.97 02:45:01 AM 1 12.79 0.00 1.44 0.00 0.07 85.70 02:45:01 AM CPU %user %nice %system %iowait %steal %idle 02:46:01 AM all 8.41 0.00 1.04 0.00 0.08 90.47 02:46:01 AM 0 3.13 0.00 0.58 0.00 0.07 96.23 02:46:01 AM 1 13.94 0.00 1.52 0.00 0.09 84.45 02:47:01 AM all 7.74 0.00 0.98 0.00 0.08 91.20 02:47:01 AM 0 7.78 0.00 1.16 0.00 0.09 90.97 02:47:01 AM 1 7.70 0.00 0.81 0.00 0.07 91.43 02:48:01 AM all 8.05 0.00 1.04 0.00 0.06 90.84 02:48:01 AM 0 0.84 0.00 0.25 0.00 0.03 98.88 02:48:01 AM 1 15.70 0.00 1.88 0.00 0.09 82.34 02:49:01 AM all 25.81 0.00 2.08 0.61 0.08 71.42 02:49:01 AM 0 17.19 0.00 1.67 0.62 0.08 80.43 02:49:01 AM 1 34.52 0.00 2.50 0.61 0.07 62.30 02:50:01 AM all 29.53 0.00 2.84 2.15 0.08 65.40 02:50:01 AM 0 18.37 0.00 2.87 1.07 0.07 77.62 02:50:01 AM 1 40.73 0.00 2.81 3.23 0.10 53.14 Average: all 4.07 0.00 0.38 0.02 0.04 95.50 Average: 0 3.22 0.00 0.33 0.01 0.04 96.40 Average: 1 4.92 0.00 0.43 0.02 0.04 94.59