Started by upstream project "integration-distribution-mri-test-calcium" build number 23 originally caused by: Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on prd-centos8-robot-2c-8g-7626 (centos8-robot-2c-8g) in workspace /w/workspace/controller-csit-3node-clustering-ask-all-calcium [ssh-agent] Looking for ssh-agent implementation... [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) $ ssh-agent SSH_AUTH_SOCK=/tmp/ssh-elOkLjgZG4ST/agent.5335 SSH_AGENT_PID=5336 [ssh-agent] Started. Running ssh-add (command line suppressed) Identity added: /w/workspace/controller-csit-3node-clustering-ask-all-calcium@tmp/private_key_15971896985012635426.key (/w/workspace/controller-csit-3node-clustering-ask-all-calcium@tmp/private_key_15971896985012635426.key) [ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key) The recommended git tool is: NONE using credential opendaylight-jenkins-ssh Wiping out workspace first. Cloning the remote Git repository Cloning repository git://devvexx.opendaylight.org/mirror/integration/test > git init /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test > git --version # timeout=10 > git --version # 'git version 2.43.0' using GIT_SSH to set credentials Release Engineering Jenkins Key [INFO] Currently running in a labeled security context [INFO] Currently SELinux is 'enforcing' on the host > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test@tmp/jenkins-gitclient-ssh11221891481368624520.key Verifying host key using known hosts file You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test using GIT_SSH to set credentials Release Engineering Jenkins Key [INFO] Currently running in a labeled security context [INFO] Currently SELinux is 'enforcing' on the host > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test@tmp/jenkins-gitclient-ssh4664336840905569190.key Verifying host key using known hosts file You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10 > git rev-parse FETCH_HEAD^{commit} # timeout=10 Checking out Revision bf53c6c85bb53ee48269e4cd22453d3963aae90e (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bf53c6c85bb53ee48269e4cd22453d3963aae90e # timeout=10 Commit message: "Remove code for capwap" > git rev-parse FETCH_HEAD^{commit} # timeout=10 > git rev-list --no-walk c35e89803a9c5593d19215b87da3e305c8293142 # timeout=10 No emails were triggered. provisioning config files... copy managed file [npmrc] to file:/home/jenkins/.npmrc copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins7806950011999190939.sh ---> python-tools-install.sh Setup pyenv: system * 3.8.13 (set by /opt/pyenv/version) * 3.9.13 (set by /opt/pyenv/version) * 3.10.6 (set by /opt/pyenv/version) lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-9zTA lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-9zTA/bin to PATH Generating Requirements File Python 3.10.6 pip 24.0 from /tmp/venv-9zTA/lib/python3.10/site-packages/pip (python 3.10) appdirs==1.4.4 argcomplete==3.2.2 aspy.yaml==1.3.0 attrs==23.2.0 autopage==0.5.2 beautifulsoup4==4.12.3 boto3==1.34.44 botocore==1.34.44 bs4==0.0.2 cachetools==5.3.2 certifi==2024.2.2 cffi==1.16.0 cfgv==3.4.0 chardet==5.2.0 charset-normalizer==3.3.2 click==8.1.7 cliff==4.5.0 cmd2==2.4.3 cryptography==3.3.2 debtcollector==2.5.0 decorator==5.1.1 defusedxml==0.7.1 Deprecated==1.2.14 distlib==0.3.8 dnspython==2.6.0 docker==4.2.2 dogpile.cache==1.3.1 email-validator==2.1.0.post1 filelock==3.13.1 future==0.18.3 gitdb==4.0.11 GitPython==3.1.42 google-auth==2.28.0 httplib2==0.22.0 identify==2.5.34 idna==3.6 importlib-resources==1.5.0 iso8601==2.1.0 Jinja2==3.1.3 jmespath==1.0.1 jsonpatch==1.33 jsonpointer==2.4 jsonschema==4.21.1 jsonschema-specifications==2023.12.1 keystoneauth1==5.5.0 kubernetes==29.0.0 lftools==0.37.8 lxml==5.1.0 MarkupSafe==2.1.5 msgpack==1.0.7 multi_key_dict==2.0.3 munch==4.0.0 netaddr==1.2.1 netifaces==0.11.0 niet==1.4.2 nodeenv==1.8.0 oauth2client==4.1.3 oauthlib==3.2.2 openstacksdk==0.62.0 os-client-config==2.1.0 os-service-types==1.7.0 osc-lib==3.0.0 oslo.config==9.3.0 oslo.context==5.3.0 oslo.i18n==6.2.0 oslo.log==5.4.0 oslo.serialization==5.3.0 oslo.utils==7.0.0 packaging==23.2 pbr==6.0.0 platformdirs==4.2.0 prettytable==3.9.0 pyasn1==0.5.1 pyasn1-modules==0.3.0 pycparser==2.21 pygerrit2==2.0.15 PyGithub==2.2.0 pyinotify==0.9.6 PyJWT==2.8.0 PyNaCl==1.5.0 pyparsing==2.4.7 pyperclip==1.8.2 pyrsistent==0.20.0 python-cinderclient==9.4.0 python-dateutil==2.8.2 python-heatclient==3.4.0 python-jenkins==1.8.2 python-keystoneclient==5.3.0 python-magnumclient==4.3.0 python-novaclient==18.4.0 python-openstackclient==6.0.1 python-swiftclient==4.4.0 pytz==2024.1 PyYAML==6.0.1 referencing==0.33.0 requests==2.31.0 requests-oauthlib==1.3.1 requestsexceptions==1.4.0 rfc3986==2.0.0 rpds-py==0.18.0 rsa==4.9 ruamel.yaml==0.18.6 ruamel.yaml.clib==0.2.8 s3transfer==0.10.0 simplejson==3.19.2 six==1.16.0 smmap==5.0.1 soupsieve==2.5 stevedore==5.1.0 tabulate==0.9.0 toml==0.10.2 tomlkit==0.12.3 tqdm==4.66.2 typing_extensions==4.9.0 tzdata==2024.1 urllib3==1.26.18 virtualenv==20.25.0 wcwidth==0.2.13 websocket-client==1.7.0 wrapt==1.16.0 xdg==6.0.0 xmltodict==0.13.0 yq==3.2.3 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_STACK_TEMPLATE=csit-2-instance-type.yaml OS_CLOUD=vex OS_STACK_NAME=releng-controller-csit-3node-clustering-ask-all-calcium-23 OS_STACK_TEMPLATE_DIR=openstack-hot [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins11069317975422036242.sh ---> Create parameters file for OpenStack HOT OpenStack Heat parameters generated ----------------------------------- parameters: vm_0_count: '3' vm_0_flavor: 'v3-standard-4' vm_0_image: 'ZZCI - CentOS Stream 8 - builder - x86_64 - 20240117-011746.201' vm_1_count: '0' vm_1_flavor: 'v3-standard-2' vm_1_image: 'ZZCI - Ubuntu 18.04 - mininet-ovs-28 - x86_64 - 20230601-180106.003' job_name: '37733-23' silo: 'releng' [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash -l /tmp/jenkins4472090590284938129.sh ---> Create HEAT stack + source /home/jenkins/lf-env.sh + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ++ mktemp -d /tmp/venv-XXXX + lf_venv=/tmp/venv-kiis + local venv_file=/tmp/.os_lf_venv + local python=python3 + local options + local set_path=true + local install_args= ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\''' + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\''' ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + true + case $1 in + python=python3 + shift 2 + true + case $1 in + shift + break + case $python in + local pkg_list= + [[ -d /opt/pyenv ]] + echo 'Setup pyenv:' Setup pyenv: + export PYENV_ROOT=/opt/pyenv + PYENV_ROOT=/opt/pyenv + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + pyenv versions system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version) + command -v pyenv ++ pyenv init - --no-rehash + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "'\''/opt/pyenv/shims'\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; fi; done; echo "${paths[*]}"'\'')" export PATH="/opt/pyenv/shims:${PATH}" export PYENV_SHELL=bash source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\'' pyenv() { local command command="${1:-}" if [ "$#" -gt 0 ]; then shift fi case "$command" in rehash|shell) eval "$(pyenv "sh-$command" "$@")" ;; *) command pyenv "$command" "$@" ;; esac }' +++ bash --norc -ec 'IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; fi; done; echo "${paths[*]}"' ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ export PYENV_SHELL=bash ++ PYENV_SHELL=bash ++ source /opt/pyenv/libexec/../completions/pyenv.bash +++ complete -F _pyenv pyenv ++ lf-pyver python3 ++ local py_version_xy=python3 ++ local py_version_xyz= ++ pyenv versions ++ local command ++ command=versions ++ '[' 1 -gt 0 ']' ++ shift ++ case "$command" in ++ command pyenv versions ++ pyenv versions ++ sed 's/^[ *]* //' ++ awk '{ print $1 }' ++ grep -E '^[0-9.]*[0-9]$' ++ [[ ! -s /tmp/.pyenv_versions ]] +++ tail -n 1 +++ grep '^3' /tmp/.pyenv_versions +++ sort -V ++ py_version_xyz=3.10.6 ++ [[ -z 3.10.6 ]] ++ echo 3.10.6 ++ return 0 + pyenv local 3.10.6 + local command + command=local + '[' 2 -gt 0 ']' + shift + case "$command" in + command pyenv local 3.10.6 + pyenv local 3.10.6 + for arg in "$@" + case $arg in + pkg_list+='lftools[openstack] ' + for arg in "$@" + case $arg in + pkg_list+='kubernetes ' + for arg in "$@" + case $arg in + pkg_list+='niet ' + for arg in "$@" + case $arg in + pkg_list+='python-heatclient ' + for arg in "$@" + case $arg in + pkg_list+='python-openstackclient ' + for arg in "$@" + case $arg in + pkg_list+='python-magnumclient ' + for arg in "$@" + case $arg in + pkg_list+='yq ' + [[ -f /tmp/.os_lf_venv ]] ++ cat /tmp/.os_lf_venv + lf_venv=/tmp/venv-9zTA + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-9zTA from' file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Reuse venv:/tmp/venv-9zTA from file:/tmp/.os_lf_venv + /tmp/venv-9zTA/bin/python3 -m pip install --upgrade --quiet pip virtualenv + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ]] + echo 'lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ' lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + /tmp/venv-9zTA/bin/python3 -m pip install --upgrade --quiet --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + type python3 + true + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-9zTA/bin to PATH' lf-activate-venv(): INFO: Adding /tmp/venv-9zTA/bin to PATH + PATH=/tmp/venv-9zTA/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + return 0 + openstack --os-cloud vex limits show --absolute +--------------------------+---------+ | Name | Value | +--------------------------+---------+ | maxTotalInstances | -1 | | maxTotalCores | 450 | | maxTotalRAMSize | 1000000 | | maxServerMeta | 128 | | maxImageMeta | 128 | | maxPersonality | 5 | | maxPersonalitySize | 10240 | | maxTotalKeypairs | 100 | | maxServerGroups | 10 | | maxServerGroupMembers | 10 | | maxTotalFloatingIps | -1 | | maxSecurityGroups | -1 | | maxSecurityGroupRules | -1 | | totalRAMUsed | 622592 | | totalCoresUsed | 152 | | totalInstancesUsed | 48 | | totalFloatingIpsUsed | 0 | | totalSecurityGroupsUsed | 0 | | totalServerGroupsUsed | 0 | | maxTotalVolumes | -1 | | maxTotalSnapshots | 10 | | maxTotalVolumeGigabytes | 4096 | | maxTotalBackups | 10 | | maxTotalBackupGigabytes | 1000 | | totalVolumesUsed | 0 | | totalGigabytesUsed | 0 | | totalSnapshotsUsed | 0 | | totalBackupsUsed | 0 | | totalBackupGigabytesUsed | 0 | +--------------------------+---------+ + pushd /opt/ciman/openstack-hot /opt/ciman/openstack-hot /w/workspace/controller-csit-3node-clustering-ask-all-calcium + lftools openstack --os-cloud vex stack create releng-controller-csit-3node-clustering-ask-all-calcium-23 csit-2-instance-type.yaml /w/workspace/controller-csit-3node-clustering-ask-all-calcium/stack-parameters.yaml Creating stack releng-controller-csit-3node-clustering-ask-all-calcium-23 Waiting to initialize infrastructure... Stack initialization successful. ------------------------------------ Stack Details ------------------------------------ {'added': None, 'capabilities': [], 'created_at': '2024-02-17T23:41:40Z', 'deleted': None, 'deleted_at': None, 'description': 'No description', 'environment': None, 'environment_files': None, 'files': None, 'files_container': None, 'id': '5845e86e-0763-411f-a0c0-e040f494018a', 'is_rollback_disabled': True, 'links': [{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-controller-csit-3node-clustering-ask-all-calcium-23/5845e86e-0763-411f-a0c0-e040f494018a', 'rel': 'self'}], 'location': Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}), 'name': 'releng-controller-csit-3node-clustering-ask-all-calcium-23', 'notification_topics': [], 'outputs': [{'description': 'IP addresses of the 1st vm types', 'output_key': 'vm_0_ips', 'output_value': ['10.30.171.227', '10.30.171.218', '10.30.170.189']}, {'description': 'IP addresses of the 2nd vm types', 'output_key': 'vm_1_ips', 'output_value': []}], 'owner_id': ****, 'parameters': {'OS::project_id': '12c36e260d8e4bb2913965203b1b491f', 'OS::stack_id': '5845e86e-0763-411f-a0c0-e040f494018a', 'OS::stack_name': 'releng-controller-csit-3node-clustering-ask-all-calcium-23', 'job_name': '37733-23', 'silo': 'releng', 'vm_0_count': '3', 'vm_0_flavor': 'v3-standard-4', 'vm_0_image': 'ZZCI - CentOS Stream 8 - builder - x86_64 - ' '20240117-011746.201', 'vm_1_count': '0', 'vm_1_flavor': 'v3-standard-2', 'vm_1_image': 'ZZCI - Ubuntu 18.04 - mininet-ovs-28 - x86_64 - ' '20230601-180106.003'}, 'parent_id': None, 'replaced': None, 'status': 'CREATE_COMPLETE', 'status_reason': 'Stack CREATE completed successfully', 'tags': [], 'template': None, 'template_description': 'No description', 'template_url': None, 'timeout_mins': 15, 'unchanged': None, 'updated': None, 'updated_at': None, 'user_project_id': 'df052d05f0594c76897f5e931b73ba6a'} ------------------------------------ + popd /w/workspace/controller-csit-3node-clustering-ask-all-calcium [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash -l /tmp/jenkins12907708835880610828.sh ---> Copy SSH public keys to CSIT lab Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-9zTA from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient lf-activate-venv(): INFO: Adding /tmp/venv-9zTA/bin to PATH SSH not responding on 10.30.171.218. Retrying in 10 seconds... SSH not responding on 10.30.170.189. Retrying in 10 seconds... SSH not responding on 10.30.171.227. Retrying in 10 seconds... Ping to 10.30.171.218 successful. Ping to 10.30.170.189 successful. Ping to 10.30.171.227 successful. SSH not responding on 10.30.171.218. Retrying in 10 seconds... SSH not responding on 10.30.170.189. Retrying in 10 seconds... SSH not responding on 10.30.171.227. Retrying in 10 seconds... Ping to 10.30.171.218 successful. Ping to 10.30.171.227 successful. Ping to 10.30.170.189 successful. SSH not responding on 10.30.171.218. Retrying in 10 seconds... Warning: Permanently added '10.30.170.189' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.227' (ECDSA) to the list of known hosts. 10.30.170.189 releng-37733-23-0-builder-2.novalocal Successfully copied public keys to slave 10.30.170.189 10.30.171.227 releng-37733-23-0-builder-0.novalocal Successfully copied public keys to slave 10.30.171.227 Process 6478 ready. Ping to 10.30.171.218 successful. SSH not responding on 10.30.171.218. Retrying in 10 seconds... Ping to 10.30.171.218 successful. Warning: Permanently added '10.30.171.218' (ECDSA) to the list of known hosts. 10.30.171.218 releng-37733-23-0-builder-1.novalocal Successfully copied public keys to slave 10.30.171.218 Process 6479 ready. Process 6480 ready. SSH ready on all stack servers. [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash -l /tmp/jenkins12955921434176553791.sh Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version) lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-Y9qC lf-activate-venv(): INFO: Save venv in file: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.robot_venv lf-activate-venv(): INFO: Installing: setuptools wheel lf-activate-venv(): INFO: Adding /tmp/venv-Y9qC/bin to PATH + echo 'Installing Python Requirements' Installing Python Requirements + cat + python -m pip install -r requirements.txt Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple Collecting docker-py (from -r requirements.txt (line 1)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-py/1.10.6/docker_py-1.10.6-py2.py3-none-any.whl (50 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50.0/50.0 kB 8.7 MB/s eta 0:00:00 Collecting ipaddr (from -r requirements.txt (line 2)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ipaddr/2.2.0/ipaddr-2.2.0.tar.gz (26 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting netaddr (from -r requirements.txt (line 3)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/netaddr/1.2.1/netaddr-1.2.1-py3-none-any.whl (2.3 MB) Collecting netifaces (from -r requirements.txt (line 4)) Using cached netifaces-0.11.0-cp310-cp310-linux_x86_64.whl Collecting pyhocon (from -r requirements.txt (line 5)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyhocon/0.3.60/pyhocon-0.3.60.tar.gz (158 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 158.8/158.8 kB 16.4 MB/s eta 0:00:00 Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting requests (from -r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/requests/2.31.0/requests-2.31.0-py3-none-any.whl (62 kB) Collecting robotframework (from -r requirements.txt (line 7)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework/7.0/robotframework-7.0-py3-none-any.whl (726 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 726.3/726.3 kB 19.4 MB/s eta 0:00:00 Collecting robotframework-httplibrary (from -r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-httplibrary/0.4.2/robotframework-httplibrary-0.4.2.tar.gz (9.1 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting robotframework-requests==0.9.3 (from -r requirements.txt (line 9)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-requests/0.9.3/robotframework_requests-0.9.3-py3-none-any.whl (21 kB) Collecting robotframework-selenium2library (from -r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-selenium2library/3.0.0/robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB) Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-sshlibrary/3.8.0/robotframework-sshlibrary-3.8.0.tar.gz (51 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 51.4/51.4 kB 5.8 MB/s eta 0:00:00 Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting scapy (from -r requirements.txt (line 12)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scapy/2.5.0/scapy-2.5.0.tar.gz (1.3 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 33.8 MB/s eta 0:00:00 Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting jsonpath-rw (from -r requirements.txt (line 15)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpath-rw/1.4.0/jsonpath-rw-1.4.0.tar.gz (13 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting elasticsearch (from -r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/8.12.0/elasticsearch-8.12.0-py3-none-any.whl (431 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 431.9/431.9 kB 29.3 MB/s eta 0:00:00 Collecting elasticsearch-dsl (from -r requirements.txt (line 19)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.12.0/elasticsearch_dsl-8.12.0-py3-none-any.whl (63 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64.0/64.0 kB 14.4 MB/s eta 0:00:00 Collecting pyangbind (from -r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyangbind/0.8.4.post1/pyangbind-0.8.4.post1-py3-none-any.whl (52 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 52.8/52.8 kB 5.4 MB/s eta 0:00:00 Collecting isodate (from -r requirements.txt (line 25)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/isodate/0.6.1/isodate-0.6.1-py2.py3-none-any.whl (41 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 41.7/41.7 kB 5.1 MB/s eta 0:00:00 Collecting jmespath (from -r requirements.txt (line 28)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jmespath/1.0.1/jmespath-1.0.1-py3-none-any.whl (20 kB) Collecting jsonpatch (from -r requirements.txt (line 31)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpatch/1.33/jsonpatch-1.33-py2.py3-none-any.whl (12 kB) Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/paramiko/3.4.0/paramiko-3.4.0-py3-none-any.whl (225 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 225.9/225.9 kB 28.1 MB/s eta 0:00:00 Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scp/0.14.5/scp-0.14.5-py2.py3-none-any.whl (8.7 kB) Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-pycreds/0.4.0/docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB) Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/six/1.16.0/six-1.16.0-py2.py3-none-any.whl (11 kB) Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/websocket-client/1.7.0/websocket_client-1.7.0-py3-none-any.whl (58 kB) Collecting pyparsing<4,>=2 (from pyhocon->-r requirements.txt (line 5)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pyparsing/3.1.1/pyparsing-3.1.1-py3-none-any.whl (103 kB) Collecting charset-normalizer<4,>=2 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/charset-normalizer/3.3.2/charset_normalizer-3.3.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (142 kB) Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/idna/3.6/idna-3.6-py3-none-any.whl (61 kB) Collecting urllib3<3,>=1.21.1 (from requests->-r requirements.txt (line 6)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.2.0/urllib3-2.2.0-py3-none-any.whl (120 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 120.9/120.9 kB 14.6 MB/s eta 0:00:00 Collecting certifi>=2017.4.17 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/certifi/2024.2.2/certifi-2024.2.2-py3-none-any.whl (163 kB) Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webtest/3.0.0/WebTest-3.0.0-py3-none-any.whl (31 kB) Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpointer/2.4/jsonpointer-2.4-py2.py3-none-any.whl (7.8 kB) Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-seleniumlibrary/6.2.0/robotframework_seleniumlibrary-6.2.0-py2.py3-none-any.whl (95 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 95.5/95.5 kB 8.1 MB/s eta 0:00:00 Collecting ply (from jsonpath-rw->-r requirements.txt (line 15)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ply/3.11/ply-3.11-py2.py3-none-any.whl (49 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49.6/49.6 kB 6.3 MB/s eta 0:00:00 Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/decorator/5.1.1/decorator-5.1.1-py3-none-any.whl (9.1 kB) Collecting elastic-transport<9,>=8 (from elasticsearch->-r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/8.12.0/elastic_transport-8.12.0-py3-none-any.whl (59 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 59.9/59.9 kB 14.8 MB/s eta 0:00:00 Collecting python-dateutil (from elasticsearch-dsl->-r requirements.txt (line 19)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/python-dateutil/2.8.2/python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB) Collecting pyang (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyang/2.6.0/pyang-2.6.0-py2.py3-none-any.whl (594 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 594.1/594.1 kB 19.5 MB/s eta 0:00:00 Collecting lxml (from pyangbind->-r requirements.txt (line 22)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/lxml/5.1.0/lxml-5.1.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (8.0 MB) Collecting regex (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/regex/2023.12.25/regex-2023.12.25-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (773 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 774.0/774.0 kB 48.8 MB/s eta 0:00:00 Collecting enum34 (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/enum34/1.1.10/enum34-1.1.10-py3-none-any.whl (11 kB) Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/bcrypt/4.1.2/bcrypt-4.1.2-cp39-abi3-manylinux_2_28_x86_64.whl (698 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 698.9/698.9 kB 41.9 MB/s eta 0:00:00 Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cryptography/42.0.3/cryptography-42.0.3-cp39-abi3-manylinux_2_28_x86_64.whl (4.6 MB) Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pynacl/1.5.0/PyNaCl-1.5.0-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl (856 kB) Collecting selenium>=4.3.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/selenium/4.17.2/selenium-4.17.2-py3-none-any.whl (9.9 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9.9/9.9 MB 6.3 MB/s eta 0:00:00 Collecting robotframework-pythonlibcore>=3.0.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-pythonlibcore/4.3.0/robotframework_pythonlibcore-4.3.0-py2.py3-none-any.whl (10 kB) Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webob/1.8.7/WebOb-1.8.7-py2.py3-none-any.whl (114 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 115.0/115.0 kB 24.9 MB/s eta 0:00:00 Collecting waitress>=0.8.5 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/waitress/3.0.0/waitress-3.0.0-py3-none-any.whl (56 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.7/56.7 kB 13.1 MB/s eta 0:00:00 Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/beautifulsoup4/4.12.3/beautifulsoup4-4.12.3-py3-none-any.whl (147 kB) Collecting cffi>=1.12 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cffi/1.16.0/cffi-1.16.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (443 kB) Collecting trio~=0.17 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio/0.24.0/trio-0.24.0-py3-none-any.whl (460 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 460.2/460.2 kB 16.8 MB/s eta 0:00:00 Collecting trio-websocket~=0.9 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-websocket/0.11.1/trio_websocket-0.11.1-py3-none-any.whl (17 kB) Collecting typing_extensions>=4.9.0 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/typing-extensions/4.9.0/typing_extensions-4.9.0-py3-none-any.whl (32 kB) Collecting soupsieve>1.2 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/soupsieve/2.5/soupsieve-2.5-py3-none-any.whl (36 kB) Collecting pycparser (from cffi>=1.12->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pycparser/2.21/pycparser-2.21-py2.py3-none-any.whl (118 kB) Collecting attrs>=20.1.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/attrs/23.2.0/attrs-23.2.0-py3-none-any.whl (60 kB) Collecting sortedcontainers (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sortedcontainers/2.4.0/sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB) Collecting outcome (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/outcome/1.3.0.post0/outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB) Collecting sniffio>=1.3.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sniffio/1.3.0/sniffio-1.3.0-py3-none-any.whl (10 kB) Collecting exceptiongroup (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/exceptiongroup/1.2.0/exceptiongroup-1.2.0-py3-none-any.whl (16 kB) Collecting wsproto>=0.14 (from trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/wsproto/1.2.0/wsproto-1.2.0-py3-none-any.whl (24 kB) Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]<3,>=1.26->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pysocks/1.7.1/PySocks-1.7.1-py3-none-any.whl (16 kB) Collecting h11<1,>=0.9.0 (from wsproto>=0.14->trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/h11/0.14.0/h11-0.14.0-py3-none-any.whl (58 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58.3/58.3 kB 9.6 MB/s eta 0:00:00 Building wheels for collected packages: robotframework-sshlibrary, ipaddr, pyhocon, robotframework-httplibrary, scapy, jsonpath-rw Building wheel for robotframework-sshlibrary (setup.py): started Building wheel for robotframework-sshlibrary (setup.py): finished with status 'done' Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55116 sha256=4710229cc6d4923e5234a6943d9c61f93b9c2530254e580134760c61c6874fc4 Stored in directory: /home/jenkins/.cache/pip/wheels/4f/7c/b3/1dfc58277260e643335754e93ea5854bc7ba3d181575a9cea9 Building wheel for ipaddr (setup.py): started Building wheel for ipaddr (setup.py): finished with status 'done' Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18282 sha256=fb454d6e10b2c1d50ec14b424b77d78c1a3dfb23d7c43c043afc69141b357c61 Stored in directory: /home/jenkins/.cache/pip/wheels/b5/7c/08/e4a91c0b38d5ae5fea76fbb9b60ce1b5f5f8d6e69cbe801870 Building wheel for pyhocon (setup.py): started Building wheel for pyhocon (setup.py): finished with status 'done' Created wheel for pyhocon: filename=pyhocon-0.3.60-py3-none-any.whl size=20864 sha256=b64b2bfbd702894be59e2dd4241ef3e6ec27908f72c4dd7000d4e0b2262a43c8 Stored in directory: /home/jenkins/.cache/pip/wheels/7e/3f/4f/66e113a4b8eca7d8ff120a7fcfb53be15fc5078eb353482440 Building wheel for robotframework-httplibrary (setup.py): started Building wheel for robotframework-httplibrary (setup.py): finished with status 'done' Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=9954 sha256=c3206d60324a3d06e6314ec89838e42e073035c189f65d032b9c9acdf6b87bf3 Stored in directory: /home/jenkins/.cache/pip/wheels/2e/b8/87/b9b31f375281dd80f51ca94affc6e39f3e45d192e1e1f95553 Building wheel for scapy (setup.py): started Building wheel for scapy (setup.py): finished with status 'done' Created wheel for scapy: filename=scapy-2.5.0-py2.py3-none-any.whl size=1444328 sha256=1b520b52ad7c6bdc58c318542b2562095793ca781f7214c03f7f8618c5fa0250 Stored in directory: /home/jenkins/.cache/pip/wheels/8e/0a/14/42ef36f95fd1fbf75090db30f0cbb4ad4186b84b7a3d10dfcb Building wheel for jsonpath-rw (setup.py): started Building wheel for jsonpath-rw (setup.py): finished with status 'done' Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15127 sha256=6a081f29d0ac2d50d08cfe9e07a1626470459bc24774a086d2aa9b7468d2a16c Stored in directory: /home/jenkins/.cache/pip/wheels/22/71/20/0f098fcfc9905114ba8ed62f4b7f9b66ef9a017f99d918fc12 Successfully built robotframework-sshlibrary ipaddr pyhocon robotframework-httplibrary scapy jsonpath-rw Installing collected packages: sortedcontainers, ply, netifaces, ipaddr, enum34, websocket-client, WebOb, waitress, urllib3, typing_extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, netaddr, lxml, jsonpointer, jmespath, idna, h11, exceptiongroup, decorator, charset-normalizer, certifi, bcrypt, attrs, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, isodate, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library Successfully installed WebOb-1.8.7 attrs-23.2.0 bcrypt-4.1.2 beautifulsoup4-4.12.3 certifi-2024.2.2 cffi-1.16.0 charset-normalizer-3.3.2 cryptography-42.0.3 decorator-5.1.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.12.0 elasticsearch-8.12.0 elasticsearch-dsl-8.12.0 enum34-1.1.10 exceptiongroup-1.2.0 h11-0.14.0 idna-3.6 ipaddr-2.2.0 isodate-0.6.1 jmespath-1.0.1 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-2.4 lxml-5.1.0 netaddr-1.2.1 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-3.4.0 ply-3.11 pyang-2.6.0 pyangbind-0.8.4.post1 pycparser-2.21 pyhocon-0.3.60 pynacl-1.5.0 pyparsing-3.1.1 pysocks-1.7.1 python-dateutil-2.8.2 regex-2023.12.25 requests-2.31.0 robotframework-7.0 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.3.0 robotframework-requests-0.9.3 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.2.0 robotframework-sshlibrary-3.8.0 scapy-2.5.0 scp-0.14.5 selenium-4.17.2 six-1.16.0 sniffio-1.3.0 sortedcontainers-2.4.0 soupsieve-2.5 trio-0.24.0 trio-websocket-0.11.1 typing_extensions-4.9.0 urllib3-2.2.0 waitress-3.0.0 websocket-client-1.7.0 webtest-3.0.0 wsproto-1.2.0 + pip freeze attrs==23.2.0 bcrypt==4.1.2 beautifulsoup4==4.12.3 certifi==2024.2.2 cffi==1.16.0 charset-normalizer==3.3.2 cryptography==42.0.3 decorator==5.1.1 distlib==0.3.8 docker-py==1.10.6 docker-pycreds==0.4.0 elastic-transport==8.12.0 elasticsearch==8.12.0 elasticsearch-dsl==8.12.0 enum34==1.1.10 exceptiongroup==1.2.0 filelock==3.13.1 h11==0.14.0 idna==3.6 ipaddr==2.2.0 isodate==0.6.1 jmespath==1.0.1 jsonpatch==1.33 jsonpath-rw==1.4.0 jsonpointer==2.4 lxml==5.1.0 netaddr==1.2.1 netifaces==0.11.0 outcome==1.3.0.post0 paramiko==3.4.0 platformdirs==4.2.0 ply==3.11 pyang==2.6.0 pyangbind==0.8.4.post1 pycparser==2.21 pyhocon==0.3.60 PyNaCl==1.5.0 pyparsing==3.1.1 PySocks==1.7.1 python-dateutil==2.8.2 regex==2023.12.25 requests==2.31.0 robotframework==7.0 robotframework-httplibrary==0.4.2 robotframework-pythonlibcore==4.3.0 robotframework-requests==0.9.3 robotframework-selenium2library==3.0.0 robotframework-seleniumlibrary==6.2.0 robotframework-sshlibrary==3.8.0 scapy==2.5.0 scp==0.14.5 selenium==4.17.2 six==1.16.0 sniffio==1.3.0 sortedcontainers==2.4.0 soupsieve==2.5 trio==0.24.0 trio-websocket==0.11.1 typing_extensions==4.9.0 urllib3==2.2.0 virtualenv==20.25.0 waitress==3.0.0 WebOb==1.8.7 websocket-client==1.7.0 WebTest==3.0.0 wsproto==1.2.0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'env.properties' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash -l /tmp/jenkins12610730439572677430.sh Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-9zTA from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient yq ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. botocore 1.34.44 requires urllib3<2.1,>=1.25.4; python_version >= "3.10", but you have urllib3 2.2.0 which is incompatible. lftools 0.37.8 requires openstacksdk<1.5.0, but you have openstacksdk 2.1.0 which is incompatible. lftools 0.37.8 requires urllib3<2.0.0, but you have urllib3 2.2.0 which is incompatible. lf-activate-venv(): INFO: Adding /tmp/venv-9zTA/bin to PATH + ODL_SYSTEM=() + TOOLS_SYSTEM=() + OPENSTACK_SYSTEM=() + OPENSTACK_CONTROLLERS=() + mapfile -t ADDR ++ openstack stack show -f json -c outputs releng-controller-csit-3node-clustering-ask-all-calcium-23 ++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]' + for i in "${ADDR[@]}" ++ ssh 10.30.171.227 hostname -s Warning: Permanently added '10.30.171.227' (ECDSA) to the list of known hosts. + REMHOST=releng-37733-23-0-builder-0 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + for i in "${ADDR[@]}" ++ ssh 10.30.171.218 hostname -s Warning: Permanently added '10.30.171.218' (ECDSA) to the list of known hosts. + REMHOST=releng-37733-23-0-builder-1 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + for i in "${ADDR[@]}" ++ ssh 10.30.170.189 hostname -s Warning: Permanently added '10.30.170.189' (ECDSA) to the list of known hosts. + REMHOST=releng-37733-23-0-builder-2 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + echo NUM_ODL_SYSTEM=3 + echo NUM_TOOLS_SYSTEM=0 + '[' '' == yes ']' + NUM_OPENSTACK_SYSTEM=0 + echo NUM_OPENSTACK_SYSTEM=0 + '[' 0 -eq 2 ']' + echo ODL_SYSTEM_IP=10.30.171.227 ++ seq 0 2 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_1_IP=10.30.171.227 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_2_IP=10.30.171.218 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_3_IP=10.30.170.189 + echo TOOLS_SYSTEM_IP= ++ seq 0 -1 + openstack_index=0 + NUM_OPENSTACK_CONTROL_NODES=1 + echo NUM_OPENSTACK_CONTROL_NODES=1 ++ seq 0 0 + for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1))) + echo OPENSTACK_CONTROL_NODE_1_IP= + NUM_OPENSTACK_COMPUTE_NODES=-1 + echo NUM_OPENSTACK_COMPUTE_NODES=-1 + '[' -1 -ge 2 ']' ++ seq 0 -2 + NUM_OPENSTACK_HAPROXY_NODES=0 + echo NUM_OPENSTACK_HAPROXY_NODES=0 ++ seq 0 -1 + echo 'Contents of slave_addresses.txt:' Contents of slave_addresses.txt: + cat slave_addresses.txt NUM_ODL_SYSTEM=3 NUM_TOOLS_SYSTEM=0 NUM_OPENSTACK_SYSTEM=0 ODL_SYSTEM_IP=10.30.171.227 ODL_SYSTEM_1_IP=10.30.171.227 ODL_SYSTEM_2_IP=10.30.171.218 ODL_SYSTEM_3_IP=10.30.170.189 TOOLS_SYSTEM_IP= NUM_OPENSTACK_CONTROL_NODES=1 OPENSTACK_CONTROL_NODE_1_IP= NUM_OPENSTACK_COMPUTE_NODES=-1 NUM_OPENSTACK_HAPROXY_NODES=0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-ask-all-calcium] $ /bin/sh /tmp/jenkins9134853024029675256.sh Preparing for JRE Version 17 Karaf artifact is karaf Karaf project is integration Java home is /usr/lib/jvm/java-17-openjdk [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'set_variables.env' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins4762462893312125122.sh --2024-02-17 23:43:49-- http://git.opendaylight.org/gerrit/gitweb?p=integration/distribution.git;a=blob_plain;f=pom.xml;hb=refs/heads/master Resolving git.opendaylight.org (git.opendaylight.org)... 52.35.122.251, 2600:1f14:421:f500:133a:a004:b30b:69e1 Connecting to git.opendaylight.org (git.opendaylight.org)|52.35.122.251|:80... connected. HTTP request sent, awaiting response... 301 Moved Permanently Location: https://git.opendaylight.org/gerrit/gitweb?p=integration/distribution.git;a=blob_plain;f=pom.xml;hb=refs/heads/master [following] --2024-02-17 23:43:49-- https://git.opendaylight.org/gerrit/gitweb?p=integration/distribution.git;a=blob_plain;f=pom.xml;hb=refs/heads/master Connecting to git.opendaylight.org (git.opendaylight.org)|52.35.122.251|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 2620 (2.6K) [text/plain] Saving to: ‘pom.xml’ 0K .. 100% 54.5M=0s 2024-02-17 23:43:50 (54.5 MB/s) - ‘pom.xml’ saved [2620/2620] Bundle version is 0.20.0-SNAPSHOT --2024-02-17 23:43:50-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.0-SNAPSHOT/maven-metadata.xml Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 1410 (1.4K) [application/xml] Saving to: ‘maven-metadata.xml’ 0K . 100% 73.8M=0s 2024-02-17 23:43:50 (73.8 MB/s) - ‘maven-metadata.xml’ saved [1410/1410] org.opendaylight.integration karaf 0.20.0-SNAPSHOT 20240126.213124 775 20240126213124 pom 0.20.0-20240126.213124-775 20240126213124 tar.gz 0.20.0-20240126.213124-775 20240126213124 zip 0.20.0-20240126.213124-775 20240126213124 cyclonedx xml 0.20.0-20240126.213124-775 20240126213124 cyclonedx json 0.20.0-20240126.213124-775 20240126213124 Nexus timestamp is 0.20.0-20240126.213124-775 Distribution bundle URL is https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.0-SNAPSHOT/karaf-0.20.0-20240126.213124-775.zip Distribution bundle is karaf-0.20.0-20240126.213124-775.zip Distribution bundle version is 0.20.0-SNAPSHOT Distribution folder is karaf-0.20.0-SNAPSHOT Nexus prefix is https://nexus.opendaylight.org [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash -l /tmp/jenkins11673905658742448430.sh Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-9zTA from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient lf-activate-venv(): INFO: Adding /tmp/venv-9zTA/bin to PATH Copying common-functions.sh to /tmp Copying common-functions.sh to 10.30.171.227:/tmp Warning: Permanently added '10.30.171.227' (ECDSA) to the list of known hosts. Copying common-functions.sh to 10.30.171.218:/tmp Warning: Permanently added '10.30.171.218' (ECDSA) to the list of known hosts. Copying common-functions.sh to 10.30.170.189:/tmp Warning: Permanently added '10.30.170.189' (ECDSA) to the list of known hosts. [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins2809937706937589319.sh common-functions.sh is being sourced common-functions environment: MAVENCONF: /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.20.0-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv CONTROLLERMEM: 2048m AKKACONF: /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ################################################# ## Configure Cluster and Start ## ################################################# ACTUALFEATURES: odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app SPACE_SEPARATED_FEATURES: odl-integration-compatible-with-all odl-jolokia odl-restconf odl-clustering-test-app Locating script plan to use... script plan exists!!! Changing the script plan path... # Place the scripts in run order: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/scripts/car_people_shard.sh Executing /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/scripts/car_people_shard.sh... Add car-people shards file Copy shard config to member-1 with IP address 10.30.171.227 Warning: Permanently added '10.30.171.227' (ECDSA) to the list of known hosts. Copy shard config to member-2 with IP address 10.30.171.218 Warning: Permanently added '10.30.171.218' (ECDSA) to the list of known hosts. Copy shard config to member-3 with IP address 10.30.170.189 Warning: Permanently added '10.30.170.189' (ECDSA) to the list of known hosts. Finished running script plans Configuring member-1 with IP address 10.30.171.227 Warning: Permanently added '10.30.171.227' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.227' (ECDSA) to the list of known hosts. + source /tmp/common-functions.sh karaf-0.20.0-SNAPSHOT common-functions.sh is being sourced ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.20.0-SNAPSHOT ++ export MAVENCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.20.0-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.20.0-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.20.0-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.20.0-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ export AKKACONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/akka.conf ++ AKKACONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/akka.conf ++ export MODULESCONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.20.0-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.0-SNAPSHOT/karaf-0.20.0-20240126.213124-775.zip + echo 'Changing to /tmp' + cd /tmp + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.0-SNAPSHOT/karaf-0.20.0-20240126.213124-775.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.0-SNAPSHOT/karaf-0.20.0-20240126.213124-775.zip --2024-02-17 23:44:01-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.0-SNAPSHOT/karaf-0.20.0-20240126.213124-775.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 231972534 (221M) [application/zip] Saving to: ‘karaf-0.20.0-20240126.213124-775.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 75.2M 3s 3072K ........ ........ ........ ........ ........ ........ 2% 139M 2s 6144K ........ ........ ........ ........ ........ ........ 4% 184M 2s 9216K ........ ........ ........ ........ ........ ........ 5% 206M 2s 12288K ........ ........ ........ ........ ........ ........ 6% 208M 1s 15360K ........ ........ ........ ........ ........ ........ 8% 214M 1s 18432K ........ ........ ........ ........ ........ ........ 9% 233M 1s 21504K ........ ........ ........ ........ ........ ........ 10% 289M 1s 24576K ........ ........ ........ ........ ........ ........ 12% 263M 1s 27648K ........ ........ ........ ........ ........ ........ 13% 263M 1s 30720K ........ ........ ........ ........ ........ ........ 14% 297M 1s 33792K ........ ........ ........ ........ ........ ........ 16% 311M 1s 36864K ........ ........ ........ ........ ........ ........ 17% 319M 1s 39936K ........ ........ ........ ........ ........ ........ 18% 306M 1s 43008K ........ ........ ........ ........ ........ ........ 20% 294M 1s 46080K ........ ........ ........ ........ ........ ........ 21% 301M 1s 49152K ........ ........ ........ ........ ........ ........ 23% 236M 1s 52224K ........ ........ ........ ........ ........ ........ 24% 292M 1s 55296K ........ ........ ........ ........ ........ ........ 25% 347M 1s 58368K ........ ........ ........ ........ ........ ........ 27% 359M 1s 61440K ........ ........ ........ ........ ........ ........ 28% 82.8M 1s 64512K ........ ........ ........ ........ ........ ........ 29% 334M 1s 67584K ........ ........ ........ ........ ........ ........ 31% 310M 1s 70656K ........ ........ ........ ........ ........ ........ 32% 290M 1s 73728K ........ ........ ........ ........ ........ ........ 33% 317M 1s 76800K ........ ........ ........ ........ ........ ........ 35% 357M 1s 79872K ........ ........ ........ ........ ........ ........ 36% 349M 1s 82944K ........ ........ ........ ........ ........ ........ 37% 345M 1s 86016K ........ ........ ........ ........ ........ ........ 39% 349M 1s 89088K ........ ........ ........ ........ ........ ........ 40% 358M 1s 92160K ........ ........ ........ ........ ........ ........ 42% 343M 1s 95232K ........ ........ ........ ........ ........ ........ 43% 342M 1s 98304K ........ ........ ........ ........ ........ ........ 44% 326M 1s 101376K ........ ........ ........ ........ ........ ........ 46% 357M 0s 104448K ........ ........ ........ ........ ........ ........ 47% 330M 0s 107520K ........ ........ ........ ........ ........ ........ 48% 326M 0s 110592K ........ ........ ........ ........ ........ ........ 50% 333M 0s 113664K ........ ........ ........ ........ ........ ........ 51% 335M 0s 116736K ........ ........ ........ ........ ........ ........ 52% 324M 0s 119808K ........ ........ ........ ........ ........ ........ 54% 351M 0s 122880K ........ ........ ........ ........ ........ ........ 55% 333M 0s 125952K ........ ........ ........ ........ ........ ........ 56% 361M 0s 129024K ........ ........ ........ ........ ........ ........ 58% 346M 0s 132096K ........ ........ ........ ........ ........ ........ 59% 344M 0s 135168K ........ ........ ........ ........ ........ ........ 61% 340M 0s 138240K ........ ........ ........ ........ ........ ........ 62% 350M 0s 141312K ........ ........ ........ ........ ........ ........ 63% 328M 0s 144384K ........ ........ ........ ........ ........ ........ 65% 323M 0s 147456K ........ ........ ........ ........ ........ ........ 66% 321M 0s 150528K ........ ........ ........ ........ ........ ........ 67% 287M 0s 153600K ........ ........ ........ ........ ........ ........ 69% 364M 0s 156672K ........ ........ ........ ........ ........ ........ 70% 367M 0s 159744K ........ ........ ........ ........ ........ ........ 71% 349M 0s 162816K ........ ........ ........ ........ ........ ........ 73% 334M 0s 165888K ........ ........ ........ ........ ........ ........ 74% 285M 0s 168960K ........ ........ ........ ........ ........ ........ 75% 369M 0s 172032K ........ ........ ........ ........ ........ ........ 77% 342M 0s 175104K ........ ........ ........ ........ ........ ........ 78% 364M 0s 178176K ........ ........ ........ ........ ........ ........ 80% 334M 0s 181248K ........ ........ ........ ........ ........ ........ 81% 344M 0s 184320K ........ ........ ........ ........ ........ ........ 82% 330M 0s 187392K ........ ........ ........ ........ ........ ........ 84% 346M 0s 190464K ........ ........ ........ ........ ........ ........ 85% 329M 0s 193536K ........ ........ ........ ........ ........ ........ 86% 333M 0s 196608K ........ ........ ........ ........ ........ ........ 88% 334M 0s 199680K ........ ........ ........ ........ ........ ........ 89% 348M 0s 202752K ........ ........ ........ ........ ........ ........ 90% 330M 0s 205824K ........ ........ ........ ........ ........ ........ 92% 348M 0s 208896K ........ ........ ........ ........ ........ ........ 93% 337M 0s 211968K ........ ........ ........ ........ ........ ........ 94% 327M 0s 215040K ........ ........ ........ ........ ........ ........ 96% 348M 0s 218112K ........ ........ ........ ........ ........ ........ 97% 356M 0s 221184K ........ ........ ........ ........ ........ ........ 98% 352M 0s 224256K ........ ........ ........ ........ ... 100% 359M=0.8s 2024-02-17 23:44:02 (287 MB/s) - ‘karaf-0.20.0-20240126.213124-775.zip’ saved [231972534/231972534] Extracting the new controller... + echo 'Extracting the new controller...' + unzip -q karaf-0.20.0-20240126.213124-775.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features... + [[ True == \T\r\u\e ]] + echo 'Configuring the startup features...' + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.20.0-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/ec0d4f70-9012-4a9c-8c73-5dade660adc2.xml # # Comma separated list of features to install at startup # featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 75f90dea-f1a3-4402-bef8-1a29b94ba6b4 # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + logapi=log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg controllerdebugmap: cat /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' + unset IFS + echo 'controllerdebugmap: ' + '[' -n '' ']' + echo 'cat /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN Configure java home: /usr/lib/jvm/java-17-openjdk max memory: 3072m memconf: /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv + set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv + local -r java_home=/usr/lib/jvm/java-17-openjdk + local -r controllermem=3072m + local -r memconf=/tmp/karaf-0.20.0-SNAPSHOT/bin/setenv + echo Configure + echo ' java home: /usr/lib/jvm/java-17-openjdk' + echo ' max memory: 3072m' + echo ' memconf: /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv cat /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv' + cat /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1 + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "17.0.6-ea" 2023-01-17 LTS OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS) OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-17-openjdk + JAVA_HOME=/usr/lib/jvm/java-17-openjdk ++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java Listing all open ports on controller system... + JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java' + echo 'Listing all open ports on controller system...' + netstat -pnatu (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 0 10.30.171.227:22 10.30.171.116:50832 ESTABLISHED - tcp 0 0 10.30.171.227:46370 199.204.45.87:443 TIME_WAIT - tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::22 :::* LISTEN - tcp6 0 0 :::111 :::* LISTEN - udp 0 0 10.30.171.227:68 10.30.170.4:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - Custom shard config exists!!! Copying the shard config... + '[' -f /tmp/custom_shard_config.txt ']' + echo 'Custom shard config exists!!!' + echo 'Copying the shard config...' + cp /tmp/custom_shard_config.txt /tmp/karaf-0.20.0-SNAPSHOT/bin/ Configuring cluster + echo 'Configuring cluster' + /tmp/karaf-0.20.0-SNAPSHOT/bin/configure_cluster.sh 1 10.30.171.227 10.30.171.218 10.30.170.189 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.20.0-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/8.0.4 Configuring unique name in akka.conf Configuring hostname in akka.conf Configuring data and rpc seed nodes in akka.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump akka.conf + echo 'Dump akka.conf' + cat /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/akka.conf odl-cluster-data { akka { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.171.227" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.227:2550", "akka://opendaylight-cluster-data@10.30.171.218:2550", "akka://opendaylight-cluster-data@10.30.170.189:2550"] roles = ["member-1"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" # Use lz4 compression for LocalSnapshotStore snapshots snapshot-store.local.use-lz4-compression = false # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB snapshot-store.local.lz4-blocksize = 256KB } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car" shards = [ { name="car" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "people" shards = [ { name="people" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car-people" shards = [ { name="car-people" replicas = ["member-1", "member-2", "member-3"] } ] } ] Configuring member-2 with IP address 10.30.171.218 Warning: Permanently added '10.30.171.218' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.218' (ECDSA) to the list of known hosts. + source /tmp/common-functions.sh karaf-0.20.0-SNAPSHOT common-functions.sh is being sourced ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.20.0-SNAPSHOT ++ export MAVENCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.20.0-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.20.0-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.20.0-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.20.0-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ export AKKACONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/akka.conf ++ AKKACONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/akka.conf ++ export MODULESCONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.20.0-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.0-SNAPSHOT/karaf-0.20.0-20240126.213124-775.zip + echo 'Changing to /tmp' + cd /tmp + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.0-SNAPSHOT/karaf-0.20.0-20240126.213124-775.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.0-SNAPSHOT/karaf-0.20.0-20240126.213124-775.zip --2024-02-17 23:44:06-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.0-SNAPSHOT/karaf-0.20.0-20240126.213124-775.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 231972534 (221M) [application/zip] Saving to: ‘karaf-0.20.0-20240126.213124-775.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 91.7M 2s 3072K ........ ........ ........ ........ ........ ........ 2% 130M 2s 6144K ........ ........ ........ ........ ........ ........ 4% 138M 2s 9216K ........ ........ ........ ........ ........ ........ 5% 194M 2s 12288K ........ ........ ........ ........ ........ ........ 6% 283M 1s 15360K ........ ........ ........ ........ ........ ........ 8% 276M 1s 18432K ........ ........ ........ ........ ........ ........ 9% 288M 1s 21504K ........ ........ ........ ........ ........ ........ 10% 272M 1s 24576K ........ ........ ........ ........ ........ ........ 12% 286M 1s 27648K ........ ........ ........ ........ ........ ........ 13% 279M 1s 30720K ........ ........ ........ ........ ........ ........ 14% 289M 1s 33792K ........ ........ ........ ........ ........ ........ 16% 328M 1s 36864K ........ ........ ........ ........ ........ ........ 17% 187M 1s 39936K ........ ........ ........ ........ ........ ........ 18% 343M 1s 43008K ........ ........ ........ ........ ........ ........ 20% 360M 1s 46080K ........ ........ ........ ........ ........ ........ 21% 362M 1s 49152K ........ ........ ........ ........ ........ ........ 23% 369M 1s 52224K ........ ........ ........ ........ ........ ........ 24% 337M 1s 55296K ........ ........ ........ ........ ........ ........ 25% 346M 1s 58368K ........ ........ ........ ........ ........ ........ 27% 347M 1s 61440K ........ ........ ........ ........ ........ ........ 28% 356M 1s 64512K ........ ........ ........ ........ ........ ........ 29% 346M 1s 67584K ........ ........ ........ ........ ........ ........ 31% 355M 1s 70656K ........ ........ ........ ........ ........ ........ 32% 325M 1s 73728K ........ ........ ........ ........ ........ ........ 33% 337M 1s 76800K ........ ........ ........ ........ ........ ........ 35% 337M 1s 79872K ........ ........ ........ ........ ........ ........ 36% 346M 1s 82944K ........ ........ ........ ........ ........ ........ 37% 351M 1s 86016K ........ ........ ........ ........ ........ ........ 39% 332M 1s 89088K ........ ........ ........ ........ ........ ........ 40% 348M 0s 92160K ........ ........ ........ ........ ........ ........ 42% 325M 0s 95232K ........ ........ ........ ........ ........ ........ 43% 350M 0s 98304K ........ ........ ........ ........ ........ ........ 44% 358M 0s 101376K ........ ........ ........ ........ ........ ........ 46% 350M 0s 104448K ........ ........ ........ ........ ........ ........ 47% 366M 0s 107520K ........ ........ ........ ........ ........ ........ 48% 356M 0s 110592K ........ ........ ........ ........ ........ ........ 50% 312M 0s 113664K ........ ........ ........ ........ ........ ........ 51% 343M 0s 116736K ........ ........ ........ ........ ........ ........ 52% 354M 0s 119808K ........ ........ ........ ........ ........ ........ 54% 342M 0s 122880K ........ ........ ........ ........ ........ ........ 55% 361M 0s 125952K ........ ........ ........ ........ ........ ........ 56% 351M 0s 129024K ........ ........ ........ ........ ........ ........ 58% 347M 0s 132096K ........ ........ ........ ........ ........ ........ 59% 131M 0s 135168K ........ ........ ........ ........ ........ ........ 61% 266M 0s 138240K ........ ........ ........ ........ ........ ........ 62% 348M 0s 141312K ........ ........ ........ ........ ........ ........ 63% 363M 0s 144384K ........ ........ ........ ........ ........ ........ 65% 353M 0s 147456K ........ ........ ........ ........ ........ ........ 66% 331M 0s 150528K ........ ........ ........ ........ ........ ........ 67% 341M 0s 153600K ........ ........ ........ ........ ........ ........ 69% 352M 0s 156672K ........ ........ ........ ........ ........ ........ 70% 337M 0s 159744K ........ ........ ........ ........ ........ ........ 71% 350M 0s 162816K ........ ........ ........ ........ ........ ........ 73% 352M 0s 165888K ........ ........ ........ ........ ........ ........ 74% 364M 0s 168960K ........ ........ ........ ........ ........ ........ 75% 357M 0s 172032K ........ ........ ........ ........ ........ ........ 77% 357M 0s 175104K ........ ........ ........ ........ ........ ........ 78% 348M 0s 178176K ........ ........ ........ ........ ........ ........ 80% 357M 0s 181248K ........ ........ ........ ........ ........ ........ 81% 356M 0s 184320K ........ ........ ........ ........ ........ ........ 82% 358M 0s 187392K ........ ........ ........ ........ ........ ........ 84% 336M 0s 190464K ........ ........ ........ ........ ........ ........ 85% 357M 0s 193536K ........ ........ ........ ........ ........ ........ 86% 340M 0s 196608K ........ ........ ........ ........ ........ ........ 88% 339M 0s 199680K ........ ........ ........ ........ ........ ........ 89% 354M 0s 202752K ........ ........ ........ ........ ........ ........ 90% 357M 0s 205824K ........ ........ ........ ........ ........ ........ 92% 349M 0s 208896K ........ ........ ........ ........ ........ ........ 93% 356M 0s 211968K ........ ........ ........ ........ ........ ........ 94% 355M 0s 215040K ........ ........ ........ ........ ........ ........ 96% 362M 0s 218112K ........ ........ ........ ........ ........ ........ 97% 351M 0s 221184K ........ ........ ........ ........ ........ ........ 98% 383M 0s 224256K ........ ........ ........ ........ ... 100% 378M=0.7s 2024-02-17 23:44:06 (303 MB/s) - ‘karaf-0.20.0-20240126.213124-775.zip’ saved [231972534/231972534] Extracting the new controller... + echo 'Extracting the new controller...' + unzip -q karaf-0.20.0-20240126.213124-775.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.+ [[ True == \T\r\u\e ]] Configuring the startup features... + echo 'Configuring the startup features...' + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.20.0-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/ec0d4f70-9012-4a9c-8c73-5dade660adc2.xml # # Comma separated list of features to install at startup # featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 75f90dea-f1a3-4402-bef8-1a29b94ba6b4 # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + logapi=log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' + unset IFS controllerdebugmap: + echo 'controllerdebugmap: ' cat /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + '[' -n '' ']' + echo 'cat /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN Configure java home: /usr/lib/jvm/java-17-openjdk + set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv + local -r java_home=/usr/lib/jvm/java-17-openjdk + local -r controllermem=3072m + local -r memconf=/tmp/karaf-0.20.0-SNAPSHOT/bin/setenv + echo Configure + echo ' java home: /usr/lib/jvm/java-17-openjdk' + echo ' max memory: 3072m' max memory: 3072m memconf: /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv + echo ' memconf: /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv cat /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv' + cat /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1 + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "17.0.6-ea" 2023-01-17 LTS OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS) OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-17-openjdk + JAVA_HOME=/usr/lib/jvm/java-17-openjdk ++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java + JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java' Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java Listing all open ports on controller system... + echo 'Listing all open ports on controller system...' + netstat -pnatu (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 164 10.30.171.218:22 10.30.171.116:43038 ESTABLISHED - tcp 0 0 10.30.171.218:47302 199.204.45.87:443 TIME_WAIT - tcp6 0 0 :::22 :::* LISTEN - tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 :::5555 :::* LISTEN - udp 0 0 10.30.171.218:68 10.30.170.3:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - Custom shard config exists!!! + '[' -f /tmp/custom_shard_config.txt ']' + echo 'Custom shard config exists!!!' + echo 'Copying the shard config...' Copying the shard config... + cp /tmp/custom_shard_config.txt /tmp/karaf-0.20.0-SNAPSHOT/bin/ Configuring cluster + echo 'Configuring cluster' + /tmp/karaf-0.20.0-SNAPSHOT/bin/configure_cluster.sh 2 10.30.171.227 10.30.171.218 10.30.170.189 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.20.0-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/8.0.4 Configuring unique name in akka.conf Configuring hostname in akka.conf Configuring data and rpc seed nodes in akka.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump akka.conf + echo 'Dump akka.conf' + cat /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/akka.conf odl-cluster-data { akka { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.171.218" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.227:2550", "akka://opendaylight-cluster-data@10.30.171.218:2550", "akka://opendaylight-cluster-data@10.30.170.189:2550"] roles = ["member-2"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" # Use lz4 compression for LocalSnapshotStore snapshots snapshot-store.local.use-lz4-compression = false # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB snapshot-store.local.lz4-blocksize = 256KB } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car" shards = [ { name="car" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "people" shards = [ { name="people" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car-people" shards = [ { name="car-people" replicas = ["member-1", "member-2", "member-3"] } ] } ] Configuring member-3 with IP address 10.30.170.189 Warning: Permanently added '10.30.170.189' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.189' (ECDSA) to the list of known hosts. common-functions.sh is being sourced + source /tmp/common-functions.sh karaf-0.20.0-SNAPSHOT ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.20.0-SNAPSHOT ++ export MAVENCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.20.0-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.20.0-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.20.0-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.20.0-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ export AKKACONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/akka.conf ++ AKKACONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/akka.conf ++ export MODULESCONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.20.0-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/module-shards.conf SUITES: Changing to /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.0-SNAPSHOT/karaf-0.20.0-20240126.213124-775.zip ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' + echo 'Changing to /tmp' + cd /tmp + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.0-SNAPSHOT/karaf-0.20.0-20240126.213124-775.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.0-SNAPSHOT/karaf-0.20.0-20240126.213124-775.zip --2024-02-17 23:44:10-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.0-SNAPSHOT/karaf-0.20.0-20240126.213124-775.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 231972534 (221M) [application/zip] Saving to: ‘karaf-0.20.0-20240126.213124-775.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 46.5M 5s 3072K ........ ........ ........ ........ ........ ........ 2% 97.1M 3s 6144K ........ ........ ........ ........ ........ ........ 4% 166M 3s 9216K ........ ........ ........ ........ ........ ........ 5% 174M 2s 12288K ........ ........ ........ ........ ........ ........ 6% 185M 2s 15360K ........ ........ ........ ........ ........ ........ 8% 224M 2s 18432K ........ ........ ........ ........ ........ ........ 9% 252M 2s 21504K ........ ........ ........ ........ ........ ........ 10% 215M 2s 24576K ........ ........ ........ ........ ........ ........ 12% 281M 1s 27648K ........ ........ ........ ........ ........ ........ 13% 235M 1s 30720K ........ ........ ........ ........ ........ ........ 14% 267M 1s 33792K ........ ........ ........ ........ ........ ........ 16% 286M 1s 36864K ........ ........ ........ ........ ........ ........ 17% 230M 1s 39936K ........ ........ ........ ........ ........ ........ 18% 290M 1s 43008K ........ ........ ........ ........ ........ ........ 20% 298M 1s 46080K ........ ........ ........ ........ ........ ........ 21% 284M 1s 49152K ........ ........ ........ ........ ........ ........ 23% 272M 1s 52224K ........ ........ ........ ........ ........ ........ 24% 169M 1s 55296K ........ ........ ........ ........ ........ ........ 25% 318M 1s 58368K ........ ........ ........ ........ ........ ........ 27% 265M 1s 61440K ........ ........ ........ ........ ........ ........ 28% 244M 1s 64512K ........ ........ ........ ........ ........ ........ 29% 252M 1s 67584K ........ ........ ........ ........ ........ ........ 31% 313M 1s 70656K ........ ........ ........ ........ ........ ........ 32% 126M 1s 73728K ........ ........ ........ ........ ........ ........ 33% 240M 1s 76800K ........ ........ ........ ........ ........ ........ 35% 228M 1s 79872K ........ ........ ........ ........ ........ ........ 36% 257M 1s 82944K ........ ........ ........ ........ ........ ........ 37% 206M 1s 86016K ........ ........ ........ ........ ........ ........ 39% 274M 1s 89088K ........ ........ ........ ........ ........ ........ 40% 261M 1s 92160K ........ ........ ........ ........ ........ ........ 42% 308M 1s 95232K ........ ........ ........ ........ ........ ........ 43% 270M 1s 98304K ........ ........ ........ ........ ........ ........ 44% 236M 1s 101376K ........ ........ ........ ........ ........ ........ 46% 269M 1s 104448K ........ ........ ........ ........ ........ ........ 47% 281M 1s 107520K ........ ........ ........ ........ ........ ........ 48% 312M 1s 110592K ........ ........ ........ ........ ........ ........ 50% 303M 1s 113664K ........ ........ ........ ........ ........ ........ 51% 299M 1s 116736K ........ ........ ........ ........ ........ ........ 52% 256M 0s 119808K ........ ........ ........ ........ ........ ........ 54% 295M 0s 122880K ........ ........ ........ ........ ........ ........ 55% 255M 0s 125952K ........ ........ ........ ........ ........ ........ 56% 304M 0s 129024K ........ ........ ........ ........ ........ ........ 58% 222M 0s 132096K ........ ........ ........ ........ ........ ........ 59% 265M 0s 135168K ........ ........ ........ ........ ........ ........ 61% 245M 0s 138240K ........ ........ ........ ........ ........ ........ 62% 318M 0s 141312K ........ ........ ........ ........ ........ ........ 63% 244M 0s 144384K ........ ........ ........ ........ ........ ........ 65% 276M 0s 147456K ........ ........ ........ ........ ........ ........ 66% 281M 0s 150528K ........ ........ ........ ........ ........ ........ 67% 244M 0s 153600K ........ ........ ........ ........ ........ ........ 69% 266M 0s 156672K ........ ........ ........ ........ ........ ........ 70% 241M 0s 159744K ........ ........ ........ ........ ........ ........ 71% 283M 0s 162816K ........ ........ ........ ........ ........ ........ 73% 304M 0s 165888K ........ ........ ........ ........ ........ ........ 74% 329M 0s 168960K ........ ........ ........ ........ ........ ........ 75% 305M 0s 172032K ........ ........ ........ ........ ........ ........ 77% 330M 0s 175104K ........ ........ ........ ........ ........ ........ 78% 243M 0s 178176K ........ ........ ........ ........ ........ ........ 80% 250M 0s 181248K ........ ........ ........ ........ ........ ........ 81% 197M 0s 184320K ........ ........ ........ ........ ........ ........ 82% 257M 0s 187392K ........ ........ ........ ........ ........ ........ 84% 280M 0s 190464K ........ ........ ........ ........ ........ ........ 85% 308M 0s 193536K ........ ........ ........ ........ ........ ........ 86% 314M 0s 196608K ........ ........ ........ ........ ........ ........ 88% 323M 0s 199680K ........ ........ ........ ........ ........ ........ 89% 284M 0s 202752K ........ ........ ........ ........ ........ ........ 90% 192M 0s 205824K ........ ........ ........ ........ ........ ........ 92% 185M 0s 208896K ........ ........ ........ ........ ........ ........ 93% 302M 0s 211968K ........ ........ ........ ........ ........ ........ 94% 248M 0s 215040K ........ ........ ........ ........ ........ ........ 96% 226M 0s 218112K ........ ........ ........ ........ ........ ........ 97% 276M 0s 221184K ........ ........ ........ ........ ........ ........ 98% 167M 0s 224256K ........ ........ ........ ........ ... 100% 239M=1.0s 2024-02-17 23:44:11 (231 MB/s) - ‘karaf-0.20.0-20240126.213124-775.zip’ saved [231972534/231972534] Extracting the new controller... + echo 'Extracting the new controller...' + unzip -q karaf-0.20.0-20240126.213124-775.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.+ [[ True == \T\r\u\e ]] + echo 'Configuring the startup features...' Configuring the startup features... + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.20.0-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/ec0d4f70-9012-4a9c-8c73-5dade660adc2.xml # # Comma separated list of features to install at startup # featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 75f90dea-f1a3-4402-bef8-1a29b94ba6b4 # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + logapi=log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg controllerdebugmap: cat /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' + unset IFS + echo 'controllerdebugmap: ' + '[' -n '' ']' + echo 'cat /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN Configure java home: /usr/lib/jvm/java-17-openjdk + set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv + local -r java_home=/usr/lib/jvm/java-17-openjdk + local -r controllermem=3072m + local -r memconf=/tmp/karaf-0.20.0-SNAPSHOT/bin/setenv + echo Configure + echo ' java home: /usr/lib/jvm/java-17-openjdk' max memory: 3072m memconf: /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv + echo ' max memory: 3072m' + echo ' memconf: /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv cat /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv' + cat /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1 + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "17.0.6-ea" 2023-01-17 LTS OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS) OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-17-openjdk + JAVA_HOME=/usr/lib/jvm/java-17-openjdk ++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java + JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java' Listing all open ports on controller system... Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 0 10.30.170.189:35134 199.204.45.87:443 TIME_WAIT - tcp 0 808 10.30.170.189:22 10.30.171.116:50022 ESTABLISHED - tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::22 :::* LISTEN - udp 0 0 10.30.170.189:68 10.30.170.2:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - + echo 'Listing all open ports on controller system...' + netstat -pnatu (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) + '[' -f /tmp/custom_shard_config.txt ']' Custom shard config exists!!! Copying the shard config... + echo 'Custom shard config exists!!!' + echo 'Copying the shard config...' + cp /tmp/custom_shard_config.txt /tmp/karaf-0.20.0-SNAPSHOT/bin/ Configuring cluster + echo 'Configuring cluster' + /tmp/karaf-0.20.0-SNAPSHOT/bin/configure_cluster.sh 3 10.30.171.227 10.30.171.218 10.30.170.189 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.20.0-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/8.0.4 Configuring unique name in akka.conf Configuring hostname in akka.conf Configuring data and rpc seed nodes in akka.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump akka.conf + echo 'Dump akka.conf' + cat /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/akka.conf odl-cluster-data { akka { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.170.189" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.227:2550", "akka://opendaylight-cluster-data@10.30.171.218:2550", "akka://opendaylight-cluster-data@10.30.170.189:2550"] roles = ["member-3"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" # Use lz4 compression for LocalSnapshotStore snapshots snapshot-store.local.use-lz4-compression = false # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB snapshot-store.local.lz4-blocksize = 256KB } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car" shards = [ { name="car" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "people" shards = [ { name="people" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car-people" shards = [ { name="car-people" replicas = ["member-1", "member-2", "member-3"] } ] } ] Locating config plan to use... Finished running config plans Starting member-1 with IP address 10.30.171.227 Warning: Permanently added '10.30.171.227' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.227' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf_console.log Starting member-2 with IP address 10.30.171.218 Warning: Permanently added '10.30.171.218' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.218' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf_console.log Starting member-3 with IP address 10.30.170.189 Warning: Permanently added '10.30.170.189' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.189' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf_console.log [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins3188952244998800143.sh common-functions.sh is being sourced common-functions environment: MAVENCONF: /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.20.0-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv CONTROLLERMEM: 2048m AKKACONF: /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/module-shards.conf SUITES: + echo '#################################################' ################################################# + echo '## Verify Cluster is UP ##' ## Verify Cluster is UP ## + echo '#################################################' ################################################# + create_post_startup_script + cat + copy_and_run_post_startup_script + seed_index=1 ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Execute the post startup script on controller 10.30.171.227' Execute the post startup script on controller 10.30.171.227 + scp /w/workspace/controller-csit-3node-clustering-ask-all-calcium/post-startup-script.sh 10.30.171.227:/tmp/ Warning: Permanently added '10.30.171.227' (ECDSA) to the list of known hosts. + ssh 10.30.171.227 'bash /tmp/post-startup-script.sh 1' Warning: Permanently added '10.30.171.227' (ECDSA) to the list of known hosts. tcp6 0 0 :::8101 :::* LISTEN Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2024-02-17T23:45:09,807 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 291 - org.opendaylight.infrautils.ready-api - 6.0.5 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2024-02-17T23:45:09,807 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 291 - org.opendaylight.infrautils.ready-api - 6.0.5 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 164 10.30.171.227:22 10.30.171.116:45858 ESTABLISHED - tcp6 0 0 :::6640 :::* LISTEN 5799/java tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::8181 :::* LISTEN 5799/java tcp6 0 0 10.30.171.227:2550 :::* LISTEN 5799/java tcp6 0 0 :::22 :::* LISTEN - tcp6 0 0 :::12345 :::* LISTEN 5799/java tcp6 0 0 127.0.0.1:44444 :::* LISTEN 5799/java tcp6 0 0 :::6653 :::* LISTEN 5799/java tcp6 0 0 :::4189 :::* LISTEN 5799/java tcp6 0 0 :::1790 :::* LISTEN 5799/java tcp6 0 0 127.0.0.1:37603 :::* LISTEN 5799/java tcp6 0 0 :::8101 :::* LISTEN 5799/java tcp6 0 0 :::6633 :::* LISTEN 5799/java tcp6 0 0 127.0.0.1:1099 :::* LISTEN 5799/java tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 127.0.0.1:48026 127.0.0.1:44444 TIME_WAIT - tcp6 0 0 127.0.0.1:60518 127.0.0.1:1099 TIME_WAIT - tcp6 0 0 10.30.171.227:2550 10.30.171.218:45234 ESTABLISHED 5799/java tcp6 0 0 10.30.171.227:2550 10.30.170.189:55974 ESTABLISHED 5799/java tcp6 0 0 10.30.171.227:2550 10.30.170.189:55990 ESTABLISHED 5799/java tcp6 0 0 127.0.0.1:48038 127.0.0.1:44444 TIME_WAIT - tcp6 0 0 10.30.171.227:32810 10.30.171.218:2550 ESTABLISHED 5799/java tcp6 0 0 10.30.171.227:2550 10.30.171.218:45228 ESTABLISHED 5799/java tcp6 32 0 10.30.171.227:35240 199.204.45.87:443 CLOSE_WAIT 5799/java tcp6 0 0 10.30.171.227:57684 10.30.170.189:2550 ESTABLISHED 5799/java tcp6 0 0 10.30.171.227:32796 10.30.171.218:2550 ESTABLISHED 5799/java tcp6 0 0 10.30.171.227:57688 10.30.170.189:2550 ESTABLISHED 5799/java udp 0 0 10.30.171.227:68 10.30.170.4:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - udp6 0 0 :::4342 :::* 5799/java looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 1 == 0 ']' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Execute the post startup script on controller 10.30.171.218' Execute the post startup script on controller 10.30.171.218 + scp /w/workspace/controller-csit-3node-clustering-ask-all-calcium/post-startup-script.sh 10.30.171.218:/tmp/ Warning: Permanently added '10.30.171.218' (ECDSA) to the list of known hosts. + ssh 10.30.171.218 'bash /tmp/post-startup-script.sh 2' Warning: Permanently added '10.30.171.218' (ECDSA) to the list of known hosts. tcp6 0 0 :::8101 :::* LISTEN Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2024-02-17T23:45:10,121 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 291 - org.opendaylight.infrautils.ready-api - 6.0.5 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2024-02-17T23:45:10,121 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 291 - org.opendaylight.infrautils.ready-api - 6.0.5 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 0 10.30.171.218:22 10.30.171.116:47308 ESTABLISHED - tcp6 0 0 :::8181 :::* LISTEN 5807/java tcp6 0 0 10.30.171.218:2550 :::* LISTEN 5807/java tcp6 0 0 :::22 :::* LISTEN - tcp6 0 0 127.0.0.1:34199 :::* LISTEN 5807/java tcp6 0 0 127.0.0.1:44444 :::* LISTEN 5807/java tcp6 0 0 :::6653 :::* LISTEN 5807/java tcp6 0 0 :::1790 :::* LISTEN 5807/java tcp6 0 0 :::8101 :::* LISTEN 5807/java tcp6 0 0 :::6633 :::* LISTEN 5807/java tcp6 0 0 127.0.0.1:1099 :::* LISTEN 5807/java tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 :::6640 :::* LISTEN 5807/java tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 10.30.171.218:45234 10.30.171.227:2550 ESTABLISHED 5807/java tcp6 0 0 127.0.0.1:51090 127.0.0.1:44444 TIME_WAIT - tcp6 0 0 127.0.0.1:51098 127.0.0.1:44444 TIME_WAIT - tcp6 0 0 10.30.171.218:37808 10.30.170.189:2550 ESTABLISHED 5807/java tcp6 0 0 10.30.171.218:2550 10.30.171.227:32796 ESTABLISHED 5807/java tcp6 0 0 127.0.0.1:54072 127.0.0.1:1099 TIME_WAIT - tcp6 0 0 10.30.171.218:2550 10.30.170.189:60308 ESTABLISHED 5807/java tcp6 0 0 10.30.171.218:2550 10.30.170.189:60298 ESTABLISHED 5807/java tcp6 0 0 10.30.171.218:37816 10.30.170.189:2550 ESTABLISHED 5807/java tcp6 32 0 10.30.171.218:41556 199.204.45.87:443 CLOSE_WAIT 5807/java tcp6 0 0 10.30.171.218:2550 10.30.171.227:32810 ESTABLISHED 5807/java tcp6 0 0 10.30.171.218:45228 10.30.171.227:2550 ESTABLISHED 5807/java udp 0 0 10.30.171.218:68 10.30.170.3:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::4342 :::* 5807/java udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 2 == 0 ']' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Execute the post startup script on controller 10.30.170.189' Execute the post startup script on controller 10.30.170.189 + scp /w/workspace/controller-csit-3node-clustering-ask-all-calcium/post-startup-script.sh 10.30.170.189:/tmp/ Warning: Permanently added '10.30.170.189' (ECDSA) to the list of known hosts. + ssh 10.30.170.189 'bash /tmp/post-startup-script.sh 3' Warning: Permanently added '10.30.170.189' (ECDSA) to the list of known hosts. tcp6 0 0 :::8101 :::* LISTEN Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2024-02-17T23:45:10,324 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 291 - org.opendaylight.infrautils.ready-api - 6.0.5 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2024-02-17T23:45:10,324 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 291 - org.opendaylight.infrautils.ready-api - 6.0.5 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 164 10.30.170.189:22 10.30.171.116:51762 ESTABLISHED - tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 :::6640 :::* LISTEN 5788/java tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::8181 :::* LISTEN 5788/java tcp6 0 0 10.30.170.189:2550 :::* LISTEN 5788/java tcp6 0 0 :::22 :::* LISTEN - tcp6 0 0 127.0.0.1:45051 :::* LISTEN 5788/java tcp6 0 0 127.0.0.1:44444 :::* LISTEN 5788/java tcp6 0 0 :::6653 :::* LISTEN 5788/java tcp6 0 0 :::1790 :::* LISTEN 5788/java tcp6 0 0 :::8101 :::* LISTEN 5788/java tcp6 0 0 :::6633 :::* LISTEN 5788/java tcp6 0 0 127.0.0.1:1099 :::* LISTEN 5788/java tcp6 0 0 10.30.170.189:60298 10.30.171.218:2550 ESTABLISHED 5788/java tcp6 0 0 127.0.0.1:37180 127.0.0.1:44444 TIME_WAIT - tcp6 0 0 10.30.170.189:2550 10.30.171.218:37816 ESTABLISHED 5788/java tcp6 0 0 10.30.170.189:2550 10.30.171.227:57688 ESTABLISHED 5788/java tcp6 0 0 127.0.0.1:37184 127.0.0.1:44444 TIME_WAIT - tcp6 0 0 10.30.170.189:55974 10.30.171.227:2550 ESTABLISHED 5788/java tcp6 0 0 10.30.170.189:55990 10.30.171.227:2550 ESTABLISHED 5788/java tcp6 32 0 10.30.170.189:37258 199.204.45.87:443 CLOSE_WAIT 5788/java tcp6 0 0 10.30.170.189:60308 10.30.171.218:2550 ESTABLISHED 5788/java tcp6 0 0 10.30.170.189:2550 10.30.171.218:37808 ESTABLISHED 5788/java tcp6 0 0 127.0.0.1:41042 127.0.0.1:1099 TIME_WAIT - tcp6 0 0 10.30.170.189:2550 10.30.171.227:57684 ESTABLISHED 5788/java udp 0 0 10.30.170.189:68 10.30.170.2:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::4342 :::* 5788/java udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 0 == 0 ']' + seed_index=1 + dump_controller_threads ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.171.227 'sudo ps aux' Warning: Permanently added '10.30.171.227' (ECDSA) to the list of known hosts. ++ tr -s ' ' ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-calcium/ps_before.log ++ cut -f2 '-d ' ++ grep -v grep + pid=5799 + echo 'karaf main: org.apache.karaf.main.Main, pid:5799' karaf main: org.apache.karaf.main.Main, pid:5799 + ssh 10.30.171.227 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5799' Warning: Permanently added '10.30.171.227' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.171.218 'sudo ps aux' Warning: Permanently added '10.30.171.218' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-calcium/ps_before.log ++ grep -v grep ++ tr -s ' ' ++ cut -f2 '-d ' + pid=5807 + echo 'karaf main: org.apache.karaf.main.Main, pid:5807' karaf main: org.apache.karaf.main.Main, pid:5807 + ssh 10.30.171.218 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5807' Warning: Permanently added '10.30.171.218' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.170.189 'sudo ps aux' Warning: Permanently added '10.30.170.189' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-calcium/ps_before.log ++ grep -v grep ++ tr -s ' ' ++ cut -f2 '-d ' + pid=5788 + echo 'karaf main: org.apache.karaf.main.Main, pid:5788' karaf main: org.apache.karaf.main.Main, pid:5788 + ssh 10.30.170.189 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5788' Warning: Permanently added '10.30.170.189' (ECDSA) to the list of known hosts. + '[' 0 -gt 0 ']' + echo 'Generating controller variables...' Generating controller variables... ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.227' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.227 -v ODL_SYSTEM_2_IP:10.30.171.218' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.227 -v ODL_SYSTEM_2_IP:10.30.171.218 -v ODL_SYSTEM_3_IP:10.30.170.189' + echo 'Generating mininet variables...' Generating mininet variables... ++ seq 1 0 + get_test_suites SUITES + local __suite_list=SUITES + echo 'Locating test plan to use...' Locating test plan to use... + testplan_filepath=/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/testplans/controller-clustering-ask-calcium.txt + '[' '!' -f /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/testplans/controller-clustering-ask-calcium.txt ']' + testplan_filepath=/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/testplans/controller-clustering-ask.txt + '[' disabled '!=' disabled ']' + echo 'Changing the testplan path...' Changing the testplan path... + sed s:integration:/w/workspace/controller-csit-3node-clustering-ask-all-calcium: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/testplans/controller-clustering-ask.txt + cat testplan.txt # Place the suites in run order: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot + '[' -z '' ']' ++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt ++ tr '\012' ' ' + suite_list='/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ' + eval 'SUITES='\''/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '\''' ++ SUITES='/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ' + echo 'Starting Robot test suites /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ...' Starting Robot test suites /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ... + robot -N controller-clustering-ask.txt --removekeywords wuks -e exclude -e skip_if_calcium -v BUNDLEFOLDER:karaf-0.20.0-SNAPSHOT -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.0-SNAPSHOT/karaf-0.20.0-20240126.213124-775.zip -v CONTROLLER:10.30.171.227 -v CONTROLLER1:10.30.171.218 -v CONTROLLER2:10.30.170.189 -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-17-openjdk -v JDKVERSION:openjdk17 -v JENKINS_WORKSPACE:/w/workspace/controller-csit-3node-clustering-ask-all-calcium -v MININET: -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:3 -v NUM_TOOLS_SYSTEM:0 -v ODL_STREAM:calcium -v ODL_SYSTEM_IP:10.30.171.227 -v ODL_SYSTEM_1_IP:10.30.171.227 -v ODL_SYSTEM_2_IP:10.30.171.218 -v ODL_SYSTEM_3_IP:10.30.170.189 -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP: -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ============================================================================== controller-clustering-ask.txt ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Rpc Provider Precedence :: DOMRpcBroker testi... ============================================================================== Register_Rpc_On_Each_Node :: Register global rpc on each node of t... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_precedence_register_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_register_rpc_on_each_node&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.227:8181/restconf/operations/odl-mdsal-lowlevel-control:register-constant ------------------------------------------------------------------------------ Invoke_Rpc_On_Each_Node :: Verify that the rpc response comes from... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.227:8181/restconf/operations/odl-mdsal-lowlevel-target:get-constant ------------------------------------------------------------------------------ Unregister_Rpc_On_Node :: Unregister the rpc on one of the cluster... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_precedence_unregister_rpc_on_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_unregister_rpc_on_node&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.227:8181/restconf/operations/odl-mdsal-lowlevel-control:unregister-constant ------------------------------------------------------------------------------ Invoke_Rpc_On_Node_With_Unregistered_Rpc :: Invoke rcp on the node... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_node_with_unregistered_rpc" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_node_with_unregistered_rpc&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.227:8181/restconf/operations/odl-mdsal-lowlevel-target:get-constant ------------------------------------------------------------------------------ Invoke_Rpc_On_Remaining_Nodes :: Verify that the rpc response come... | PASS | ------------------------------------------------------------------------------ Reregister_Rpc_On_Node :: Reregister the rpc. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_precedence_reregister_rpc_on_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_reregister_rpc_on_node&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.227:8181/restconf/operations/odl-mdsal-lowlevel-control:register-constant ------------------------------------------------------------------------------ Invoke_Rpc_On_Each_Node_Again :: Verify that the rpc response come... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node_again" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node_again&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.227:8181/restconf/operations/odl-mdsal-lowlevel-target:get-constant ------------------------------------------------------------------------------ Unregister_Rpc_On_Each_Node :: Unregister rpc on every node. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_precedence_unregister_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_unregister_rpc_on_each_node&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.227:8181/restconf/operations/odl-mdsal-lowlevel-control:unregister-constant ------------------------------------------------------------------------------ controller-clustering-ask.txt.Rpc Provider Precedence :: DOMRpcBro... | FAIL | 8 tests, 1 passed, 7 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Rpc Provider Partition And Heal :: DOMRpcBrok... ============================================================================== Register_Rpc_On_Two_Nodes :: Register rpc on two nodes of the odl ... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_partition_and_heal_register_rpc_on_two_nodes" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_register_rpc_on_two_nodes&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.227:8181/restconf/operations/odl-mdsal-lowlevel-control:register-constant ------------------------------------------------------------------------------ Invoke_Rpc_On_Each_Node :: Invoke get-constant rpc on every node o... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node&order=bug_status" Keyword 'Verify_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: HTTPError: 404 Client Error: Not Found for url: http://10.30.171.227:8181/restconf/operations/odl-mdsal-lowlevel-target:get-constant ------------------------------------------------------------------------------ Isolate_One_Node :: Isolate one node with registered rpc. From the... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_partition_and_heal_isolate_one_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_isolate_one_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Invoke_Rpc_On_Nonisolated_Nodes :: Invoke rpc on non-islolated nodes. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_nonisolated_nodes" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_nonisolated_nodes&order=bug_status" Keyword 'DrbCommons.Verify_Constant_On_Active_Nodes' failed after retrying for 1 minute. The last error was: Keyword 'Verify_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: HTTPError: 404 Client Error: Not Found for url: http://10.30.171.227:8181/restconf/operations/odl-mdsal-lowlevel-target:get-constant ------------------------------------------------------------------------------ Rejoin_Isolated_Member :: Rejoin isolated node | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_partition_and_heal_rejoin_isolated_member" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_rejoin_isolated_member&order=bug_status" Variable '${isolated_idx}' not found. ------------------------------------------------------------------------------ Invoke_Rpc_On_Each_Node_Again :: Invoke rpc get-constant on every ... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node_again" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node_again&order=bug_status" Keyword 'Verify_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: HTTPError: 404 Client Error: Not Found for url: http://10.30.171.227:8181/restconf/operations/odl-mdsal-lowlevel-target:get-constant ------------------------------------------------------------------------------ Unregister_Rpc_On_Each_Node :: Inregister rpc on both nodes. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_partition_and_heal_unregister_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_unregister_rpc_on_each_node&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.227:8181/restconf/operations/odl-mdsal-lowlevel-control:unregister-constant ------------------------------------------------------------------------------ controller-clustering-ask.txt.Rpc Provider Partition And Heal :: D... | FAIL | 7 tests, 0 passed, 7 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Action Provider Precedence :: DOMRpcBroker te... ============================================================================== Register_Rpc_On_Each_Node :: Register routed rpc on each node of t... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_precedence_register_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_register_rpc_on_each_node&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.227:8181/restconf/operations/odl-mdsal-lowlevel-control:register-bound-constant ------------------------------------------------------------------------------ Invoke_Rpc_On_Each_Node :: Verify that the rpc response comes from... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.227:8181/restconf/operations/odl-mdsal-lowlevel-target:get-contexted-constant ------------------------------------------------------------------------------ Unregister_Rpc_On_Node :: Unregister the rpc on one of the cluster... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_precedence_unregister_rpc_on_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_unregister_rpc_on_node&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.227:8181/restconf/operations/odl-mdsal-lowlevel-control:unregister-bound-constant ------------------------------------------------------------------------------ Invoke_Rpc_On_Node_With_Unregistered_Rpc :: Invoke rcp on the node... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_node_with_unregistered_rpc" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_node_with_unregistered_rpc&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.227:8181/restconf/operations/odl-mdsal-lowlevel-target:get-contexted-constant ------------------------------------------------------------------------------ Invoke_Rpc_On_Remaining_Nodes :: Verify that the rpc response come... | PASS | ------------------------------------------------------------------------------ Reregister_Rpc_On_Node :: Reregister the rpc. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_precedence_reregister_rpc_on_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_reregister_rpc_on_node&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.227:8181/restconf/operations/odl-mdsal-lowlevel-control:register-bound-constant ------------------------------------------------------------------------------ Invoke_Rpc_On_Each_Node_Again :: Verify that the rpc response come... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node_again" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node_again&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.227:8181/restconf/operations/odl-mdsal-lowlevel-target:get-contexted-constant ------------------------------------------------------------------------------ Unregister_Rpc_On_Each_Node :: Unregister rpc on every node. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_precedence_unregister_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_unregister_rpc_on_each_node&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.227:8181/restconf/operations/odl-mdsal-lowlevel-control:unregister-bound-constant ------------------------------------------------------------------------------ controller-clustering-ask.txt.Action Provider Precedence :: DOMRpc... | FAIL | 8 tests, 1 passed, 7 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Action Provider Partition And Heal :: DOMRpcB... ============================================================================== Register_Rpc_On_Two_Nodes :: Register rpc on two nodes of the odl ... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_partition_and_heal_register_rpc_on_two_nodes" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_register_rpc_on_two_nodes&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.227:8181/restconf/operations/odl-mdsal-lowlevel-control:register-bound-constant ------------------------------------------------------------------------------ Invoke_Rpc_On_Each_Node :: Invoke get-contexted-constant rpc on ev... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node&order=bug_status" Keyword 'Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: HTTPError: 404 Client Error: Not Found for url: http://10.30.171.227:8181/restconf/operations/odl-mdsal-lowlevel-target:get-contexted-constant ------------------------------------------------------------------------------ Isolate_One_Node :: Isolate one node with registered rpc. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_partition_and_heal_isolate_one_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_isolate_one_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Invoke_Rpc_On_Remaining_Nodes :: Invoke rpc on non-islolated nodes... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_remaining_nodes" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_remaining_nodes&order=bug_status" Keyword 'DrbCommons.Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 1 minute. The last error was: Keyword 'Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: HTTPError: 404 Client Error: Not Found for url: http://10.30.171.227:8181/restconf/operations/odl-mdsal-lowlevel-target:get-contexted-constant ------------------------------------------------------------------------------ Rejoin_Isolated_Member :: Rejoin isolated node | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_partition_and_heal_rejoin_isolated_member" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_rejoin_isolated_member&order=bug_status" Variable '${isolated_idx}' not found. ------------------------------------------------------------------------------ Invoke_Rpc_On_Each_Node_Again :: Invoke rpc get-contexted-constant... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node_again" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node_again&order=bug_status" Keyword 'Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: HTTPError: 404 Client Error: Not Found for url: http://10.30.171.227:8181/restconf/operations/odl-mdsal-lowlevel-target:get-contexted-constant ------------------------------------------------------------------------------ Unregister_Rpc_On_Each_Node :: Inregister rpc on both nodes. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_partition_and_heal_unregister_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_unregister_rpc_on_each_node&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.227:8181/restconf/operations/odl-mdsal-lowlevel-control:unregister-bound-constant ------------------------------------------------------------------------------ controller-clustering-ask.txt.Action Provider Partition And Heal :... | FAIL | 7 tests, 0 passed, 7 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Master Stability :: Cluster Singleton testing... ============================================================================== Register_Singleton_Constant_On_Each_Node_And_Verify :: Register a ... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_master_stability_register_singleton_constant_on_each_node_and_verify" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_register_singleton_constant_on_each_node_and_verify&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.227:8181/restconf/operations/odl-mdsal-lowlevel-control:register-singleton-constant ------------------------------------------------------------------------------ Unregister_Singleton_Constant_On_Non_Master_Node :: Unregister the... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_non_master_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_non_master_node&order=bug_status" Variable '@{cs_candidates}' not found. Did you mean: @{cs_exp_candidates} ------------------------------------------------------------------------------ Monitor_Stability_While_Unregistered :: Verify that the owner rema... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_master_stability_monitor_stability_while_unregistered" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_monitor_stability_while_unregistered&order=bug_status" Variable '${cs_owner}' not found. ------------------------------------------------------------------------------ Reregister_Singleton_Constant :: Re-register the unregistered cand... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_master_stability_reregister_singleton_constant" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_reregister_singleton_constant&order=bug_status" Variable '${unregistered_node}' not found. ------------------------------------------------------------------------------ Verify_Stability_After_Reregistration :: Verify that the owner rem... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_master_stability_verify_stability_after_reregistration" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_verify_stability_after_reregistration&order=bug_status" Variable '${cs_owner}' not found. ------------------------------------------------------------------------------ Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_each_node&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.227:8181/restconf/operations/odl-mdsal-lowlevel-control:unregister-singleton-constant ------------------------------------------------------------------------------ controller-clustering-ask.txt.Master Stability :: Cluster Singleto... | FAIL | 6 tests, 0 passed, 6 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Partition And Heal :: Cluster Singleton testi... ============================================================================== Register_Singleton_Constant_On_Each_Node :: Register a candidate a... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_partition_and_heal_register_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_register_singleton_constant_on_each_node&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.227:8181/restconf/operations/odl-mdsal-lowlevel-control:register-singleton-constant ------------------------------------------------------------------------------ Verify_Singleton_Constant_On_Each_Node :: Store the owner and cand... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_partition_and_heal_verify_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_verify_singleton_constant_on_each_node&order=bug_status" Could not parse owner and candidates for device get-singleton-constant-service'] ------------------------------------------------------------------------------ Isolate_Owner_Node :: Isolate the cluster node which is the owner.... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_partition_and_heal_isolate_owner_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_isolate_owner_node&order=bug_status" Variable '${cs_owner}' not found. ------------------------------------------------------------------------------ Monitor_Stability_While_Isolated :: Monitor the stability of the s... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_partition_and_heal_monitor_stability_while_isolated" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_monitor_stability_while_isolated&order=bug_status" Invalid IF condition: Evaluating expression '"${index}" == "${cs_isolated_index}"' failed: Variable '${cs_isolated_index}' not found. ------------------------------------------------------------------------------ Rejoin_Isolated_node :: Rejoin isolated node. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_partition_and_heal_rejoin_isolated_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_rejoin_isolated_node&order=bug_status" Variable '${cs_isolated_index}' not found. ------------------------------------------------------------------------------ Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_partition_and_heal_unregister_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_unregister_singleton_constant_on_each_node&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.227:8181/restconf/operations/odl-mdsal-lowlevel-control:unregister-singleton-constant ------------------------------------------------------------------------------ controller-clustering-ask.txt.Partition And Heal :: Cluster Single... | FAIL | 6 tests, 0 passed, 6 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Chasing The Leader :: Cluster Singleton testi... ============================================================================== Register_Candidates :: Register a candidate application on each no... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_chasing_the_leader_register_candidates" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_chasing_the_leader_register_candidates&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.227:8181/restconf/operations/odl-mdsal-lowlevel-control:register-flapping-singleton ------------------------------------------------------------------------------ Do_Nothing :: Do nothing for the time of the test duration, becaus... | PASS | ------------------------------------------------------------------------------ Unregister_Candidates_And_Validate_Criteria :: Unregister the test... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_chasing_the_leader_unregister_candidates_and_validate_criteria" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_chasing_the_leader_unregister_candidates_and_validate_criteria&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.227:8181/restconf/operations/odl-mdsal-lowlevel-control:unregister-flapping-singleton ------------------------------------------------------------------------------ controller-clustering-ask.txt.Chasing The Leader :: Cluster Single... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Global Rpc Kill :: Controller functional HA t... ============================================================================== Get_Basic_Rpc_Test_Owner :: Find a service owner and successors. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_Before_Stopping_On_Owner :: Run rpc on the service owner. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_Before_Stop_On_Successors :: Run rpc on non owher cluster nodes. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Stop_Current_Owner_Member :: Stop cluster node which is the owner. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Verify_New_Basic_Rpc_Test_Owner_Elected :: Verify new owner of the... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_On_Remained_Cluster_Nodes :: Run rpc on remained cluster nodes. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Restart_Stopped_Member :: Restart stopped node | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Verify_New_Owner_Remained_After_Rejoin :: Verify no owner change h... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_New_Owner :: Run rpc on the new service owner ... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_Old_Owner :: Run rpc on rejoined cluster node. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_All :: Run rpc again on all nodes. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ controller-clustering-ask.txt.Global Rpc Kill :: Controller functi... | FAIL | Suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . 11 tests, 0 passed, 11 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Global Rpc Freeze :: Controller functional HA... ============================================================================== Get_Basic_Rpc_Test_Owner :: Find a service owner and successors. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_Before_Freezing_On_Owner :: Run rpc on the service owner. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_Before_Freeze_On_Successors :: Run rpc on non owher cluster no... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Freeze_Current_Owner_Member :: Stop cluster node which is the owner. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Verify_New_Basic_Rpc_Test_Owner_Elected :: Verify new owner of the... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_On_Remained_Cluster_Nodes :: Run rpc on remained cluster nodes. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Unfreeze_Frozen_Member :: Restart frozen node | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_New_Owner :: Run rpc on the new service owner ... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_Old_Owner :: Run rpc on rejoined cluster node. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_All :: Run rpc again on all nodes. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ controller-clustering-ask.txt.Global Rpc Freeze :: Controller func... | FAIL | Suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . 10 tests, 0 passed, 10 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Global Rpc Isolate :: Controller functional H... ============================================================================== Get_Basic_Rpc_Test_Owner :: Find a service owner and successors. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_Before_Isolation_On_Owner :: Run rpc on the service owner. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_Before_Isolation_On_Successors :: Run rpc on non owher cluster... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Isolate_Current_Owner_Member :: Isolating cluster node which is th... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Verify_New_Basic_Rpc_Test_Owner_Elected :: Verify new owner of the... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_On_Isolated_Node :: Run rpc on isolated cluster node. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_On_Non_Isolated_Cluster_Nodes :: Run rpc on remained cluster n... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rejoin_Isolated_Member :: Rejoin isolated node | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_New_Owner :: Run rpc on the new service owner ... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_Old_Owner :: Run rpc on rejoined cluster node. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_All :: Run rpc again on all nodes. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ controller-clustering-ask.txt.Global Rpc Isolate :: Controller fun... | FAIL | Suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . 11 tests, 0 passed, 11 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Carpeople Crud :: Suite for performing basic ... ============================================================================== [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. Add_Cars_To_Leader :: Add 30 cars to car Leader by one big PUT. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Added_Cars_On_Leader :: GET response from Leader should match ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Added_Cars_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Add_People_To_First_Follower :: Add 30 people to people first Foll... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Added_People_On_Leader :: GET response from Leader should matc... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Added_People_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Leader :: Buy some cars on car-people Leader, loop of ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Followers :: On each Follower buy corresponding ID seg... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Added_CarPeople_On_Leader :: GET car-person mappings from Lead... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Added_CarPeople_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_CarPeople_On_Leader :: DELETE car-people container. No ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_People_On_Leader :: DELETE people container. No verific... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_Cars_On_Leader :: DELETE cars container. No verificatio... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Carpeople Crud :: Suite for performi... | FAIL | Suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) 13 tests, 0 passed, 13 failed ============================================================================== controller-clustering-ask.txt.Car Failover Crud :: Suite mixing basic opera... ============================================================================== [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Stop_Original_Car_Leader :: Stop the car Leader to cause a new lea... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Start_Old_Car_Leader :: Start the stopped member without deleting ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Car Failover Crud :: Suite mixing ba... | FAIL | Suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) 16 tests, 0 passed, 16 failed ============================================================================== controller-clustering-ask.txt.Car Persistence Recovery :: This test restart... ============================================================================== [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. Add_Cars_On_Leader_And_Verify :: Single big PUT to datastore to ad... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Stop_All_Members :: Stop all controllers. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Start_All_Members :: Start all controllers (should restore the per... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Memorize_Leader_And_Followers :: Locate current Leader of car Shard. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Cars_On_Leader :: GET cars from Leader, should match the PUT d... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Cars_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_Cars_On_Leader :: Delete cars on the new Leader. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Car Persistence Recovery :: This tes... | FAIL | Suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) 7 tests, 0 passed, 7 failed ============================================================================== controller-clustering-ask.txt.Buycar Failover :: This test focuses on testi... ============================================================================== [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Reboot_People_Leader :: Previous people Leader is rebooted. We sho... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Leader_After_Reboot_And_Verify :: Buy some cars on the... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Follower_After_Reboot_And_Verify :: Buy some cars on t... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_People :: DELETE people container. No verification beyo... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Buycar Failover :: This test focuses... | FAIL | Suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) 10 tests, 0 passed, 10 failed ============================================================================== controller-clustering-ask.txt.Entity Isolate :: Suite for performing member... ============================================================================== [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. Check All Shards Before Isolate :: Check all shards in controller. | FAIL | Parent suite setup failed: Dictionary does not contain key 'value'. ------------------------------------------------------------------------------ Isolate Entity Leader :: Isolate the entity-ownership Leader to ca... | FAIL | Parent suite setup failed: Dictionary does not contain key 'value'. ------------------------------------------------------------------------------ Check All Shards After Isolate :: Check all shards in controller. | FAIL | Parent suite setup failed: Dictionary does not contain key 'value'. ------------------------------------------------------------------------------ Rejoin Entity Leader :: Rejoin the entity-ownership Leader. | FAIL | Parent suite setup failed: Dictionary does not contain key 'value'. ------------------------------------------------------------------------------ Check All Shards After Rejoin :: Check all shards in controller. | FAIL | Parent suite setup failed: Dictionary does not contain key 'value'. ------------------------------------------------------------------------------ controller-clustering-ask.txt.Entity Isolate :: Suite for performi... | FAIL | Suite setup failed: Dictionary does not contain key 'value'. 5 tests, 0 passed, 5 failed ============================================================================== controller-clustering-ask.txt.Buycar Failover Isolation :: This test focuse... ============================================================================== [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Isolate_and_Rejoin_People_Leader :: Previous people Leader is isol... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Leader_After_Rejoin_And_Verify :: Buy some cars on the... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Follower_After_Rejoin_And_Verify :: Buy some cars on t... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_People :: DELETE people container. No verification beyo... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Buycar Failover Isolation :: This te... | FAIL | Suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) 10 tests, 0 passed, 10 failed ============================================================================== controller-clustering-ask.txt.Car Failover Crud Isolation :: Suite mixing b... ============================================================================== [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Isolate_Original_Car_Leader :: Isolate the car Leader to cause a n... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Rejoin_Old_Car_Leader :: Rejoin the isolated member without deleti... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Car Failover Crud Isolation :: Suite... | FAIL | Suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) 16 tests, 0 passed, 16 failed ============================================================================== controller-clustering-ask.txt.Car Outage Corners :: Cluster suite for testi... ============================================================================== [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. Stop_Majority_Of_The_Followers :: Stop half plus one car Follower ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Attempt_To_Add_Cars_To_Leader :: Adding cars should fail, as major... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Start_Tipping_Follower :: Start one Follower member without persis... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Add_Cars_On_Tipping_Follower :: Add cars on the tipping Follower. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Cars_On_Existing_Members :: On each up member: GET cars, shoul... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Start_Other_Followers :: Start other followers without persisted d... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Cars_On_New_Follower_Leader :: GET cars from a new follower to... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_Cars_On_Leader :: Delete cars on Leader. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Car Outage Corners :: Cluster suite ... | FAIL | Suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.189', port=8181): Read timed out. (read timeout=5.0) 8 tests, 0 passed, 8 failed ============================================================================== controller-clustering-ask.txt | FAIL | 195 tests, 14 passed, 181 failed ============================================================================== Output: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/output.xml Log: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/log.html Report: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/report.html + true + echo 'Examining the files in data/log and checking filesize' Examining the files in data/log and checking filesize + ssh 10.30.171.227 'ls -altr /tmp/karaf-0.20.0-SNAPSHOT/data/log/' Warning: Permanently added '10.30.171.227' (ECDSA) to the list of known hosts. total 17476 drwxrwxr-x. 2 jenkins jenkins 48 Feb 17 23:44 . -rw-rw-r--. 1 jenkins jenkins 1720 Feb 17 23:44 karaf_console.log drwxrwxr-x. 9 jenkins jenkins 149 Feb 18 03:05 .. -rw-rw-r--. 1 jenkins jenkins 13743484 Feb 18 03:20 karaf.log + ssh 10.30.171.227 'du -hs /tmp/karaf-0.20.0-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.171.227' (ECDSA) to the list of known hosts. 4.0K /tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf_console.log 18M /tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf.log + ssh 10.30.171.218 'ls -altr /tmp/karaf-0.20.0-SNAPSHOT/data/log/' Warning: Permanently added '10.30.171.218' (ECDSA) to the list of known hosts. total 19140 drwxrwxr-x. 2 jenkins jenkins 48 Feb 17 23:44 . -rw-rw-r--. 1 jenkins jenkins 1720 Feb 17 23:44 karaf_console.log drwxrwxr-x. 9 jenkins jenkins 149 Feb 18 03:06 .. -rw-rw-r--. 1 jenkins jenkins 15454300 Feb 18 03:20 karaf.log + ssh 10.30.171.218 'du -hs /tmp/karaf-0.20.0-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.171.218' (ECDSA) to the list of known hosts. 4.0K /tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf_console.log 19M /tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf.log + ssh 10.30.170.189 'ls -altr /tmp/karaf-0.20.0-SNAPSHOT/data/log/' Warning: Permanently added '10.30.170.189' (ECDSA) to the list of known hosts. total 7516 drwxrwxr-x. 2 jenkins jenkins 48 Feb 17 23:44 . -rw-rw-r--. 1 jenkins jenkins 158399 Feb 18 00:13 karaf_console.log drwxrwxr-x. 4 jenkins jenkins 28 Feb 18 03:05 .. -rw-rw-r--. 1 jenkins jenkins 7438236 Feb 18 03:20 karaf.log + ssh 10.30.170.189 'du -hs /tmp/karaf-0.20.0-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.170.189' (ECDSA) to the list of known hosts. 156K /tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf_console.log 7.2M /tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf.log + set +e ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.171.227 'sudo ps aux' Warning: Permanently added '10.30.171.227' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-calcium/ps_after.log ++ grep -v grep ++ cut -f2 '-d ' ++ tr -s ' ' + pid=30946 + echo 'karaf main: org.apache.karaf.main.Main, pid:30946' karaf main: org.apache.karaf.main.Main, pid:30946 + ssh 10.30.171.227 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 30946' Warning: Permanently added '10.30.171.227' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.171.227 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.171.227' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.171.218 'sudo ps aux' Warning: Permanently added '10.30.171.218' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-calcium/ps_after.log ++ grep -v grep ++ tr -s ' ' ++ cut -f2 '-d ' + pid=29397 + echo 'karaf main: org.apache.karaf.main.Main, pid:29397' karaf main: org.apache.karaf.main.Main, pid:29397 + ssh 10.30.171.218 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 29397' Warning: Permanently added '10.30.171.218' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.171.218 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.171.218' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.170.189 'sudo ps aux' Warning: Permanently added '10.30.170.189' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-calcium/ps_after.log ++ grep -v grep ++ cut -f2 '-d ' ++ tr -s ' ' + pid=5788 + echo 'karaf main: org.apache.karaf.main.Main, pid:5788' karaf main: org.apache.karaf.main.Main, pid:5788 + ssh 10.30.170.189 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5788' Warning: Permanently added '10.30.170.189' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.170.189 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.170.189' (ECDSA) to the list of known hosts. + sleep 5 ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Compressing karaf.log 1' Compressing karaf.log 1 + ssh 10.30.171.227 gzip --best /tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.171.227' (ECDSA) to the list of known hosts. + echo 'Fetching compressed karaf.log 1' Fetching compressed karaf.log 1 + scp 10.30.171.227:/tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf.log.gz odl1_karaf.log.gz Warning: Permanently added '10.30.171.227' (ECDSA) to the list of known hosts. + ssh 10.30.171.227 rm -f /tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.171.227' (ECDSA) to the list of known hosts. + scp 10.30.171.227:/tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf_console.log odl1_karaf_console.log Warning: Permanently added '10.30.171.227' (ECDSA) to the list of known hosts. + ssh 10.30.171.227 rm -f /tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.171.227' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-1 + scp '10.30.171.227:/tmp/karaf-0.20.0-SNAPSHOT/data/log/*.log' gclogs-1/ Warning: Permanently added '10.30.171.227' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.20.0-SNAPSHOT/data/log/*.log: No such file or directory + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Compressing karaf.log 2' Compressing karaf.log 2 + ssh 10.30.171.218 gzip --best /tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.171.218' (ECDSA) to the list of known hosts. + echo 'Fetching compressed karaf.log 2' Fetching compressed karaf.log 2 + scp 10.30.171.218:/tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf.log.gz odl2_karaf.log.gz Warning: Permanently added '10.30.171.218' (ECDSA) to the list of known hosts. + ssh 10.30.171.218 rm -f /tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.171.218' (ECDSA) to the list of known hosts. + scp 10.30.171.218:/tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf_console.log odl2_karaf_console.log Warning: Permanently added '10.30.171.218' (ECDSA) to the list of known hosts. + ssh 10.30.171.218 rm -f /tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.171.218' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-2 + scp '10.30.171.218:/tmp/karaf-0.20.0-SNAPSHOT/data/log/*.log' gclogs-2/ Warning: Permanently added '10.30.171.218' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.20.0-SNAPSHOT/data/log/*.log: No such file or directory + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Compressing karaf.log 3' Compressing karaf.log 3 + ssh 10.30.170.189 gzip --best /tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.170.189' (ECDSA) to the list of known hosts. + echo 'Fetching compressed karaf.log 3' Fetching compressed karaf.log 3 + scp 10.30.170.189:/tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf.log.gz odl3_karaf.log.gz Warning: Permanently added '10.30.170.189' (ECDSA) to the list of known hosts. + ssh 10.30.170.189 rm -f /tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.170.189' (ECDSA) to the list of known hosts. + scp 10.30.170.189:/tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf_console.log odl3_karaf_console.log Warning: Permanently added '10.30.170.189' (ECDSA) to the list of known hosts. + ssh 10.30.170.189 rm -f /tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.170.189' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-3 + scp '10.30.170.189:/tmp/karaf-0.20.0-SNAPSHOT/data/log/*.log' gclogs-3/ Warning: Permanently added '10.30.170.189' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.20.0-SNAPSHOT/data/log/*.log: No such file or directory + echo 'Examine copied files' Examine copied files + ls -lt total 55180 drwxrwxr-x. 2 jenkins jenkins 6 Feb 18 03:21 gclogs-3 -rw-rw-r--. 1 jenkins jenkins 158399 Feb 18 03:21 odl3_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 313029 Feb 18 03:21 odl3_karaf.log.gz drwxrwxr-x. 2 jenkins jenkins 6 Feb 18 03:21 gclogs-2 -rw-rw-r--. 1 jenkins jenkins 1720 Feb 18 03:21 odl2_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 1044875 Feb 18 03:21 odl2_karaf.log.gz drwxrwxr-x. 2 jenkins jenkins 6 Feb 18 03:21 gclogs-1 -rw-rw-r--. 1 jenkins jenkins 1720 Feb 18 03:21 odl1_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 961425 Feb 18 03:21 odl1_karaf.log.gz -rw-rw-r--. 1 jenkins jenkins 131355 Feb 18 03:21 karaf_3_5788_threads_after.log -rw-rw-r--. 1 jenkins jenkins 15742 Feb 18 03:21 ps_after.log -rw-rw-r--. 1 jenkins jenkins 123757 Feb 18 03:21 karaf_2_29397_threads_after.log -rw-rw-r--. 1 jenkins jenkins 123890 Feb 18 03:21 karaf_1_30946_threads_after.log -rw-rw-r--. 1 jenkins jenkins 304176 Feb 18 03:21 report.html -rw-rw-r--. 1 jenkins jenkins 3587010 Feb 18 03:21 log.html -rw-rw-r--. 1 jenkins jenkins 49186398 Feb 18 03:20 output.xml -rw-rw-r--. 1 jenkins jenkins 4091 Feb 17 23:45 testplan.txt -rw-rw-r--. 1 jenkins jenkins 144067 Feb 17 23:45 karaf_3_5788_threads_before.log -rw-rw-r--. 1 jenkins jenkins 16520 Feb 17 23:45 ps_before.log -rw-rw-r--. 1 jenkins jenkins 142714 Feb 17 23:45 karaf_2_5807_threads_before.log -rw-rw-r--. 1 jenkins jenkins 145460 Feb 17 23:45 karaf_1_5799_threads_before.log -rw-rw-r--. 1 jenkins jenkins 3106 Feb 17 23:44 post-startup-script.sh -rw-rw-r--. 1 jenkins jenkins 252 Feb 17 23:44 startup-script.sh -rw-rw-r--. 1 jenkins jenkins 3455 Feb 17 23:44 configuration-script.sh -rw-rw-r--. 1 jenkins jenkins 695 Feb 17 23:44 custom_shard_config.txt -rw-rw-r--. 1 jenkins jenkins 134 Feb 17 23:44 scriptplan.txt -rw-rw-r--. 1 jenkins jenkins 337 Feb 17 23:43 detect_variables.env -rw-rw-r--. 1 jenkins jenkins 2620 Feb 17 23:43 pom.xml -rw-rw-r--. 1 jenkins jenkins 86 Feb 17 23:43 set_variables.env -rw-rw-r--. 1 jenkins jenkins 314 Feb 17 23:43 slave_addresses.txt -rw-rw-r--. 1 jenkins jenkins 570 Feb 17 23:43 requirements.txt -rw-rw-r--. 1 jenkins jenkins 26 Feb 17 23:43 env.properties -rw-rw-r--. 1 jenkins jenkins 335 Feb 17 23:41 stack-parameters.yaml drwxrwxr-x. 7 jenkins jenkins 4096 Feb 17 23:39 test drwxrwxr-x. 2 jenkins jenkins 6 Feb 17 23:39 test@tmp -rw-rw-r--. 1 jenkins jenkins 1410 Jan 26 21:31 maven-metadata.xml + true [controller-csit-3node-clustering-ask-all-calcium] $ /bin/sh /tmp/jenkins3726416403366239799.sh Cleaning up Robot installation... $ ssh-agent -k unset SSH_AUTH_SOCK; unset SSH_AGENT_PID; echo Agent pid 5336 killed; [ssh-agent] Stopped. Recording plot data Robot results publisher started... INFO: Checking test criticality is deprecated and will be dropped in a future release! -Parsing output xml: Done! -Copying log files to build dir: Done! -Assigning results to build: Done! -Checking thresholds: Done! Done publishing Robot results. Build step 'Publish Robot Framework test results' changed build result to UNSTABLE [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins17700457554347066517.sh Archiving csit artifacts mv: cannot stat '*_1.png': No such file or directory mv: cannot stat '/tmp/odl1_*': No such file or directory mv: cannot stat '*_2.png': No such file or directory mv: cannot stat '/tmp/odl2_*': No such file or directory mv: cannot stat '*_3.png': No such file or directory mv: cannot stat '/tmp/odl3_*': No such file or directory % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 3432k 0 3432k 0 0 4366k 0 --:--:-- --:--:-- --:--:-- 4360k 100 4712k 0 4712k 0 0 4620k 0 --:--:-- 0:00:01 --:--:-- 4620k Archive: robot-plugin.zip inflating: ./archives/robot-plugin/log.html inflating: ./archives/robot-plugin/output.xml inflating: ./archives/robot-plugin/report.html mv: cannot stat '*.log.gz': No such file or directory mv: cannot stat '*.csv': No such file or directory mv: cannot stat '*.png': No such file or directory [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins9500347717502356644.sh [PostBuildScript] - [INFO] Executing post build scripts. [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_CLOUD=vex OS_STACK_NAME=releng-controller-csit-3node-clustering-ask-all-calcium-23 [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins17273344147784667116.sh ---> openstack-stack-delete.sh Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-9zTA from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient lf-activate-venv(): INFO: Adding /tmp/venv-9zTA/bin to PATH INFO: Retrieving stack cost for: releng-controller-csit-3node-clustering-ask-all-calcium-23 DEBUG: Successfully retrieved stack cost: total: 1.32 INFO: Deleting stack releng-controller-csit-3node-clustering-ask-all-calcium-23 Successfully deleted stack releng-controller-csit-3node-clustering-ask-all-calcium-23 [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins6929026678503328707.sh ---> sysstat.sh [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins12241871114998398819.sh ---> package-listing.sh ++ facter osfamily ++ tr '[:upper:]' '[:lower:]' + OS_FAMILY=redhat + workspace=/w/workspace/controller-csit-3node-clustering-ask-all-calcium + START_PACKAGES=/tmp/packages_start.txt + END_PACKAGES=/tmp/packages_end.txt + DIFF_PACKAGES=/tmp/packages_diff.txt + PACKAGES=/tmp/packages_start.txt + '[' /w/workspace/controller-csit-3node-clustering-ask-all-calcium ']' + PACKAGES=/tmp/packages_end.txt + case "${OS_FAMILY}" in + rpm -qa + sort + '[' -f /tmp/packages_start.txt ']' + '[' -f /tmp/packages_end.txt ']' + diff /tmp/packages_start.txt /tmp/packages_end.txt + '[' /w/workspace/controller-csit-3node-clustering-ask-all-calcium ']' + mkdir -p /w/workspace/controller-csit-3node-clustering-ask-all-calcium/archives/ + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/controller-csit-3node-clustering-ask-all-calcium/archives/ [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins2046860816496791141.sh ---> capture-instance-metadata.sh Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-9zTA from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-9zTA/bin to PATH INFO: Running in OpenStack, capturing instance metadata [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins2765557066092600604.sh provisioning config files... Could not find credentials [logs] for controller-csit-3node-clustering-ask-all-calcium #23 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/controller-csit-3node-clustering-ask-all-calcium@tmp/config8542735308807925349tmp Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] Run condition [Regular expression match] enabling perform for step [Provide Configuration files] provisioning config files... copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content SERVER_ID=logs [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins2868599255843919757.sh ---> create-netrc.sh WARN: Log server credential not found. [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins13856726901943399312.sh ---> python-tools-install.sh Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-9zTA from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-9zTA/bin to PATH [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins17700643636277925479.sh ---> sudo-logs.sh Archiving 'sudo' log.. [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins10773708519986253670.sh ---> job-cost.sh Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-9zTA from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. lftools 0.37.8 requires openstacksdk<1.5.0, but you have openstacksdk 2.1.0 which is incompatible. lf-activate-venv(): INFO: Adding /tmp/venv-9zTA/bin to PATH DEBUG: total: 1.32 INFO: Retrieving Stack Cost... INFO: Retrieving Pricing Info for: v3-standard-2 INFO: Archiving Costs [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash -l /tmp/jenkins4613819337502989937.sh ---> logs-deploy.sh Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-9zTA from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. python-openstackclient 6.5.0 requires openstacksdk>=2.0.0, but you have openstacksdk 1.4.0 which is incompatible. lf-activate-venv(): INFO: Adding /tmp/venv-9zTA/bin to PATH WARNING: Nexus logging server not set INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/controller-csit-3node-clustering-ask-all-calcium/23/ INFO: archiving logs to S3 ---> uname -a: Linux prd-centos8-robot-2c-8g-7626.novalocal 4.18.0-532.el8.x86_64 #1 SMP Thu Dec 21 12:11:59 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux ---> lscpu: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 1 Socket(s): 2 NUMA node(s): 1 Vendor ID: AuthenticAMD CPU family: 23 Model: 49 Model name: AMD EPYC-Rome Processor Stepping: 0 CPU MHz: 2800.000 BogoMIPS: 5600.00 Virtualization: AMD-V Hypervisor vendor: KVM Virtualization type: full L1d cache: 32K L1i cache: 32K L2 cache: 512K L3 cache: 16384K NUMA node0 CPU(s): 0,1 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities ---> nproc: 2 ---> df -h: Filesystem Size Used Avail Use% Mounted on devtmpfs 3.8G 0 3.8G 0% /dev tmpfs 3.8G 0 3.8G 0% /dev/shm tmpfs 3.8G 17M 3.8G 1% /run tmpfs 3.8G 0 3.8G 0% /sys/fs/cgroup /dev/vda1 40G 9.4G 31G 24% / tmpfs 770M 0 770M 0% /run/user/1001 ---> free -m: total used free shared buff/cache available Mem: 7697 650 4632 19 2414 6749 Swap: 1023 0 1023 ---> ip addr: 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: mtu 1458 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:97:d5:1e brd ff:ff:ff:ff:ff:ff altname enp0s3 altname ens3 inet 10.30.171.116/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0 valid_lft 72965sec preferred_lft 72965sec inet6 fe80::f816:3eff:fe97:d51e/64 scope link valid_lft forever preferred_lft forever ---> sar -b -r -n DEV: Linux 4.18.0-532.el8.x86_64 (prd-centos8-robot-2c-8g-7626.novalocal) 02/18/2024 _x86_64_ (2 CPU) 12:00:01 AM tps rtps wtps bread/s bwrtn/s 12:01:01 AM 0.90 0.02 0.88 0.13 192.29 12:02:01 AM 0.53 0.07 0.47 1.73 10.56 12:03:01 AM 0.25 0.00 0.25 0.00 9.65 12:04:01 AM 0.13 0.00 0.13 0.00 2.93 12:05:01 AM 0.13 0.00 0.13 0.00 4.68 12:06:01 AM 0.23 0.00 0.23 0.00 10.55 12:07:01 AM 0.18 0.03 0.15 4.53 10.80 12:08:01 AM 0.37 0.03 0.33 2.80 13.18 12:09:01 AM 0.27 0.00 0.27 0.00 17.10 12:10:01 AM 0.22 0.00 0.22 0.00 17.33 12:11:02 AM 0.27 0.00 0.27 0.00 13.00 12:12:01 AM 0.22 0.00 0.22 0.00 8.17 12:13:01 AM 0.13 0.00 0.13 0.00 16.81 12:14:01 AM 0.25 0.00 0.25 0.00 17.60 12:15:01 AM 0.18 0.00 0.18 0.00 2.27 12:16:01 AM 0.13 0.00 0.13 0.00 4.30 12:17:01 AM 0.22 0.00 0.22 0.00 2.42 12:18:01 AM 0.10 0.00 0.10 0.00 0.65 12:19:01 AM 0.12 0.00 0.12 0.00 3.62 12:20:01 AM 0.15 0.00 0.15 0.00 1.45 12:21:01 AM 0.25 0.00 0.25 0.00 9.12 12:22:01 AM 0.33 0.00 0.33 0.00 8.62 12:23:01 AM 0.20 0.00 0.20 0.00 17.06 12:24:01 AM 0.35 0.00 0.35 0.00 4.97 12:25:01 AM 0.35 0.00 0.35 0.00 3.97 12:26:01 AM 0.40 0.00 0.40 0.00 8.95 12:27:01 AM 0.20 0.00 0.20 0.00 41.47 12:28:01 AM 0.15 0.00 0.15 0.00 29.73 12:29:01 AM 0.18 0.00 0.18 0.00 16.93 12:30:00 AM 1.43 0.30 1.13 6.45 28.99 12:31:01 AM 0.38 0.00 0.38 0.00 16.50 12:32:01 AM 0.27 0.00 0.27 0.00 11.60 12:33:01 AM 0.13 0.00 0.13 0.00 15.34 12:34:01 AM 0.27 0.00 0.27 0.00 9.07 12:35:01 AM 0.27 0.00 0.27 0.00 18.26 12:36:01 AM 0.20 0.00 0.20 0.00 11.13 12:37:01 AM 0.28 0.00 0.28 0.00 27.90 12:38:01 AM 0.13 0.00 0.13 0.00 3.72 12:39:01 AM 0.12 0.00 0.12 0.00 1.32 12:40:01 AM 31.44 23.08 8.36 775.61 4221.54 12:41:01 AM 2.13 0.00 2.13 0.00 1881.02 12:42:01 AM 0.38 0.00 0.38 0.00 6.86 12:43:01 AM 0.37 0.00 0.37 0.00 4.50 12:44:01 AM 0.48 0.00 0.48 0.00 11.55 12:45:01 AM 0.42 0.00 0.42 0.00 6.15 12:46:01 AM 0.40 0.00 0.40 0.00 7.89 12:47:01 AM 0.20 0.00 0.20 0.00 8.82 12:48:01 AM 0.13 0.00 0.13 0.00 4.67 12:49:01 AM 0.13 0.00 0.13 0.00 6.00 12:50:01 AM 0.38 0.00 0.38 0.00 8.41 12:51:01 AM 0.33 0.00 0.33 0.00 10.65 12:52:01 AM 0.17 0.00 0.17 0.00 11.76 12:53:01 AM 0.20 0.00 0.20 0.00 13.45 12:54:01 AM 0.13 0.00 0.13 0.00 13.73 12:55:01 AM 0.13 0.00 0.13 0.00 13.75 12:56:01 AM 0.15 0.00 0.15 0.00 8.75 12:57:01 AM 0.38 0.00 0.38 0.00 19.00 12:58:01 AM 0.22 0.00 0.22 0.00 19.19 12:59:01 AM 0.27 0.00 0.27 0.00 6.23 01:00:01 AM 0.20 0.00 0.20 0.00 3.47 01:01:01 AM 0.23 0.03 0.20 0.27 5.11 01:02:01 AM 0.32 0.00 0.32 0.00 5.68 01:03:01 AM 0.23 0.00 0.23 0.00 6.01 01:04:01 AM 0.32 0.00 0.32 0.00 2.95 01:05:01 AM 0.32 0.00 0.32 0.00 9.05 01:06:01 AM 0.15 0.00 0.15 0.00 3.08 01:07:01 AM 0.20 0.00 0.20 0.00 5.75 01:08:01 AM 0.13 0.00 0.13 0.00 19.48 01:09:01 AM 0.18 0.00 0.18 0.00 2.13 01:10:01 AM 0.35 0.00 0.35 0.00 5.88 01:11:01 AM 0.28 0.00 0.28 0.00 39.54 01:12:02 AM 0.20 0.00 0.20 0.00 41.72 01:13:01 AM 0.12 0.00 0.12 0.00 2.85 01:14:01 AM 0.10 0.00 0.10 0.00 16.93 01:15:01 AM 0.12 0.00 0.12 0.00 6.93 01:16:01 AM 0.23 0.00 0.23 0.00 15.86 01:17:01 AM 0.23 0.00 0.23 0.00 14.35 01:18:01 AM 0.13 0.00 0.13 0.00 13.73 01:19:01 AM 0.13 0.00 0.13 0.00 13.76 01:20:01 AM 0.18 0.00 0.18 0.00 14.28 01:21:01 AM 0.15 0.00 0.15 0.00 7.51 01:22:01 AM 0.27 0.00 0.27 0.00 24.85 01:23:01 AM 0.43 0.00 0.43 0.00 6.08 01:24:01 AM 0.32 0.00 0.32 0.00 5.58 01:25:01 AM 0.18 0.00 0.18 0.00 1.87 01:26:01 AM 0.15 0.00 0.15 0.00 1.07 01:27:01 AM 0.15 0.00 0.15 0.00 3.95 01:28:01 AM 0.17 0.00 0.17 0.00 1.60 01:29:01 AM 0.12 0.00 0.12 0.00 6.67 01:30:01 AM 0.13 0.00 0.13 0.00 3.07 01:31:01 AM 0.30 0.00 0.30 0.00 8.75 01:32:01 AM 0.25 0.00 0.25 0.00 5.10 01:33:01 AM 0.13 0.00 0.13 0.00 4.80 01:34:01 AM 0.17 0.00 0.17 0.00 7.88 01:35:01 AM 0.15 0.00 0.15 0.00 12.93 01:36:01 AM 0.33 0.00 0.33 0.00 15.50 01:37:01 AM 0.23 0.00 0.23 0.00 11.48 01:38:01 AM 0.13 0.00 0.13 0.00 14.03 01:39:01 AM 0.15 0.00 0.15 0.00 8.01 01:40:01 AM 0.30 0.00 0.30 0.00 19.16 01:41:01 AM 0.18 0.00 0.18 0.00 24.29 01:42:01 AM 0.15 0.00 0.15 0.00 4.27 01:43:01 AM 0.15 0.00 0.15 0.00 1.88 01:44:01 AM 0.18 0.00 0.18 0.00 4.28 01:45:01 AM 0.30 0.00 0.30 0.00 4.12 01:46:01 AM 0.08 0.00 0.08 0.00 0.52 01:47:01 AM 0.25 0.00 0.25 0.00 5.85 01:48:01 AM 0.15 0.00 0.15 0.00 1.48 01:49:01 AM 0.23 0.00 0.23 0.00 9.08 01:50:01 AM 0.12 0.00 0.12 0.00 4.55 01:51:01 AM 0.22 0.00 0.22 0.00 5.91 01:52:01 AM 0.15 0.00 0.15 0.00 3.87 01:53:01 AM 0.13 0.00 0.13 0.00 8.27 01:54:01 AM 0.23 0.00 0.23 0.00 4.13 01:55:01 AM 0.22 0.00 0.22 0.00 18.45 01:56:02 AM 0.77 0.00 0.77 0.00 24.31 01:57:01 AM 0.59 0.00 0.59 0.00 18.90 01:58:01 AM 0.30 0.00 0.30 0.00 14.38 01:59:01 AM 0.50 0.00 0.50 0.00 17.31 02:00:01 AM 0.53 0.00 0.53 0.00 19.86 02:01:01 AM 0.48 0.00 0.48 0.00 18.16 02:02:01 AM 0.33 0.00 0.33 0.00 3.58 02:03:01 AM 0.33 0.00 0.33 0.00 6.37 02:04:01 AM 0.22 0.00 0.22 0.00 2.77 02:05:01 AM 0.17 0.00 0.17 0.00 2.02 02:06:01 AM 0.20 0.00 0.20 0.00 4.85 02:07:01 AM 0.13 0.00 0.13 0.00 0.92 02:08:01 AM 0.15 0.00 0.15 0.00 7.13 02:09:01 AM 0.17 0.00 0.17 0.00 5.60 02:10:01 AM 0.18 0.00 0.18 0.00 3.47 02:11:01 AM 0.27 0.00 0.27 0.00 3.38 02:12:01 AM 0.33 0.00 0.33 0.00 12.41 02:13:01 AM 0.23 0.00 0.23 0.00 14.65 02:14:01 AM 0.20 0.00 0.20 0.00 10.58 02:15:01 AM 0.47 0.00 0.47 0.00 18.98 02:16:01 AM 0.52 0.00 0.52 0.00 16.64 02:17:01 AM 0.52 0.00 0.52 0.00 16.03 02:18:01 AM 0.43 0.00 0.43 0.00 14.00 02:19:01 AM 0.28 0.00 0.28 0.00 21.75 02:20:01 AM 0.15 0.00 0.15 0.00 3.90 02:21:01 AM 0.27 0.00 0.27 0.00 3.22 02:22:01 AM 0.27 0.00 0.27 0.00 5.95 02:23:01 AM 0.15 0.00 0.15 0.00 1.62 02:24:01 AM 0.12 0.00 0.12 0.00 3.45 02:25:01 AM 0.12 0.00 0.12 0.00 1.18 02:26:01 AM 0.12 0.00 0.12 0.00 1.05 02:27:01 AM 0.18 0.00 0.18 0.00 8.96 02:28:01 AM 0.25 0.00 0.25 0.00 12.00 02:29:01 AM 0.20 0.00 0.20 0.00 10.93 02:30:01 AM 0.18 0.00 0.18 0.00 16.26 02:31:01 AM 0.18 0.00 0.18 0.00 14.60 02:32:01 AM 0.18 0.00 0.18 0.00 8.82 02:33:01 AM 0.15 0.00 0.15 0.00 14.53 02:34:01 AM 0.17 0.00 0.17 0.00 14.93 02:35:01 AM 0.23 0.00 0.23 0.00 19.86 02:36:01 AM 0.35 0.00 0.35 0.00 3.88 02:37:01 AM 0.17 0.00 0.17 0.00 2.15 02:38:01 AM 0.12 0.00 0.12 0.00 3.35 02:39:01 AM 0.15 0.00 0.15 0.00 1.45 02:40:01 AM 0.12 0.00 0.12 0.00 3.62 02:41:01 AM 0.30 0.00 0.30 0.00 3.55 02:42:01 AM 0.25 0.00 0.25 0.00 9.07 02:43:01 AM 0.20 0.00 0.20 0.00 7.22 02:44:01 AM 0.13 0.00 0.13 0.00 8.26 02:45:01 AM 0.17 0.00 0.17 0.00 14.16 02:46:01 AM 0.20 0.00 0.20 0.00 15.65 02:47:01 AM 0.22 0.00 0.22 0.00 12.68 02:48:01 AM 0.23 0.00 0.23 0.00 11.61 02:49:01 AM 0.18 0.00 0.18 0.00 17.20 02:50:01 AM 0.23 0.00 0.23 0.00 22.81 02:51:01 AM 0.52 0.00 0.52 0.00 10.91 02:52:01 AM 0.33 0.00 0.33 0.00 3.58 02:53:01 AM 0.32 0.00 0.32 0.00 5.88 02:54:01 AM 0.22 0.00 0.22 0.00 2.78 02:55:01 AM 0.17 0.00 0.17 0.00 1.73 02:56:01 AM 0.15 0.00 0.15 0.00 4.28 02:57:01 AM 0.18 0.00 0.18 0.00 2.02 02:58:01 AM 0.12 0.00 0.12 0.00 6.67 02:59:01 AM 0.30 0.00 0.30 0.00 8.93 03:00:01 AM 0.22 0.00 0.22 0.00 12.66 03:01:01 AM 0.20 0.00 0.20 0.00 15.39 03:02:01 AM 0.55 0.00 0.55 0.00 16.29 03:03:02 AM 0.62 0.00 0.62 0.00 19.03 03:04:01 AM 0.51 0.00 0.51 0.00 15.84 03:05:01 AM 0.52 0.00 0.52 0.00 16.91 03:06:01 AM 0.35 0.00 0.35 0.00 22.03 03:07:01 AM 0.37 0.00 0.37 0.00 10.75 03:08:01 AM 0.12 0.00 0.12 0.00 1.33 03:09:01 AM 0.13 0.00 0.13 0.00 1.33 03:10:01 AM 0.17 0.00 0.17 0.00 4.38 03:11:01 AM 0.25 0.00 0.25 0.00 2.82 03:12:01 AM 0.25 0.00 0.25 0.00 6.56 03:13:01 AM 0.12 0.00 0.12 0.00 0.90 03:14:01 AM 0.15 0.00 0.15 0.00 7.20 03:15:01 AM 0.20 0.02 0.18 0.13 15.74 03:16:01 AM 0.15 0.00 0.15 0.00 14.13 03:17:01 AM 0.13 0.00 0.13 0.00 14.40 03:18:01 AM 0.12 0.00 0.12 0.00 13.61 03:19:01 AM 0.33 0.00 0.33 0.00 22.01 03:20:01 AM 0.18 0.00 0.18 0.00 15.21 03:21:01 AM 0.33 0.00 0.33 0.00 20.33 03:22:01 AM 13.98 0.22 13.76 31.59 942.40 Average: 0.48 0.12 0.36 4.08 45.86 12:00:01 AM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 12:01:01 AM 4978052 7005476 2904396 36.85 2688 2197060 749644 8.39 244616 2283956 8 12:02:01 AM 4978816 7006420 2903632 36.84 2688 2197240 732992 8.21 244660 2283664 28 12:03:01 AM 4978272 7006056 2904176 36.84 2688 2197420 732992 8.21 244664 2284088 12 12:04:01 AM 4978412 7006260 2904036 36.84 2688 2197484 732992 8.21 244664 2283900 20 12:05:01 AM 4978124 7006152 2904324 36.85 2688 2197672 732992 8.21 244672 2284256 104 12:06:01 AM 4977884 7006104 2904564 36.85 2688 2197856 732992 8.21 244676 2284488 40 12:07:01 AM 4976436 7005056 2906012 36.87 2688 2198256 733620 8.21 244676 2285904 32 12:08:01 AM 4976096 7005220 2906352 36.87 2688 2198768 734392 8.22 244716 2286236 196 12:09:01 AM 4975340 7004816 2907108 36.88 2688 2199112 734392 8.22 244716 2286944 140 12:10:01 AM 4975848 7005664 2906600 36.87 2688 2199452 733000 8.21 244716 2286396 4 12:11:02 AM 4975668 7005824 2906780 36.88 2688 2199816 733000 8.21 244716 2286672 32 12:12:01 AM 4974864 7005340 2907584 36.89 2688 2200120 733000 8.21 244716 2287452 168 12:13:01 AM 4973020 7004148 2909428 36.91 2688 2200780 733000 8.21 244716 2289312 364 12:14:01 AM 4973040 7004268 2909408 36.91 2688 2200864 733000 8.21 244716 2289412 12 12:15:01 AM 4973168 7004396 2909280 36.91 2688 2200864 733000 8.21 244716 2289304 12 12:16:01 AM 4973032 7004344 2909416 36.91 2688 2200948 733000 8.21 244716 2289684 4 12:17:01 AM 4972956 7004268 2909492 36.91 2688 2200948 733000 8.21 244716 2289364 4 12:18:01 AM 4973016 7004408 2909432 36.91 2688 2201028 733000 8.21 244716 2289444 88 12:19:01 AM 4972932 7004328 2909516 36.91 2688 2201032 733000 8.21 244716 2289448 4 12:20:01 AM 4974368 7005844 2908080 36.89 2688 2201112 726608 8.14 244716 2287808 100 12:21:01 AM 4972588 7004212 2909860 36.92 2688 2201260 726608 8.14 244716 2289804 60 12:22:01 AM 4972484 7004208 2909964 36.92 2688 2201368 726608 8.14 244716 2289788 16 12:23:01 AM 4972844 7005036 2909604 36.91 2688 2201828 726608 8.14 244720 2289564 4 12:24:01 AM 4972796 7005032 2909652 36.91 2688 2201872 726608 8.14 244720 2289608 4 12:25:01 AM 4972800 7005036 2909648 36.91 2688 2201872 726608 8.14 244720 2289676 4 12:26:01 AM 4972268 7004876 2910180 36.92 2688 2202288 726608 8.14 244720 2290096 272 12:27:01 AM 4970352 7004492 2912096 36.94 2688 2203816 726608 8.14 244720 2291928 636 12:28:01 AM 4970632 7005044 2911816 36.94 2688 2204048 726608 8.14 244720 2291792 4 12:29:01 AM 4970096 7004976 2912352 36.95 2688 2204516 726608 8.14 244720 2292276 4 12:30:00 AM 4970128 7005396 2912320 36.95 2688 2204904 743592 8.33 244816 2292300 4 12:31:01 AM 4968408 7004048 2914040 36.97 2688 2205284 743592 8.33 244816 2293964 16 12:32:01 AM 4968904 7004888 2913544 36.96 2688 2205628 743592 8.33 244816 2293528 96 12:33:01 AM 4966508 7002832 2915940 36.99 2688 2205976 743592 8.33 244816 2295996 24 12:34:01 AM 4965672 7002352 2916776 37.00 2688 2206324 743592 8.33 244816 2296804 188 12:35:01 AM 4965268 7002268 2917180 37.01 2688 2206668 743592 8.33 244816 2297128 88 12:36:01 AM 4964748 7002136 2917700 37.02 2688 2207032 743592 8.33 244816 2297380 180 12:37:01 AM 4964924 7002880 2917524 37.01 2688 2207604 743592 8.33 244816 2297552 4 12:38:01 AM 4964916 7002956 2917532 37.01 2688 2207676 743592 8.33 244816 2297640 4 12:39:01 AM 4964816 7002860 2917632 37.01 2688 2207680 743592 8.33 244816 2297644 4 12:40:01 AM 4773284 7000908 3109164 39.44 2688 2396968 728160 8.15 359400 2372588 55800 12:41:01 AM 4773632 7001260 3108816 39.44 2688 2396968 728160 8.15 359400 2372716 12 12:42:01 AM 4773500 7001212 3108948 39.44 2688 2397052 728160 8.15 359400 2372492 8 12:43:01 AM 4773336 7001048 3109112 39.44 2688 2397052 728160 8.15 359400 2372792 4 12:44:01 AM 4773920 7001804 3108528 39.44 2688 2397224 728160 8.15 359400 2373012 4 12:45:01 AM 4773760 7001696 3108688 39.44 2688 2397284 728160 8.15 359400 2373016 16 12:46:01 AM 4774068 7002204 3108380 39.43 2688 2397476 728160 8.15 359400 2373096 88 12:47:01 AM 4773728 7001968 3108720 39.44 2688 2397588 728160 8.15 359400 2373232 16 12:48:01 AM 4775068 7003416 3107380 39.42 2688 2397728 728160 8.15 359408 2371976 56 12:49:01 AM 4774896 7003388 3107552 39.42 2688 2397840 728160 8.15 359416 2372112 16 12:50:01 AM 4774468 7003064 3107980 39.43 2688 2397936 743164 8.32 359444 2372372 4 12:51:01 AM 4774528 7003392 3107920 39.43 2688 2398212 743104 8.32 359452 2372596 108 12:52:01 AM 4773088 7002304 3109360 39.45 2688 2398556 743104 8.32 359452 2374044 128 12:53:01 AM 4773768 7003328 3108680 39.44 2688 2398908 743104 8.32 359452 2373372 144 12:54:01 AM 4772516 7002420 3109932 39.45 2688 2399252 743104 8.32 359452 2374536 104 12:55:01 AM 4771456 7001720 3110992 39.47 2688 2399612 743104 8.32 359452 2375568 92 12:56:01 AM 4771136 7001752 3111312 39.47 2688 2399956 743104 8.32 359452 2375952 208 12:57:01 AM 4770592 7001496 3111856 39.48 2688 2400252 743104 8.32 359452 2376588 32 12:58:01 AM 4772064 7003480 3110384 39.46 2688 2400828 743104 8.32 359452 2375144 80 12:59:01 AM 4772100 7003592 3110348 39.46 2688 2400832 743104 8.32 359452 2375220 4 01:00:01 AM 4770724 7002216 3111724 39.48 2688 2400840 760500 8.52 359452 2375984 16 01:01:01 AM 4770904 7002492 3111544 39.47 2688 2400924 760500 8.52 359456 2375976 4 01:02:01 AM 4771936 7003524 3110512 39.46 2688 2400924 745084 8.34 359460 2375308 4 01:03:01 AM 4771508 7003176 3110940 39.47 2688 2401004 745084 8.34 359460 2375596 4 01:04:01 AM 4771624 7003296 3110824 39.47 2688 2401008 745084 8.34 359460 2375512 4 01:05:01 AM 4771356 7003200 3111092 39.47 2688 2401180 745084 8.34 359460 2375624 4 01:06:01 AM 4771148 7003056 3111300 39.47 2688 2401244 745084 8.34 359460 2375912 24 01:07:01 AM 4770652 7003072 3111796 39.48 2688 2401816 745084 8.34 359460 2376312 492 01:08:01 AM 4770384 7002924 3112064 39.48 2688 2401876 745084 8.34 359460 2376608 4 01:09:01 AM 4770896 7003436 3111552 39.47 2688 2401876 745084 8.34 359460 2376276 4 01:10:01 AM 4770584 7003164 3111864 39.48 2688 2401916 760488 8.52 359456 2376424 48 01:11:01 AM 4769836 7003624 3112612 39.49 2688 2403124 760488 8.52 359456 2377312 148 01:12:02 AM 4768432 7003264 3114016 39.51 2688 2404176 744296 8.33 359456 2378472 4 01:13:01 AM 4768512 7003516 3113936 39.50 2688 2404388 744296 8.33 359456 2378532 156 01:14:01 AM 4767888 7003420 3114560 39.51 2688 2404900 744296 8.33 359456 2379048 184 01:15:01 AM 4767456 7003196 3114992 39.52 2688 2405092 744296 8.33 359456 2379856 204 01:16:01 AM 4766276 7002376 3116172 39.53 2688 2405436 744296 8.33 359456 2380896 152 01:17:01 AM 4766800 7003228 3115648 39.53 2688 2405780 744296 8.33 359456 2380284 120 01:18:01 AM 4765892 7002688 3116556 39.54 2688 2406132 744296 8.33 359456 2381372 88 01:19:01 AM 4764576 7001708 3117872 39.55 2688 2406476 744296 8.33 359456 2382432 48 01:20:01 AM 4764068 7001568 3118380 39.56 2688 2406836 735476 8.24 359456 2382952 24 01:21:01 AM 4765548 7003648 3116900 39.54 2688 2407436 735476 8.24 359456 2381732 436 01:22:01 AM 4765244 7003584 3117204 39.55 2688 2407676 735476 8.24 359456 2381888 4 01:23:01 AM 4765024 7003364 3117424 39.55 2688 2407676 735476 8.24 359464 2382152 4 01:24:01 AM 4764704 7003124 3117744 39.55 2688 2407756 735476 8.24 359456 2382288 4 01:25:01 AM 4765044 7003464 3117404 39.55 2688 2407756 735476 8.24 359456 2382168 4 01:26:01 AM 4765092 7003516 3117356 39.55 2688 2407768 735476 8.24 359456 2382120 16 01:27:01 AM 4765108 7003616 3117340 39.55 2688 2407844 735476 8.24 359456 2382208 4 01:28:01 AM 4764892 7003400 3117556 39.55 2688 2407844 735476 8.24 359456 2382208 4 01:29:01 AM 4764456 7003148 3117992 39.56 2688 2408028 735476 8.24 359456 2382392 16 01:30:01 AM 4764332 7003160 3118116 39.56 2688 2408164 725540 8.12 359456 2382712 108 01:31:01 AM 4764676 7003572 3117772 39.55 2688 2408232 725540 8.12 359456 2382608 20 01:32:01 AM 4764344 7003340 3118104 39.56 2688 2408332 725540 8.12 359456 2382712 56 01:33:01 AM 4764160 7003212 3118288 39.56 2688 2408396 725540 8.12 359456 2383044 20 01:34:01 AM 4763584 7002840 3118864 39.57 2688 2408592 725540 8.12 359456 2383504 24 01:35:01 AM 4763236 7002844 3119212 39.57 2688 2408952 745144 8.34 359456 2383972 32 01:36:01 AM 4762024 7002000 3120424 39.59 2688 2409312 745144 8.34 359456 2385004 40 01:37:01 AM 4761576 7001880 3120872 39.59 2688 2409656 745144 8.34 359456 2385820 112 01:38:01 AM 4761052 7001716 3121396 39.60 2688 2410000 745144 8.34 359456 2386112 64 01:39:01 AM 4761516 7002532 3120932 39.59 2688 2410352 745144 8.34 359456 2385656 208 01:40:01 AM 4761572 7002940 3120876 39.59 2688 2410712 735332 8.23 359456 2385584 120 01:41:01 AM 4759988 7001940 3122460 39.61 2688 2411288 735332 8.23 359456 2387172 4 01:42:01 AM 4759996 7002020 3122452 39.61 2688 2411360 735332 8.23 359456 2387192 4 01:43:01 AM 4761032 7003056 3121416 39.60 2688 2411360 735332 8.23 359456 2386372 8 01:44:01 AM 4760400 7002508 3122048 39.61 2688 2411444 735332 8.23 359456 2386700 4 01:45:01 AM 4760380 7002488 3122068 39.61 2688 2411444 735332 8.23 359456 2386652 4 01:46:01 AM 4760504 7002692 3121944 39.61 2688 2411524 735332 8.23 359456 2386792 92 01:47:01 AM 4760540 7002732 3121908 39.61 2688 2411528 735332 8.23 359456 2386796 4 01:48:01 AM 4760204 7002536 3122244 39.61 2688 2411700 735332 8.23 359456 2386916 180 01:49:01 AM 4760344 7002756 3122104 39.61 2688 2411756 735332 8.23 359456 2386892 16 01:50:01 AM 4759588 7002116 3122860 39.62 2688 2411920 734544 8.22 359464 2387184 80 01:51:01 AM 4759748 7002392 3122700 39.62 2688 2411984 734544 8.22 359472 2387104 16 01:52:01 AM 4759668 7002388 3122780 39.62 2688 2412092 734544 8.22 359472 2387184 64 01:53:01 AM 4759328 7002272 3123120 39.62 2688 2412276 734544 8.22 359476 2387664 48 01:54:01 AM 4759356 7002528 3123092 39.62 2688 2412512 734544 8.22 359476 2387856 236 01:55:01 AM 4758464 7001992 3123984 39.63 2688 2412868 734184 8.22 359476 2388712 104 01:56:02 AM 4758200 7002040 3124248 39.64 2688 2413196 734972 8.23 369340 2379172 32 01:57:01 AM 4757948 7002164 3124500 39.64 2688 2413548 734972 8.23 369340 2379240 32 01:58:01 AM 4757780 7002344 3124668 39.64 2688 2413904 734972 8.23 369340 2379616 48 01:59:01 AM 4757132 7002044 3125316 39.65 2688 2414244 734972 8.23 369340 2380124 40 02:00:01 AM 4755936 7001524 3126512 39.66 2688 2414960 726548 8.14 369340 2381172 300 02:01:01 AM 4755956 7001688 3126492 39.66 2688 2415064 726548 8.14 369340 2381012 4 02:02:01 AM 4757180 7002912 3125268 39.65 2688 2415064 726548 8.14 369344 2380196 4 02:03:01 AM 4756604 7002420 3125844 39.66 2688 2415148 726548 8.14 369344 2380516 4 02:04:01 AM 4757036 7002852 3125412 39.65 2688 2415148 726548 8.14 369344 2380312 8 02:05:01 AM 4756628 7002452 3125820 39.66 2688 2415156 726548 8.14 369344 2380528 16 02:06:01 AM 4756788 7002692 3125660 39.65 2688 2415236 726548 8.14 369344 2380584 4 02:07:01 AM 4756804 7002708 3125644 39.65 2688 2415236 726548 8.14 369344 2380584 4 02:08:01 AM 4755700 7001784 3126748 39.67 2688 2415416 726548 8.14 369344 2381480 4 02:09:01 AM 4755256 7001476 3127192 39.67 2688 2415560 726548 8.14 369344 2381920 16 02:10:01 AM 4754912 7001156 3127536 39.68 2688 2415576 735760 8.24 369344 2382116 4 02:11:01 AM 4755368 7001656 3127080 39.67 2688 2415620 735760 8.24 369344 2381980 48 02:12:01 AM 4754644 7001128 3127804 39.68 2688 2415816 735760 8.24 369344 2382400 16 02:13:01 AM 4754464 7001328 3127984 39.68 2688 2416204 735760 8.24 369344 2382808 72 02:14:01 AM 4754228 7001432 3128220 39.69 2688 2416544 735760 8.24 369344 2383156 136 02:15:01 AM 4753256 7000796 3129192 39.70 2688 2416880 735760 8.24 369344 2383676 24 02:16:01 AM 4752436 7000324 3130012 39.71 2688 2417236 735760 8.24 369344 2384780 24 02:17:01 AM 4751564 6999776 3130884 39.72 2688 2417552 735760 8.24 369344 2385528 32 02:18:01 AM 4751412 6999960 3131036 39.72 2688 2417912 735760 8.24 369344 2385980 40 02:19:01 AM 4752124 7001248 3130324 39.71 2688 2418492 735760 8.24 369344 2384988 44 02:20:01 AM 4752104 7001300 3130344 39.71 2688 2418528 735760 8.24 369344 2385196 4 02:21:01 AM 4752060 7001256 3130388 39.71 2688 2418528 751136 8.41 369344 2385064 12 02:22:01 AM 4752300 7001576 3130148 39.71 2688 2418608 751136 8.41 369344 2385028 4 02:23:01 AM 4752168 7001448 3130280 39.71 2688 2418612 751136 8.41 369344 2385148 4 02:24:01 AM 4752264 7001624 3130184 39.71 2688 2418692 751136 8.41 369344 2385112 4 02:25:01 AM 4752052 7001412 3130396 39.71 2688 2418692 751136 8.41 369344 2385180 12 02:26:01 AM 4753884 7003420 3128564 39.69 2688 2418868 751136 8.41 369344 2383324 184 02:27:01 AM 4751820 7001516 3130628 39.72 2688 2419028 728052 8.15 369344 2385564 124 02:28:01 AM 4751156 7001076 3131292 39.72 2688 2419252 743780 8.33 369344 2386364 64 02:29:01 AM 4751296 7001568 3131152 39.72 2688 2419596 743780 8.33 369344 2385984 148 02:30:01 AM 4749928 7000544 3132520 39.74 2688 2419940 735544 8.24 369344 2387228 48 02:31:01 AM 4748960 6999932 3133488 39.75 2688 2420296 735544 8.24 369344 2388220 4 02:32:01 AM 4749588 7000880 3132860 39.74 2688 2420636 735544 8.24 369344 2387636 148 02:33:01 AM 4748540 7000192 3133908 39.76 2688 2420980 735544 8.24 369344 2388472 104 02:34:01 AM 4747580 6999936 3134868 39.77 2688 2421676 735544 8.24 369344 2389488 388 02:35:01 AM 4747548 7000032 3134900 39.77 2688 2421804 735544 8.24 369344 2389584 4 02:36:01 AM 4747712 7000196 3134736 39.77 2688 2421804 735544 8.24 369344 2389516 4 02:37:01 AM 4747696 7000260 3134752 39.77 2688 2421884 735544 8.24 369344 2389596 84 02:38:01 AM 4747476 7000040 3134972 39.77 2688 2421884 735544 8.24 369344 2389596 4 02:39:01 AM 4747536 7000100 3134912 39.77 2688 2421892 735544 8.24 369344 2389596 16 02:40:01 AM 4747344 6999992 3135104 39.77 2688 2421968 728792 8.16 369344 2389864 12 02:41:01 AM 4747552 7000204 3134896 39.77 2688 2421972 728792 8.16 369344 2389688 8 02:42:01 AM 4747100 6999940 3135348 39.78 2688 2422160 750136 8.40 369344 2390004 16 02:43:01 AM 4747064 7000072 3135384 39.78 2688 2422328 729556 8.17 369344 2390160 24 02:44:01 AM 4746576 6999908 3135872 39.78 2688 2422660 729556 8.17 369344 2390388 136 02:45:01 AM 4746276 6999972 3136172 39.79 2688 2423024 729556 8.17 369344 2390820 112 02:46:01 AM 4746080 7000108 3136368 39.79 2688 2423364 729556 8.17 369344 2391180 40 02:47:01 AM 4745780 7000152 3136668 39.79 2688 2423708 729556 8.17 369344 2391408 64 02:48:01 AM 4745004 6999708 3137444 39.80 2688 2424040 729556 8.17 369344 2392188 136 02:49:01 AM 4746224 7001284 3136224 39.79 2688 2424388 729556 8.17 369344 2390944 4 02:50:01 AM 4744796 7000476 3137652 39.81 2688 2425000 727412 8.14 369344 2392420 24 02:51:01 AM 4744704 7000512 3137744 39.81 2688 2425124 727412 8.14 369344 2392512 4 02:52:01 AM 4744692 7000500 3137756 39.81 2688 2425124 727412 8.14 369344 2392396 4 02:53:01 AM 4744540 7000428 3137908 39.81 2688 2425204 727412 8.14 369344 2392572 8 02:54:01 AM 4744492 7000380 3137956 39.81 2688 2425204 727412 8.14 369344 2392572 4 02:55:01 AM 4744228 7000196 3138220 39.81 2688 2425284 742792 8.32 369344 2392928 88 02:56:01 AM 4744320 7000292 3138128 39.81 2688 2425288 742792 8.32 369344 2392864 4 02:57:01 AM 4744428 7000400 3138020 39.81 2688 2425288 742792 8.32 369344 2392864 4 02:58:01 AM 4745144 7001332 3137304 39.80 2688 2425504 742792 8.32 369344 2392112 48 02:59:01 AM 4744704 7001028 3137744 39.81 2688 2425640 742792 8.32 369344 2392364 4 03:00:01 AM 4743828 7000552 3138620 39.82 2688 2426048 727268 8.14 369344 2393288 128 03:01:01 AM 4742204 6999292 3140244 39.84 2688 2426408 727268 8.14 369344 2394588 68 03:02:01 AM 4742616 6999976 3139832 39.83 2688 2426680 727268 8.14 369344 2394364 24 03:03:02 AM 4742856 7000552 3139592 39.83 2688 2427024 727268 8.14 369344 2394196 40 03:04:01 AM 4743192 7001232 3139256 39.83 2688 2427360 727268 8.14 369344 2393984 16 03:05:01 AM 4741924 7000316 3140524 39.84 2688 2427720 727268 8.14 369344 2395256 24 03:06:01 AM 4740556 6999512 3141892 39.86 2688 2428316 727268 8.14 369344 2396568 56 03:07:01 AM 4740400 6999572 3142048 39.86 2688 2428484 727268 8.14 369344 2396784 4 03:08:01 AM 4740904 7000080 3141544 39.85 2688 2428488 727268 8.14 369344 2396260 16 03:09:01 AM 4741208 7000464 3141240 39.85 2688 2428568 727268 8.14 369344 2396020 92 03:10:01 AM 4740732 6999988 3141716 39.86 2688 2428568 730080 8.17 369344 2396120 4 03:11:01 AM 4741100 7000372 3141348 39.85 2688 2428580 730080 8.17 369344 2396272 28 03:12:01 AM 4740752 7000096 3141696 39.86 2688 2428652 730080 8.17 369344 2396300 4 03:13:01 AM 4740896 7000244 3141552 39.86 2688 2428656 730080 8.17 369344 2396032 4 03:14:01 AM 4740960 7000488 3141488 39.85 2688 2428836 730080 8.17 369344 2396212 16 03:15:01 AM 4740192 7000124 3142256 39.86 2688 2429236 746520 8.36 369348 2396780 4 03:16:01 AM 4737364 6997696 3145084 39.90 2688 2429636 778356 8.72 369348 2399412 16 03:17:01 AM 4736548 6997276 3145900 39.91 2688 2430032 794608 8.90 369348 2400100 4 03:18:01 AM 4733596 6994724 3148852 39.95 2688 2430424 827492 9.27 369348 2402752 16 03:19:01 AM 4732640 6994316 3149808 39.96 2688 2430976 860260 9.63 369348 2403464 4 03:20:01 AM 4730964 6993144 3151484 39.98 2688 2431476 898980 10.07 369348 2404264 112 03:21:01 AM 4610504 6873040 3271944 41.51 2688 2431836 1018036 11.40 369348 2524900 92 03:22:01 AM 4756996 6919132 3125452 39.65 2688 2337020 742360 8.31 430616 2340636 77936 Average: 4797825 7001100 3084623 39.13 2688 2372697 739698 8.28 341866 2367010 721 12:00:01 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 12:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:01:01 AM eth0 4.80 4.46 1.12 0.42 0.00 0.00 0.00 0.00 12:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:02:01 AM eth0 4.51 3.13 0.81 0.31 0.00 0.00 0.00 0.00 12:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:03:01 AM eth0 8.12 7.78 1.60 0.85 0.00 0.00 0.00 0.00 12:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:04:01 AM eth0 4.65 4.45 0.69 0.39 0.00 0.00 0.00 0.00 12:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:05:01 AM eth0 9.67 7.47 1.52 0.64 0.00 0.00 0.00 0.00 12:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:06:01 AM eth0 9.77 7.52 1.77 1.03 0.00 0.00 0.00 0.00 12:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:07:01 AM eth0 8.16 7.90 1.64 1.46 0.00 0.00 0.00 0.00 12:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:08:01 AM eth0 10.90 10.13 2.62 2.08 0.00 0.00 0.00 0.00 12:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:09:01 AM eth0 10.41 9.62 2.46 1.99 0.00 0.00 0.00 0.00 12:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:10:01 AM eth0 9.36 9.43 2.04 1.80 0.00 0.00 0.00 0.00 12:11:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:11:02 AM eth0 9.80 9.85 2.11 1.82 0.00 0.00 0.00 0.00 12:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:12:01 AM eth0 9.05 8.46 1.80 1.57 0.00 0.00 0.00 0.00 12:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:13:01 AM eth0 20.89 17.34 4.68 3.48 0.00 0.00 0.00 0.00 12:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:14:01 AM eth0 1.38 0.82 0.62 0.47 0.00 0.00 0.00 0.00 12:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:15:01 AM eth0 2.08 0.15 0.32 0.07 0.00 0.00 0.00 0.00 12:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:16:01 AM eth0 3.95 0.70 0.71 0.28 0.00 0.00 0.00 0.00 12:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:17:01 AM eth0 3.63 0.00 0.44 0.00 0.00 0.00 0.00 0.00 12:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:18:01 AM eth0 1.30 0.62 0.14 0.09 0.00 0.00 0.00 0.00 12:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:19:01 AM eth0 0.62 0.02 0.03 0.00 0.00 0.00 0.00 0.00 12:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:20:01 AM eth0 2.85 2.37 0.84 0.65 0.00 0.00 0.00 0.00 12:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:21:01 AM eth0 9.40 9.10 1.70 0.83 0.00 0.00 0.00 0.00 12:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:22:01 AM eth0 3.70 3.52 0.62 0.30 0.00 0.00 0.00 0.00 12:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:23:01 AM eth0 3.95 3.83 0.67 0.40 0.00 0.00 0.00 0.00 12:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:24:01 AM eth0 0.47 0.10 0.07 0.01 0.00 0.00 0.00 0.00 12:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:25:01 AM eth0 0.48 0.12 0.09 0.07 0.00 0.00 0.00 0.00 12:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:26:01 AM eth0 5.43 4.77 0.83 0.41 0.00 0.00 0.00 0.00 12:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:27:01 AM eth0 1.27 1.43 0.37 0.46 0.00 0.00 0.00 0.00 12:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:28:01 AM eth0 8.95 8.47 1.60 0.66 0.00 0.00 0.00 0.00 12:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:29:01 AM eth0 5.33 5.37 0.75 0.46 0.00 0.00 0.00 0.00 12:30:00 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:30:00 AM eth0 9.00 9.12 1.55 1.04 0.00 0.00 0.00 0.00 12:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:31:01 AM eth0 10.00 10.25 2.12 1.89 0.00 0.00 0.00 0.00 12:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:32:01 AM eth0 9.58 9.38 2.01 1.74 0.00 0.00 0.00 0.00 12:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:33:01 AM eth0 10.50 10.20 2.38 8.15 0.00 0.00 0.00 0.00 12:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:34:01 AM eth0 10.08 9.72 2.15 1.85 0.00 0.00 0.00 0.00 12:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:35:01 AM eth0 9.68 9.60 2.29 1.99 0.00 0.00 0.00 0.00 12:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:36:01 AM eth0 9.95 9.75 2.15 1.81 0.00 0.00 0.00 0.00 12:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:37:01 AM eth0 14.36 14.36 3.25 2.61 0.00 0.00 0.00 0.00 12:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:38:01 AM eth0 0.57 0.47 0.10 0.09 0.00 0.00 0.00 0.00 12:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:39:01 AM eth0 0.23 0.05 0.01 0.00 0.00 0.00 0.00 0.00 12:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:40:01 AM eth0 236.57 149.18 1340.77 10.37 0.00 0.00 0.00 0.00 12:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:41:01 AM eth0 1.17 0.25 0.41 0.25 0.00 0.00 0.00 0.00 12:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:42:01 AM eth0 1.05 0.52 0.16 0.09 0.00 0.00 0.00 0.00 12:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:43:01 AM eth0 0.50 0.17 0.26 0.19 0.00 0.00 0.00 0.00 12:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:44:01 AM eth0 8.67 8.22 1.69 1.03 0.00 0.00 0.00 0.00 12:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:45:01 AM eth0 2.78 2.52 0.84 0.46 0.00 0.00 0.00 0.00 12:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:46:01 AM eth0 4.18 4.19 1.01 0.43 0.00 0.00 0.00 0.00 12:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:47:01 AM eth0 4.47 4.47 0.70 0.36 0.00 0.00 0.00 0.00 12:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:48:01 AM eth0 7.67 7.63 1.24 0.63 0.00 0.00 0.00 0.00 12:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:49:01 AM eth0 4.08 3.93 0.65 0.34 0.00 0.00 0.00 0.00 12:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:50:01 AM eth0 4.12 3.98 0.74 0.43 0.00 0.00 0.00 0.00 12:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:51:01 AM eth0 10.48 10.56 1.83 1.28 0.00 0.00 0.00 0.00 12:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:52:01 AM eth0 9.13 9.43 1.95 1.75 0.00 0.00 0.00 0.00 12:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:53:01 AM eth0 9.46 9.71 2.03 1.81 0.00 0.00 0.00 0.00 12:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:54:01 AM eth0 9.13 9.32 1.96 1.74 0.00 0.00 0.00 0.00 12:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:55:01 AM eth0 9.52 9.70 2.10 1.87 0.00 0.00 0.00 0.00 12:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:56:01 AM eth0 9.61 9.26 2.07 1.73 0.00 0.00 0.00 0.00 12:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:57:01 AM eth0 8.82 8.50 2.04 1.72 0.00 0.00 0.00 0.00 12:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:58:01 AM eth0 12.96 13.01 2.93 2.33 0.00 0.00 0.00 0.00 12:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:59:01 AM eth0 0.13 0.00 0.01 0.00 0.00 0.00 0.00 0.00 01:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:00:01 AM eth0 0.48 0.18 0.13 0.07 0.00 0.00 0.00 0.00 01:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:01:01 AM eth0 0.75 0.57 0.43 0.09 0.00 0.00 0.00 0.00 01:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:02:01 AM eth0 0.20 0.03 0.01 0.00 0.00 0.00 0.00 0.00 01:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:03:01 AM eth0 1.55 0.77 0.48 0.34 0.00 0.00 0.00 0.00 01:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:04:01 AM eth0 0.10 0.03 0.01 0.00 0.00 0.00 0.00 0.00 01:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:05:01 AM eth0 8.32 7.98 1.69 1.01 0.00 0.00 0.00 0.00 01:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:06:01 AM eth0 4.47 3.42 1.10 0.50 0.00 0.00 0.00 0.00 01:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:07:01 AM eth0 6.96 5.41 1.33 0.55 0.00 0.00 0.00 0.00 01:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:08:01 AM eth0 1.62 0.70 0.34 0.27 0.00 0.00 0.00 0.00 01:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:09:01 AM eth0 5.78 0.30 1.03 0.26 0.00 0.00 0.00 0.00 01:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:10:01 AM eth0 3.02 2.58 0.87 0.43 0.00 0.00 0.00 0.00 01:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:11:01 AM eth0 1.62 1.57 0.17 0.39 0.00 0.00 0.00 0.00 01:12:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:12:02 AM eth0 11.07 4.55 1.60 0.55 0.00 0.00 0.00 0.00 01:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:13:01 AM eth0 5.68 4.57 0.82 0.44 0.00 0.00 0.00 0.00 01:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:14:01 AM eth0 12.08 11.85 2.13 1.19 0.00 0.00 0.00 0.00 01:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:15:01 AM eth0 5.63 5.46 1.22 1.05 0.00 0.00 0.00 0.00 01:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:16:01 AM eth0 9.70 9.62 2.02 1.78 0.00 0.00 0.00 0.00 01:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:17:01 AM eth0 9.88 9.32 2.02 1.74 0.00 0.00 0.00 0.00 01:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:18:01 AM eth0 10.03 9.23 2.03 1.73 0.00 0.00 0.00 0.00 01:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:19:01 AM eth0 9.07 9.32 1.95 1.74 0.00 0.00 0.00 0.00 01:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:20:01 AM eth0 10.28 10.00 2.38 2.07 0.00 0.00 0.00 0.00 01:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:21:01 AM eth0 15.13 15.66 3.54 2.93 0.00 0.00 0.00 0.00 01:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:22:01 AM eth0 5.88 4.60 0.98 0.78 0.00 0.00 0.00 0.00 01:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:23:01 AM eth0 2.38 0.30 0.59 0.26 0.00 0.00 0.00 0.00 01:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:24:01 AM eth0 1.08 0.70 0.36 0.28 0.00 0.00 0.00 0.00 01:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:25:01 AM eth0 0.43 0.18 0.09 0.07 0.00 0.00 0.00 0.00 01:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:26:01 AM eth0 3.78 0.08 0.61 0.01 0.00 0.00 0.00 0.00 01:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:27:01 AM eth0 1.28 0.52 0.14 0.09 0.00 0.00 0.00 0.00 01:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:28:01 AM eth0 0.47 0.00 0.03 0.00 0.00 0.00 0.00 0.00 01:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:29:01 AM eth0 8.02 7.87 1.56 0.99 0.00 0.00 0.00 0.00 01:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:30:01 AM eth0 5.98 5.60 1.25 0.51 0.00 0.00 0.00 0.00 01:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:31:01 AM eth0 3.07 2.82 0.57 0.26 0.00 0.00 0.00 0.00 01:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:32:01 AM eth0 8.70 6.97 1.40 0.60 0.00 0.00 0.00 0.00 01:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:33:01 AM eth0 6.75 4.48 1.45 0.78 0.00 0.00 0.00 0.00 01:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:34:01 AM eth0 9.53 9.33 1.74 1.17 0.00 0.00 0.00 0.00 01:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:35:01 AM eth0 9.78 9.93 2.12 1.88 0.00 0.00 0.00 0.00 01:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:36:01 AM eth0 13.91 9.63 2.65 1.81 0.00 0.00 0.00 0.00 01:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:37:01 AM eth0 9.88 9.31 2.06 1.74 0.00 0.00 0.00 0.00 01:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:38:01 AM eth0 9.70 9.65 2.05 1.81 0.00 0.00 0.00 0.00 01:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:39:01 AM eth0 9.60 9.16 2.06 1.73 0.00 0.00 0.00 0.00 01:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:40:01 AM eth0 9.93 9.88 2.13 1.88 0.00 0.00 0.00 0.00 01:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:41:01 AM eth0 14.28 13.98 3.24 2.58 0.00 0.00 0.00 0.00 01:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:42:01 AM eth0 3.53 0.50 0.59 0.09 0.00 0.00 0.00 0.00 01:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:43:01 AM eth0 1.55 0.40 0.65 0.44 0.00 0.00 0.00 0.00 01:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:44:01 AM eth0 1.10 0.62 0.14 0.09 0.00 0.00 0.00 0.00 01:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:45:01 AM eth0 6.60 0.17 1.02 0.07 0.00 0.00 0.00 0.00 01:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:46:01 AM eth0 2.92 0.50 0.28 0.09 0.00 0.00 0.00 0.00 01:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:47:01 AM eth0 0.67 0.02 0.04 0.00 0.00 0.00 0.00 0.00 01:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:48:01 AM eth0 8.03 7.87 1.54 0.95 0.00 0.00 0.00 0.00 01:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:49:01 AM eth0 3.42 2.92 0.67 0.24 0.00 0.00 0.00 0.00 01:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:50:01 AM eth0 5.52 5.32 1.16 0.60 0.00 0.00 0.00 0.00 01:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:51:01 AM eth0 3.70 3.48 0.60 0.29 0.00 0.00 0.00 0.00 01:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:52:01 AM eth0 10.45 7.13 1.56 0.59 0.00 0.00 0.00 0.00 01:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:53:01 AM eth0 11.21 9.38 2.13 1.32 0.00 0.00 0.00 0.00 01:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:54:01 AM eth0 6.78 6.50 1.61 1.36 0.00 0.00 0.00 0.00 01:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:55:01 AM eth0 10.03 9.73 2.18 1.87 0.00 0.00 0.00 0.00 01:56:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:56:02 AM eth0 19.44 9.06 3.09 1.71 0.00 0.00 0.00 0.00 01:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:57:01 AM eth0 10.64 9.51 2.06 1.77 0.00 0.00 0.00 0.00 01:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:58:01 AM eth0 10.75 9.36 2.04 1.75 0.00 0.00 0.00 0.00 01:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:59:01 AM eth0 10.16 9.47 2.05 1.79 0.00 0.00 0.00 0.00 02:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:00:01 AM eth0 19.89 18.71 4.35 3.49 0.00 0.00 0.00 0.00 02:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:01:01 AM eth0 1.67 0.58 0.17 0.10 0.00 0.00 0.00 0.00 02:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:02:01 AM eth0 3.12 0.05 0.28 0.00 0.00 0.00 0.00 0.00 02:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:03:01 AM eth0 3.35 1.10 1.04 0.67 0.00 0.00 0.00 0.00 02:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:04:01 AM eth0 1.67 0.03 0.10 0.00 0.00 0.00 0.00 0.00 02:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:05:01 AM eth0 4.37 0.33 0.80 0.26 0.00 0.00 0.00 0.00 02:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:06:01 AM eth0 5.88 0.47 0.67 0.08 0.00 0.00 0.00 0.00 02:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:07:01 AM eth0 1.67 0.00 0.11 0.00 0.00 0.00 0.00 0.00 02:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:08:01 AM eth0 8.67 7.20 1.58 0.96 0.00 0.00 0.00 0.00 02:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:09:01 AM eth0 6.02 4.43 0.98 0.37 0.00 0.00 0.00 0.00 02:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:10:01 AM eth0 2.13 0.48 0.23 0.13 0.00 0.00 0.00 0.00 02:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:11:01 AM eth0 4.23 2.47 0.70 0.22 0.00 0.00 0.00 0.00 02:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:12:01 AM eth0 10.30 7.85 2.06 1.22 0.00 0.00 0.00 0.00 02:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:13:01 AM eth0 12.63 11.13 2.74 2.28 0.00 0.00 0.00 0.00 02:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:14:01 AM eth0 9.46 9.01 2.24 1.85 0.00 0.00 0.00 0.00 02:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:15:01 AM eth0 9.72 9.48 2.05 1.81 0.00 0.00 0.00 0.00 02:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:16:01 AM eth0 10.58 9.56 2.13 1.76 0.00 0.00 0.00 0.00 02:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:17:01 AM eth0 13.05 8.95 2.44 1.68 0.00 0.00 0.00 0.00 02:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:18:01 AM eth0 9.81 9.31 2.02 1.74 0.00 0.00 0.00 0.00 02:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:19:01 AM eth0 14.13 13.43 3.15 2.48 0.00 0.00 0.00 0.00 02:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:20:01 AM eth0 1.03 0.50 0.39 0.30 0.00 0.00 0.00 0.00 02:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:21:01 AM eth0 0.57 0.05 0.03 0.00 0.00 0.00 0.00 0.00 02:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:22:01 AM eth0 0.85 0.67 0.21 0.20 0.00 0.00 0.00 0.00 02:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:23:01 AM eth0 0.53 0.18 0.14 0.01 0.00 0.00 0.00 0.00 02:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:24:01 AM eth0 1.05 0.60 0.14 0.09 0.00 0.00 0.00 0.00 02:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:25:01 AM eth0 0.62 0.15 0.11 0.07 0.00 0.00 0.00 0.00 02:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:26:01 AM eth0 7.83 7.45 1.60 0.92 0.00 0.00 0.00 0.00 02:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:27:01 AM eth0 7.26 7.18 1.62 0.99 0.00 0.00 0.00 0.00 02:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:28:01 AM eth0 5.80 5.95 1.20 1.09 0.00 0.00 0.00 0.00 02:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:29:01 AM eth0 9.20 9.28 1.96 1.74 0.00 0.00 0.00 0.00 02:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:30:01 AM eth0 9.46 9.56 2.09 1.85 0.00 0.00 0.00 0.00 02:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:31:01 AM eth0 9.31 9.38 2.01 1.75 0.00 0.00 0.00 0.00 02:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:32:01 AM eth0 9.60 9.25 2.01 1.73 0.00 0.00 0.00 0.00 02:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:33:01 AM eth0 10.68 9.70 2.61 2.18 0.00 0.00 0.00 0.00 02:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:34:01 AM eth0 18.64 18.59 4.15 3.41 0.00 0.00 0.00 0.00 02:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:35:01 AM eth0 1.52 0.90 0.27 0.21 0.00 0.00 0.00 0.00 02:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:36:01 AM eth0 0.38 0.07 0.02 0.00 0.00 0.00 0.00 0.00 02:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:37:01 AM eth0 0.97 0.53 0.12 0.09 0.00 0.00 0.00 0.00 02:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:38:01 AM eth0 0.50 0.05 0.02 0.00 0.00 0.00 0.00 0.00 02:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:39:01 AM eth0 0.53 0.02 0.02 0.00 0.00 0.00 0.00 0.00 02:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:40:01 AM eth0 0.95 0.57 0.18 0.15 0.00 0.00 0.00 0.00 02:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:41:01 AM eth0 1.85 0.00 0.11 0.00 0.00 0.00 0.00 0.00 02:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:42:01 AM eth0 7.88 7.68 1.56 0.98 0.00 0.00 0.00 0.00 02:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:43:01 AM eth0 6.57 6.28 1.50 0.87 0.00 0.00 0.00 0.00 02:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:44:01 AM eth0 13.83 9.40 2.26 1.74 0.00 0.00 0.00 0.00 02:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:45:01 AM eth0 9.78 9.78 2.12 1.87 0.00 0.00 0.00 0.00 02:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:46:01 AM eth0 10.11 9.32 2.05 1.74 0.00 0.00 0.00 0.00 02:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:47:01 AM eth0 9.67 9.40 2.02 1.74 0.00 0.00 0.00 0.00 02:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:48:01 AM eth0 9.10 9.26 2.18 1.94 0.00 0.00 0.00 0.00 02:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:49:01 AM eth0 9.27 9.42 2.00 1.77 0.00 0.00 0.00 0.00 02:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:50:01 AM eth0 15.36 15.28 3.55 2.82 0.00 0.00 0.00 0.00 02:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:51:01 AM eth0 0.78 0.70 0.16 0.13 0.00 0.00 0.00 0.00 02:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:52:01 AM eth0 0.22 0.00 0.01 0.00 0.00 0.00 0.00 0.00 02:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:53:01 AM eth0 0.57 0.57 0.10 0.09 0.00 0.00 0.00 0.00 02:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:54:01 AM eth0 0.13 0.00 0.01 0.00 0.00 0.00 0.00 0.00 02:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:55:01 AM eth0 0.68 0.57 0.17 0.15 0.00 0.00 0.00 0.00 02:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:56:01 AM eth0 0.35 0.10 0.02 0.00 0.00 0.00 0.00 0.00 02:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:57:01 AM eth0 0.15 0.00 0.01 0.00 0.00 0.00 0.00 0.00 02:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:58:01 AM eth0 9.53 9.62 1.92 1.23 0.00 0.00 0.00 0.00 02:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:59:01 AM eth0 5.45 5.48 1.30 0.81 0.00 0.00 0.00 0.00 03:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:00:01 AM eth0 11.05 11.25 2.38 2.11 0.00 0.00 0.00 0.00 03:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:01:01 AM eth0 9.03 9.26 1.95 1.73 0.00 0.00 0.00 0.00 03:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:02:01 AM eth0 8.35 7.71 1.75 1.48 0.00 0.00 0.00 0.00 03:03:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:03:02 AM eth0 10.61 10.20 3.05 2.20 0.00 0.00 0.00 0.00 03:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:04:01 AM eth0 9.69 9.29 2.04 1.76 0.00 0.00 0.00 0.00 03:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:05:01 AM eth0 9.53 9.60 2.28 1.99 0.00 0.00 0.00 0.00 03:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:06:01 AM eth0 13.66 13.66 3.13 2.50 0.00 0.00 0.00 0.00 03:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:07:01 AM eth0 0.95 0.90 0.21 0.17 0.00 0.00 0.00 0.00 03:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:08:01 AM eth0 1.08 0.38 0.40 0.27 0.00 0.00 0.00 0.00 03:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:09:01 AM eth0 0.67 0.55 0.10 0.09 0.00 0.00 0.00 0.00 03:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:10:01 AM eth0 0.62 0.12 0.16 0.07 0.00 0.00 0.00 0.00 03:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:11:01 AM eth0 2.05 0.40 0.53 0.27 0.00 0.00 0.00 0.00 03:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:12:01 AM eth0 1.50 0.60 0.46 0.27 0.00 0.00 0.00 0.00 03:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:13:01 AM eth0 0.25 0.05 0.01 0.00 0.00 0.00 0.00 0.00 03:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:14:01 AM eth0 7.63 7.73 1.54 0.98 0.00 0.00 0.00 0.00 03:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:15:01 AM eth0 7.95 7.70 3.01 1.08 0.00 0.00 0.00 0.00 03:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:16:01 AM eth0 7.33 7.22 2.96 1.03 0.00 0.00 0.00 0.00 03:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:17:01 AM eth0 7.92 8.02 2.85 0.93 0.00 0.00 0.00 0.00 03:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:18:01 AM eth0 7.97 7.98 3.60 1.00 0.00 0.00 0.00 0.00 03:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:19:01 AM eth0 10.31 10.43 3.43 1.38 0.00 0.00 0.00 0.00 03:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:20:01 AM eth0 11.46 11.21 3.72 1.68 0.00 0.00 0.00 0.00 03:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:21:01 AM eth0 7.28 7.18 2.51 0.64 0.00 0.00 0.00 0.00 03:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:22:01 AM eth0 104.32 78.51 198.35 246.57 0.00 0.00 0.00 0.00 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 Average: eth0 8.02 6.65 8.96 2.24 0.00 0.00 0.00 0.00 ---> sar -P ALL: Linux 4.18.0-532.el8.x86_64 (prd-centos8-robot-2c-8g-7626.novalocal) 02/18/2024 _x86_64_ (2 CPU) 12:00:01 AM CPU %user %nice %system %iowait %steal %idle 12:01:01 AM all 6.41 0.04 1.08 2.14 0.10 90.23 12:01:01 AM 0 3.99 0.00 0.67 4.11 0.12 91.11 12:01:01 AM 1 9.04 0.07 1.53 0.00 0.07 89.28 12:02:01 AM all 5.77 0.00 0.90 0.01 0.08 93.24 12:02:01 AM 0 4.65 0.00 0.82 0.00 0.07 94.46 12:02:01 AM 1 6.91 0.00 0.97 0.02 0.09 92.02 12:03:01 AM all 6.13 0.00 0.84 0.00 0.06 92.97 12:03:01 AM 0 7.32 0.00 1.13 0.00 0.07 91.48 12:03:01 AM 1 4.98 0.00 0.57 0.00 0.05 94.40 12:04:01 AM all 5.98 0.00 0.85 0.00 0.06 93.10 12:04:01 AM 0 8.25 0.00 1.16 0.00 0.07 90.52 12:04:01 AM 1 3.81 0.00 0.55 0.00 0.05 95.59 12:05:01 AM all 6.18 0.00 0.91 0.00 0.06 92.85 12:05:01 AM 0 12.26 0.00 1.75 0.00 0.07 85.92 12:05:01 AM 1 0.67 0.00 0.15 0.00 0.05 99.13 12:06:01 AM all 6.56 0.00 0.87 0.00 0.07 92.50 12:06:01 AM 0 12.88 0.00 1.63 0.00 0.07 85.42 12:06:01 AM 1 0.80 0.00 0.17 0.00 0.07 98.96 12:07:01 AM all 5.37 0.00 0.47 0.00 0.06 94.10 12:07:01 AM 0 8.45 0.00 0.75 0.00 0.07 90.73 12:07:01 AM 1 2.41 0.00 0.20 0.00 0.05 97.34 12:08:01 AM all 4.51 0.00 0.21 0.01 0.08 95.20 12:08:01 AM 0 6.05 0.00 0.20 0.02 0.08 93.65 12:08:01 AM 1 2.98 0.00 0.22 0.00 0.07 96.74 12:09:01 AM all 4.20 0.00 0.21 0.00 0.05 95.54 12:09:01 AM 0 3.48 0.00 0.22 0.00 0.05 96.25 12:09:01 AM 1 4.92 0.00 0.20 0.00 0.05 94.83 12:10:01 AM all 4.25 0.00 0.20 0.00 0.06 95.49 12:10:01 AM 0 3.92 0.00 0.17 0.00 0.05 95.87 12:10:01 AM 1 4.58 0.00 0.23 0.00 0.07 95.12 12:11:02 AM all 4.50 0.00 0.18 0.00 0.06 95.25 12:11:02 AM 0 2.31 0.00 0.17 0.00 0.05 97.48 12:11:02 AM 1 6.71 0.00 0.20 0.00 0.07 93.02 12:11:02 AM CPU %user %nice %system %iowait %steal %idle 12:12:01 AM all 3.97 0.00 0.18 0.00 0.06 95.79 12:12:01 AM 0 1.85 0.00 0.19 0.00 0.05 97.91 12:12:01 AM 1 6.09 0.00 0.17 0.00 0.07 93.67 12:13:01 AM all 6.86 0.00 0.25 0.00 0.07 92.82 12:13:01 AM 0 7.29 0.00 0.22 0.00 0.07 92.42 12:13:01 AM 1 6.42 0.00 0.29 0.00 0.07 93.22 12:14:01 AM all 0.61 0.00 0.08 0.00 0.03 99.28 12:14:01 AM 0 0.63 0.00 0.08 0.00 0.03 99.25 12:14:01 AM 1 0.58 0.00 0.07 0.00 0.03 99.31 12:15:01 AM all 0.32 0.00 0.06 0.00 0.03 99.60 12:15:01 AM 0 0.55 0.00 0.05 0.00 0.03 99.37 12:15:01 AM 1 0.08 0.00 0.07 0.00 0.02 99.83 12:16:01 AM all 0.52 0.00 0.08 0.00 0.04 99.36 12:16:01 AM 0 0.55 0.00 0.08 0.00 0.03 99.33 12:16:01 AM 1 0.48 0.00 0.08 0.00 0.05 99.38 12:17:01 AM all 0.30 0.00 0.08 0.00 0.03 99.60 12:17:01 AM 0 0.58 0.00 0.12 0.00 0.05 99.25 12:17:01 AM 1 0.02 0.00 0.03 0.00 0.00 99.95 12:18:01 AM all 0.52 0.00 0.08 0.00 0.03 99.37 12:18:01 AM 0 0.55 0.00 0.10 0.00 0.02 99.33 12:18:01 AM 1 0.48 0.00 0.07 0.00 0.03 99.42 12:19:01 AM all 0.33 0.00 0.07 0.00 0.03 99.57 12:19:01 AM 0 0.07 0.00 0.05 0.00 0.02 99.87 12:19:01 AM 1 0.60 0.00 0.08 0.00 0.03 99.28 12:20:01 AM all 1.21 0.00 0.08 0.00 0.04 98.66 12:20:01 AM 0 1.72 0.00 0.08 0.00 0.03 98.16 12:20:01 AM 1 0.70 0.00 0.08 0.00 0.05 99.16 12:21:01 AM all 5.91 0.00 0.80 0.00 0.06 93.23 12:21:01 AM 0 6.21 0.00 0.84 0.00 0.05 92.89 12:21:01 AM 1 5.61 0.00 0.75 0.00 0.07 93.57 12:22:01 AM all 5.80 0.00 0.90 0.00 0.06 93.23 12:22:01 AM 0 11.80 0.00 1.76 0.00 0.07 86.37 12:22:01 AM 1 0.38 0.00 0.13 0.00 0.05 99.43 12:22:01 AM CPU %user %nice %system %iowait %steal %idle 12:23:01 AM all 6.52 0.00 0.73 0.00 0.06 92.69 12:23:01 AM 0 3.32 0.00 0.46 0.00 0.05 96.17 12:23:01 AM 1 9.84 0.00 1.01 0.00 0.07 89.08 12:24:01 AM all 0.95 0.00 0.13 0.00 0.03 98.89 12:24:01 AM 0 0.28 0.00 0.07 0.00 0.03 99.62 12:24:01 AM 1 1.62 0.00 0.19 0.00 0.03 98.17 12:25:01 AM all 0.20 0.00 0.08 0.00 0.03 99.69 12:25:01 AM 0 0.22 0.00 0.08 0.00 0.02 99.68 12:25:01 AM 1 0.18 0.00 0.08 0.00 0.03 99.70 12:26:01 AM all 5.41 0.00 0.59 0.00 0.05 93.96 12:26:01 AM 0 8.65 0.00 1.11 0.00 0.07 90.18 12:26:01 AM 1 2.37 0.00 0.10 0.00 0.03 97.49 12:27:01 AM all 6.73 0.00 0.11 0.00 0.05 93.11 12:27:01 AM 0 6.63 0.00 0.10 0.00 0.05 93.22 12:27:01 AM 1 6.83 0.00 0.12 0.00 0.05 93.00 12:28:01 AM all 6.54 0.00 0.82 0.00 0.06 92.58 12:28:01 AM 0 8.92 0.00 1.14 0.00 0.07 89.87 12:28:01 AM 1 4.25 0.00 0.51 0.00 0.05 95.18 12:29:01 AM all 6.69 0.00 0.73 0.00 0.06 92.52 12:29:01 AM 0 6.07 0.00 0.73 0.00 0.07 93.13 12:29:01 AM 1 7.30 0.00 0.73 0.00 0.05 91.92 12:30:00 AM all 6.53 0.00 0.85 0.04 0.05 92.54 12:30:00 AM 0 10.57 0.00 1.33 0.07 0.05 87.98 12:30:00 AM 1 2.74 0.00 0.39 0.00 0.05 96.82 12:31:01 AM all 5.18 0.00 0.32 0.00 0.07 94.43 12:31:01 AM 0 5.11 0.00 0.40 0.00 0.07 94.42 12:31:01 AM 1 5.25 0.00 0.23 0.00 0.07 94.45 12:32:01 AM all 4.34 0.00 0.21 0.00 0.04 95.41 12:32:01 AM 0 6.55 0.00 0.23 0.00 0.05 93.16 12:32:01 AM 1 2.12 0.00 0.18 0.00 0.03 97.66 12:33:01 AM all 4.44 0.00 0.19 0.00 0.07 95.30 12:33:01 AM 0 5.19 0.00 0.18 0.00 0.07 94.56 12:33:01 AM 1 3.70 0.00 0.20 0.00 0.07 96.03 12:33:01 AM CPU %user %nice %system %iowait %steal %idle 12:34:01 AM all 4.47 0.00 0.18 0.00 0.05 95.30 12:34:01 AM 0 5.33 0.00 0.18 0.00 0.05 94.44 12:34:01 AM 1 3.61 0.00 0.18 0.00 0.05 96.15 12:35:01 AM all 4.28 0.00 0.17 0.00 0.06 95.49 12:35:01 AM 0 4.04 0.00 0.17 0.00 0.05 95.75 12:35:01 AM 1 4.53 0.00 0.17 0.00 0.07 95.24 12:36:01 AM all 4.45 0.00 0.20 0.00 0.07 95.28 12:36:01 AM 0 3.86 0.00 0.22 0.00 0.07 95.86 12:36:01 AM 1 5.05 0.00 0.18 0.00 0.07 94.70 12:37:01 AM all 5.70 0.00 0.23 0.00 0.04 94.03 12:37:01 AM 0 3.66 0.00 0.20 0.00 0.03 96.10 12:37:01 AM 1 7.76 0.00 0.25 0.00 0.05 91.94 12:38:01 AM all 0.51 0.00 0.08 0.00 0.03 99.37 12:38:01 AM 0 0.68 0.00 0.10 0.00 0.03 99.18 12:38:01 AM 1 0.33 0.00 0.07 0.00 0.03 99.57 12:39:01 AM all 0.33 0.00 0.05 0.00 0.03 99.59 12:39:01 AM 0 0.50 0.00 0.03 0.00 0.02 99.45 12:39:01 AM 1 0.15 0.00 0.07 0.00 0.05 99.73 12:40:01 AM all 0.49 16.66 1.07 1.48 0.06 80.24 12:40:01 AM 0 0.47 27.72 1.50 1.52 0.07 68.72 12:40:01 AM 1 0.52 5.60 0.64 1.44 0.05 91.76 12:41:01 AM all 0.29 0.00 0.10 0.28 0.03 99.30 12:41:01 AM 0 0.17 0.00 0.12 0.08 0.05 99.58 12:41:01 AM 1 0.42 0.00 0.08 0.47 0.02 99.02 12:42:01 AM all 0.46 0.00 0.06 0.00 0.03 99.46 12:42:01 AM 0 0.45 0.00 0.05 0.00 0.03 99.47 12:42:01 AM 1 0.47 0.00 0.07 0.00 0.02 99.45 12:43:01 AM all 0.34 0.00 0.04 0.00 0.03 99.58 12:43:01 AM 0 0.07 0.00 0.05 0.00 0.02 99.87 12:43:01 AM 1 0.62 0.00 0.03 0.00 0.05 99.30 12:44:01 AM all 2.86 0.00 0.27 0.00 0.04 96.83 12:44:01 AM 0 2.49 0.00 0.15 0.00 0.05 97.31 12:44:01 AM 1 3.23 0.00 0.39 0.00 0.03 96.34 12:44:01 AM CPU %user %nice %system %iowait %steal %idle 12:45:01 AM all 6.02 0.00 0.92 0.00 0.06 93.00 12:45:01 AM 0 11.94 0.00 1.77 0.00 0.09 86.20 12:45:01 AM 1 0.67 0.00 0.15 0.00 0.03 99.15 12:46:01 AM all 5.97 0.00 0.85 0.00 0.07 93.11 12:46:01 AM 0 11.83 0.00 1.67 0.00 0.09 86.40 12:46:01 AM 1 0.67 0.00 0.10 0.00 0.05 99.18 12:47:01 AM all 5.98 0.00 0.86 0.00 0.07 93.09 12:47:01 AM 0 3.62 0.00 0.57 0.00 0.05 95.76 12:47:01 AM 1 8.44 0.00 1.16 0.00 0.09 90.31 12:48:01 AM all 6.15 0.00 0.89 0.00 0.05 92.90 12:48:01 AM 0 0.45 0.00 0.17 0.00 0.05 99.33 12:48:01 AM 1 12.42 0.00 1.69 0.00 0.06 85.83 12:49:01 AM all 5.68 0.00 0.85 0.00 0.07 93.40 12:49:01 AM 0 11.77 0.00 1.64 0.00 0.07 86.51 12:49:01 AM 1 0.17 0.00 0.13 0.00 0.07 99.63 12:50:01 AM all 5.64 0.00 0.82 0.00 0.06 93.48 12:50:01 AM 0 11.67 0.00 1.57 0.00 0.07 86.69 12:50:01 AM 1 0.20 0.00 0.13 0.00 0.05 99.62 12:51:01 AM all 6.75 0.00 0.78 0.00 0.06 92.41 12:51:01 AM 0 4.54 0.00 0.41 0.00 0.05 95.00 12:51:01 AM 1 9.07 0.00 1.16 0.00 0.07 89.70 12:52:01 AM all 4.28 0.00 0.16 0.00 0.05 95.51 12:52:01 AM 0 6.02 0.00 0.18 0.00 0.05 93.75 12:52:01 AM 1 2.54 0.00 0.13 0.00 0.05 97.27 12:53:01 AM all 4.49 0.00 0.18 0.00 0.07 95.26 12:53:01 AM 0 5.02 0.00 0.20 0.00 0.07 94.71 12:53:01 AM 1 3.95 0.00 0.17 0.00 0.07 95.82 12:54:01 AM all 4.29 0.00 0.18 0.00 0.06 95.47 12:54:01 AM 0 3.06 0.00 0.13 0.00 0.05 96.76 12:54:01 AM 1 5.51 0.00 0.23 0.00 0.07 94.19 12:55:01 AM all 4.43 0.00 0.18 0.00 0.04 95.35 12:55:01 AM 0 5.92 0.00 0.22 0.00 0.05 93.81 12:55:01 AM 1 2.94 0.00 0.13 0.00 0.03 96.89 12:55:01 AM CPU %user %nice %system %iowait %steal %idle 12:56:01 AM all 4.28 0.00 0.18 0.00 0.07 95.47 12:56:01 AM 0 4.95 0.00 0.18 0.00 0.07 94.79 12:56:01 AM 1 3.61 0.00 0.18 0.00 0.07 96.14 12:57:01 AM all 3.79 0.00 0.17 0.00 0.03 96.01 12:57:01 AM 0 4.67 0.00 0.18 0.00 0.03 95.11 12:57:01 AM 1 2.91 0.00 0.15 0.00 0.03 96.91 12:58:01 AM all 5.04 0.00 0.21 0.00 0.06 94.69 12:58:01 AM 0 3.07 0.00 0.20 0.00 0.05 96.68 12:58:01 AM 1 7.01 0.00 0.22 0.00 0.07 92.70 12:59:01 AM all 0.28 0.00 0.05 0.00 0.03 99.65 12:59:01 AM 0 0.47 0.00 0.03 0.00 0.02 99.48 12:59:01 AM 1 0.08 0.00 0.07 0.00 0.03 99.82 01:00:01 AM all 0.23 0.00 0.08 0.00 0.03 99.67 01:00:01 AM 0 0.32 0.00 0.10 0.00 0.03 99.55 01:00:01 AM 1 0.13 0.00 0.07 0.00 0.02 99.78 01:01:01 AM all 0.53 0.00 0.06 0.00 0.03 99.39 01:01:01 AM 0 0.37 0.00 0.07 0.00 0.02 99.55 01:01:01 AM 1 0.68 0.00 0.05 0.00 0.03 99.23 01:02:01 AM all 0.33 0.00 0.08 0.00 0.03 99.56 01:02:01 AM 0 0.10 0.00 0.10 0.00 0.03 99.77 01:02:01 AM 1 0.57 0.00 0.05 0.00 0.03 99.35 01:03:01 AM all 0.53 0.00 0.08 0.00 0.04 99.35 01:03:01 AM 0 0.47 0.00 0.08 0.00 0.03 99.42 01:03:01 AM 1 0.60 0.00 0.07 0.00 0.05 99.28 01:04:01 AM all 0.28 0.00 0.06 0.00 0.03 99.63 01:04:01 AM 0 0.05 0.00 0.05 0.00 0.03 99.87 01:04:01 AM 1 0.52 0.00 0.07 0.00 0.02 99.40 01:05:01 AM all 3.85 0.00 0.42 0.00 0.05 95.68 01:05:01 AM 0 7.00 0.00 0.77 0.00 0.05 92.18 01:05:01 AM 1 0.84 0.00 0.08 0.00 0.05 99.03 01:06:01 AM all 5.33 0.00 0.87 0.00 0.05 93.75 01:06:01 AM 0 8.92 0.00 1.42 0.00 0.05 89.61 01:06:01 AM 1 1.99 0.00 0.36 0.00 0.05 97.61 01:06:01 AM CPU %user %nice %system %iowait %steal %idle 01:07:01 AM all 6.47 0.00 0.73 0.00 0.06 92.74 01:07:01 AM 0 8.50 0.00 0.96 0.00 0.07 90.47 01:07:01 AM 1 4.51 0.00 0.51 0.00 0.05 94.93 01:08:01 AM all 3.48 0.00 0.51 0.00 0.05 95.96 01:08:01 AM 0 0.17 0.00 0.13 0.00 0.05 99.65 01:08:01 AM 1 6.99 0.00 0.91 0.00 0.05 92.05 01:09:01 AM all 0.38 0.00 0.10 0.00 0.03 99.49 01:09:01 AM 0 0.30 0.00 0.10 0.00 0.03 99.57 01:09:01 AM 1 0.45 0.00 0.10 0.00 0.03 99.42 01:10:01 AM all 2.11 0.00 0.32 0.00 0.03 97.53 01:10:01 AM 0 0.73 0.00 0.12 0.00 0.03 99.12 01:10:01 AM 1 3.53 0.00 0.53 0.00 0.03 95.90 01:11:01 AM all 6.92 0.00 0.36 0.00 0.07 92.66 01:11:01 AM 0 7.21 0.00 0.12 0.00 0.07 92.61 01:11:01 AM 1 6.62 0.00 0.61 0.00 0.07 92.71 01:12:02 AM all 6.46 0.00 0.49 0.00 0.07 92.98 01:12:02 AM 0 11.21 0.00 0.83 0.00 0.07 87.89 01:12:02 AM 1 2.03 0.00 0.17 0.00 0.07 97.74 01:13:01 AM all 5.77 0.00 0.79 0.00 0.05 93.38 01:13:01 AM 0 3.07 0.00 0.45 0.00 0.05 96.42 01:13:01 AM 1 8.61 0.00 1.15 0.00 0.05 90.19 01:14:01 AM all 7.06 0.00 0.84 0.00 0.06 92.04 01:14:01 AM 0 9.30 0.00 0.91 0.00 0.05 89.73 01:14:01 AM 1 4.85 0.00 0.76 0.00 0.07 94.32 01:15:01 AM all 5.68 0.00 0.67 0.00 0.06 93.58 01:15:01 AM 0 2.64 0.00 0.17 0.00 0.05 97.14 01:15:01 AM 1 8.93 0.00 1.21 0.00 0.07 89.79 01:16:01 AM all 4.43 0.00 0.18 0.01 0.05 95.33 01:16:01 AM 0 5.34 0.00 0.22 0.00 0.05 94.39 01:16:01 AM 1 3.51 0.00 0.15 0.02 0.05 96.27 01:17:01 AM all 4.39 0.00 0.20 0.00 0.05 95.35 01:17:01 AM 0 5.59 0.00 0.18 0.00 0.05 94.17 01:17:01 AM 1 3.20 0.00 0.22 0.00 0.05 96.54 01:17:01 AM CPU %user %nice %system %iowait %steal %idle 01:18:01 AM all 4.33 0.00 0.18 0.00 0.05 95.45 01:18:01 AM 0 3.97 0.00 0.15 0.00 0.05 95.83 01:18:01 AM 1 4.69 0.00 0.20 0.00 0.05 95.06 01:19:01 AM all 4.34 0.00 0.18 0.00 0.05 95.43 01:19:01 AM 0 6.83 0.00 0.22 0.00 0.05 92.91 01:19:01 AM 1 1.85 0.00 0.15 0.00 0.05 97.94 01:20:01 AM all 4.42 0.00 0.18 0.00 0.07 95.33 01:20:01 AM 0 5.68 0.00 0.20 0.00 0.07 94.05 01:20:01 AM 1 3.16 0.00 0.17 0.00 0.07 96.60 01:21:01 AM all 6.59 0.00 0.25 0.00 0.04 93.12 01:21:01 AM 0 8.83 0.00 0.29 0.00 0.05 90.84 01:21:01 AM 1 4.35 0.00 0.22 0.00 0.03 95.40 01:22:01 AM all 1.83 0.00 0.09 0.00 0.05 98.03 01:22:01 AM 0 2.82 0.00 0.07 0.00 0.05 97.06 01:22:01 AM 1 0.84 0.00 0.12 0.00 0.05 99.00 01:23:01 AM all 0.35 0.00 0.08 0.00 0.02 99.56 01:23:01 AM 0 0.12 0.00 0.10 0.00 0.02 99.77 01:23:01 AM 1 0.58 0.00 0.05 0.00 0.02 99.35 01:24:01 AM all 0.52 0.00 0.08 0.00 0.03 99.37 01:24:01 AM 0 0.48 0.00 0.08 0.00 0.03 99.40 01:24:01 AM 1 0.55 0.00 0.07 0.00 0.03 99.35 01:25:01 AM all 0.21 0.00 0.08 0.00 0.03 99.69 01:25:01 AM 0 0.32 0.00 0.05 0.00 0.02 99.62 01:25:01 AM 1 0.10 0.00 0.10 0.00 0.03 99.77 01:26:01 AM all 0.37 0.00 0.08 0.00 0.03 99.52 01:26:01 AM 0 0.55 0.00 0.07 0.00 0.03 99.35 01:26:01 AM 1 0.18 0.00 0.08 0.00 0.03 99.70 01:27:01 AM all 0.50 0.00 0.05 0.00 0.03 99.42 01:27:01 AM 0 0.52 0.00 0.07 0.00 0.03 99.38 01:27:01 AM 1 0.48 0.00 0.03 0.00 0.02 99.47 01:28:01 AM all 0.33 0.00 0.07 0.00 0.03 99.57 01:28:01 AM 0 0.55 0.00 0.05 0.00 0.03 99.37 01:28:01 AM 1 0.12 0.00 0.08 0.00 0.03 99.77 01:28:01 AM CPU %user %nice %system %iowait %steal %idle 01:29:01 AM all 5.41 0.00 0.67 0.00 0.05 93.86 01:29:01 AM 0 2.19 0.00 0.17 0.00 0.05 97.59 01:29:01 AM 1 8.86 0.00 1.22 0.00 0.05 89.86 01:30:01 AM all 5.76 0.00 0.89 0.00 0.06 93.29 01:30:01 AM 0 8.08 0.00 1.14 0.00 0.05 90.72 01:30:01 AM 1 3.53 0.00 0.64 0.00 0.07 95.76 01:31:01 AM all 5.95 0.00 0.95 0.00 0.06 93.04 01:31:01 AM 0 0.70 0.00 0.10 0.00 0.05 99.15 01:31:01 AM 1 11.76 0.00 1.89 0.00 0.07 86.28 01:32:01 AM all 5.65 0.00 0.89 0.00 0.06 93.39 01:32:01 AM 0 2.45 0.00 0.48 0.00 0.07 97.00 01:32:01 AM 1 9.05 0.00 1.34 0.00 0.05 89.55 01:33:01 AM all 5.86 0.00 0.86 0.00 0.07 93.21 01:33:01 AM 0 5.44 0.00 0.79 0.00 0.07 93.71 01:33:01 AM 1 6.29 0.00 0.93 0.00 0.07 92.70 01:34:01 AM all 6.74 0.00 0.91 0.00 0.07 92.28 01:34:01 AM 0 4.32 0.00 0.48 0.00 0.07 95.13 01:34:01 AM 1 9.28 0.00 1.36 0.00 0.07 89.28 01:35:01 AM all 5.03 0.00 0.27 0.00 0.05 94.65 01:35:01 AM 0 4.22 0.00 0.17 0.00 0.05 95.56 01:35:01 AM 1 5.86 0.00 0.37 0.00 0.05 93.72 01:36:01 AM all 4.52 0.00 0.19 0.00 0.07 95.22 01:36:01 AM 0 6.68 0.00 0.22 0.00 0.07 93.03 01:36:01 AM 1 2.36 0.00 0.17 0.00 0.07 97.40 01:37:01 AM all 4.41 0.00 0.17 0.00 0.06 95.36 01:37:01 AM 0 6.76 0.00 0.20 0.00 0.07 92.97 01:37:01 AM 1 2.07 0.00 0.13 0.00 0.05 97.74 01:38:01 AM all 4.45 0.00 0.20 0.00 0.05 95.30 01:38:01 AM 0 4.99 0.00 0.20 0.00 0.05 94.76 01:38:01 AM 1 3.90 0.00 0.20 0.00 0.05 95.85 01:39:01 AM all 4.34 0.00 0.17 0.00 0.06 95.43 01:39:01 AM 0 5.60 0.00 0.18 0.00 0.05 94.17 01:39:01 AM 1 3.09 0.00 0.15 0.00 0.07 96.69 01:39:01 AM CPU %user %nice %system %iowait %steal %idle 01:40:01 AM all 4.54 0.00 0.18 0.00 0.05 95.23 01:40:01 AM 0 5.47 0.00 0.18 0.00 0.05 94.29 01:40:01 AM 1 3.60 0.00 0.18 0.00 0.05 96.17 01:41:01 AM all 5.72 0.00 0.23 0.00 0.06 94.00 01:41:01 AM 0 7.47 0.00 0.20 0.00 0.05 92.28 01:41:01 AM 1 3.97 0.00 0.25 0.00 0.07 95.72 01:42:01 AM all 0.55 0.00 0.06 0.00 0.03 99.36 01:42:01 AM 0 0.57 0.00 0.05 0.00 0.03 99.35 01:42:01 AM 1 0.53 0.00 0.07 0.00 0.03 99.37 01:43:01 AM all 0.35 0.00 0.07 0.00 0.03 99.56 01:43:01 AM 0 0.58 0.00 0.05 0.00 0.02 99.35 01:43:01 AM 1 0.12 0.00 0.08 0.00 0.03 99.77 01:44:01 AM all 0.49 0.00 0.08 0.00 0.03 99.39 01:44:01 AM 0 0.47 0.00 0.08 0.00 0.03 99.42 01:44:01 AM 1 0.52 0.00 0.08 0.00 0.03 99.37 01:45:01 AM all 0.30 0.00 0.08 0.00 0.04 99.58 01:45:01 AM 0 0.32 0.00 0.03 0.00 0.03 99.62 01:45:01 AM 1 0.28 0.00 0.12 0.00 0.05 99.55 01:46:01 AM all 0.58 0.00 0.07 0.00 0.03 99.32 01:46:01 AM 0 0.52 0.00 0.07 0.00 0.05 99.37 01:46:01 AM 1 0.63 0.00 0.07 0.00 0.02 99.28 01:47:01 AM all 0.22 0.00 0.08 0.00 0.03 99.67 01:47:01 AM 0 0.37 0.00 0.12 0.00 0.03 99.48 01:47:01 AM 1 0.07 0.00 0.05 0.00 0.03 99.85 01:48:01 AM all 2.89 0.00 0.26 0.00 0.03 96.82 01:48:01 AM 0 4.35 0.00 0.45 0.00 0.03 95.17 01:48:01 AM 1 1.47 0.00 0.08 0.00 0.02 98.43 01:49:01 AM all 5.82 0.00 0.87 0.00 0.06 93.25 01:49:01 AM 0 6.70 0.00 1.01 0.00 0.07 92.21 01:49:01 AM 1 4.95 0.00 0.73 0.00 0.05 94.27 01:50:01 AM all 6.14 0.00 0.86 0.00 0.06 92.94 01:50:01 AM 0 0.77 0.00 0.20 0.00 0.03 99.00 01:50:01 AM 1 12.08 0.00 1.59 0.00 0.09 86.24 01:50:01 AM CPU %user %nice %system %iowait %steal %idle 01:51:01 AM all 5.93 0.00 0.90 0.00 0.07 93.10 01:51:01 AM 0 0.70 0.00 0.13 0.00 0.07 99.10 01:51:01 AM 1 11.70 0.00 1.75 0.00 0.07 86.47 01:52:01 AM all 5.73 0.00 0.83 0.00 0.06 93.38 01:52:01 AM 0 8.17 0.00 1.16 0.00 0.07 90.59 01:52:01 AM 1 3.37 0.00 0.50 0.00 0.05 96.08 01:53:01 AM all 6.49 0.00 0.89 0.00 0.06 92.56 01:53:01 AM 0 4.04 0.00 0.37 0.00 0.05 95.54 01:53:01 AM 1 9.10 0.00 1.45 0.00 0.07 89.38 01:54:01 AM all 5.61 0.00 0.52 0.00 0.07 93.81 01:54:01 AM 0 5.79 0.00 0.41 0.00 0.07 93.74 01:54:01 AM 1 5.43 0.00 0.62 0.00 0.07 93.88 01:55:01 AM all 4.48 0.00 0.18 0.00 0.04 95.29 01:55:01 AM 0 6.39 0.00 0.18 0.00 0.05 93.38 01:55:01 AM 1 2.58 0.00 0.18 0.00 0.03 97.21 01:56:02 AM all 4.31 0.16 0.24 0.01 0.08 95.21 01:56:02 AM 0 4.78 0.32 0.25 0.02 0.07 94.56 01:56:02 AM 1 3.83 0.00 0.23 0.00 0.08 95.85 01:57:01 AM all 4.41 0.00 0.18 0.00 0.06 95.35 01:57:01 AM 0 2.62 0.00 0.17 0.00 0.05 97.16 01:57:01 AM 1 6.21 0.00 0.19 0.00 0.07 93.54 01:58:01 AM all 4.41 0.00 0.19 0.00 0.06 95.34 01:58:01 AM 0 4.36 0.00 0.18 0.00 0.07 95.39 01:58:01 AM 1 4.47 0.00 0.20 0.00 0.05 95.28 01:59:01 AM all 4.41 0.00 0.18 0.00 0.05 95.36 01:59:01 AM 0 3.30 0.00 0.15 0.00 0.05 96.50 01:59:01 AM 1 5.53 0.00 0.20 0.00 0.05 94.22 02:00:01 AM all 7.49 0.00 0.28 0.00 0.06 92.17 02:00:01 AM 0 8.11 0.00 0.25 0.00 0.05 91.58 02:00:01 AM 1 6.87 0.00 0.30 0.00 0.07 92.76 02:01:01 AM all 0.63 0.00 0.11 0.00 0.04 99.22 02:01:01 AM 0 0.60 0.00 0.13 0.00 0.05 99.22 02:01:01 AM 1 0.65 0.00 0.08 0.00 0.03 99.23 02:01:01 AM CPU %user %nice %system %iowait %steal %idle 02:02:01 AM all 0.28 0.00 0.08 0.00 0.03 99.62 02:02:01 AM 0 0.45 0.00 0.05 0.00 0.03 99.47 02:02:01 AM 1 0.10 0.00 0.10 0.00 0.03 99.77 02:03:01 AM all 0.56 0.00 0.10 0.00 0.03 99.31 02:03:01 AM 0 0.93 0.00 0.07 0.00 0.03 98.97 02:03:01 AM 1 0.18 0.00 0.13 0.00 0.03 99.65 02:04:01 AM all 0.35 0.00 0.05 0.00 0.04 99.56 02:04:01 AM 0 0.57 0.00 0.03 0.00 0.03 99.37 02:04:01 AM 1 0.13 0.00 0.07 0.00 0.05 99.75 02:05:01 AM all 0.36 0.00 0.07 0.00 0.04 99.53 02:05:01 AM 0 0.57 0.00 0.05 0.00 0.02 99.37 02:05:01 AM 1 0.15 0.00 0.08 0.00 0.07 99.70 02:06:01 AM all 0.52 0.00 0.07 0.00 0.03 99.38 02:06:01 AM 0 0.62 0.00 0.08 0.00 0.05 99.25 02:06:01 AM 1 0.42 0.00 0.05 0.00 0.02 99.52 02:07:01 AM all 0.32 0.00 0.08 0.00 0.03 99.57 02:07:01 AM 0 0.52 0.00 0.07 0.00 0.03 99.38 02:07:01 AM 1 0.12 0.00 0.08 0.00 0.03 99.77 02:08:01 AM all 5.99 0.00 0.68 0.00 0.08 93.25 02:08:01 AM 0 0.78 0.00 0.12 0.00 0.07 99.03 02:08:01 AM 1 11.62 0.00 1.30 0.00 0.09 86.99 02:09:01 AM all 6.10 0.00 0.88 0.00 0.07 92.96 02:09:01 AM 0 2.13 0.00 0.39 0.00 0.05 97.43 02:09:01 AM 1 10.35 0.00 1.40 0.00 0.09 88.16 02:10:01 AM all 2.91 0.00 0.47 0.00 0.06 96.56 02:10:01 AM 0 2.37 0.00 0.34 0.00 0.05 97.24 02:10:01 AM 1 3.45 0.00 0.60 0.00 0.07 95.88 02:11:01 AM all 3.28 0.00 0.54 0.01 0.04 96.13 02:11:01 AM 0 0.77 0.00 0.12 0.02 0.02 99.08 02:11:01 AM 1 5.93 0.00 0.99 0.00 0.07 93.01 02:12:01 AM all 6.58 0.00 0.89 0.00 0.09 92.44 02:12:01 AM 0 2.89 0.00 0.44 0.00 0.08 96.58 02:12:01 AM 1 10.50 0.00 1.38 0.00 0.09 88.03 02:12:01 AM CPU %user %nice %system %iowait %steal %idle 02:13:01 AM all 5.16 0.00 0.22 0.00 0.06 94.57 02:13:01 AM 0 4.75 0.00 0.20 0.00 0.03 95.01 02:13:01 AM 1 5.56 0.00 0.24 0.00 0.08 94.12 02:14:01 AM all 4.17 0.00 0.18 0.08 0.05 95.51 02:14:01 AM 0 4.38 0.00 0.17 0.17 0.05 95.24 02:14:01 AM 1 3.97 0.00 0.20 0.00 0.05 95.78 02:15:01 AM all 4.48 0.00 0.21 0.00 0.05 95.26 02:15:01 AM 0 5.86 0.00 0.22 0.00 0.05 93.87 02:15:01 AM 1 3.10 0.00 0.20 0.00 0.05 96.65 02:16:01 AM all 4.43 0.00 0.21 0.00 0.05 95.31 02:16:01 AM 0 2.99 0.00 0.20 0.00 0.05 96.76 02:16:01 AM 1 5.87 0.00 0.22 0.00 0.05 93.86 02:17:01 AM all 4.16 0.00 0.19 0.00 0.07 95.58 02:17:01 AM 0 3.50 0.00 0.18 0.00 0.05 96.27 02:17:01 AM 1 4.83 0.00 0.20 0.00 0.08 94.89 02:18:01 AM all 4.45 0.00 0.22 0.00 0.04 95.29 02:18:01 AM 0 4.27 0.00 0.20 0.00 0.05 95.48 02:18:01 AM 1 4.64 0.00 0.23 0.00 0.03 95.09 02:19:01 AM all 5.59 0.00 0.24 0.00 0.06 94.11 02:19:01 AM 0 7.44 0.00 0.27 0.00 0.07 92.23 02:19:01 AM 1 3.74 0.00 0.22 0.00 0.05 96.00 02:20:01 AM all 0.44 0.00 0.06 0.00 0.03 99.47 02:20:01 AM 0 0.58 0.00 0.05 0.00 0.03 99.33 02:20:01 AM 1 0.30 0.00 0.07 0.00 0.03 99.60 02:21:01 AM all 0.33 0.00 0.05 0.00 0.03 99.59 02:21:01 AM 0 0.53 0.00 0.05 0.00 0.02 99.40 02:21:01 AM 1 0.13 0.00 0.05 0.00 0.03 99.78 02:22:01 AM all 0.54 0.00 0.08 0.00 0.03 99.34 02:22:01 AM 0 0.52 0.00 0.08 0.00 0.03 99.37 02:22:01 AM 1 0.57 0.00 0.08 0.00 0.03 99.32 02:23:01 AM all 0.26 0.00 0.06 0.00 0.03 99.65 02:23:01 AM 0 0.10 0.00 0.05 0.00 0.02 99.83 02:23:01 AM 1 0.42 0.00 0.07 0.00 0.05 99.46 02:23:01 AM CPU %user %nice %system %iowait %steal %idle 02:24:01 AM all 0.58 0.00 0.09 0.00 0.03 99.30 02:24:01 AM 0 0.45 0.00 0.10 0.00 0.03 99.42 02:24:01 AM 1 0.70 0.00 0.08 0.00 0.03 99.18 02:25:01 AM all 0.31 0.00 0.09 0.00 0.02 99.58 02:25:01 AM 0 0.17 0.00 0.07 0.00 0.02 99.75 02:25:01 AM 1 0.45 0.00 0.12 0.00 0.02 99.41 02:26:01 AM all 3.40 0.00 0.36 0.00 0.04 96.21 02:26:01 AM 0 5.21 0.00 0.59 0.00 0.05 94.16 02:26:01 AM 1 1.64 0.00 0.13 0.00 0.03 98.19 02:27:01 AM all 6.60 0.00 0.94 0.00 0.09 92.37 02:27:01 AM 0 9.60 0.00 1.29 0.00 0.11 89.00 02:27:01 AM 1 3.75 0.00 0.60 0.00 0.07 95.58 02:28:01 AM all 6.34 0.00 0.61 0.00 0.07 92.98 02:28:01 AM 0 2.41 0.00 0.18 0.00 0.05 97.36 02:28:01 AM 1 10.50 0.00 1.06 0.00 0.09 88.35 02:29:01 AM all 4.48 0.00 0.21 0.00 0.05 95.26 02:29:01 AM 0 3.78 0.00 0.20 0.00 0.03 95.99 02:29:01 AM 1 5.18 0.00 0.22 0.00 0.07 94.53 02:30:01 AM all 4.65 0.00 0.18 0.00 0.06 95.11 02:30:01 AM 0 3.06 0.00 0.17 0.00 0.07 96.71 02:30:01 AM 1 6.24 0.00 0.20 0.00 0.05 93.51 02:31:01 AM all 4.56 0.00 0.21 0.00 0.05 95.18 02:31:01 AM 0 4.19 0.00 0.22 0.00 0.05 95.55 02:31:01 AM 1 4.93 0.00 0.20 0.00 0.05 94.82 02:32:01 AM all 4.70 0.00 0.24 0.00 0.07 94.99 02:32:01 AM 0 4.66 0.00 0.23 0.00 0.08 95.02 02:32:01 AM 1 4.74 0.00 0.25 0.00 0.05 94.95 02:33:01 AM all 4.61 0.00 0.22 0.00 0.08 95.10 02:33:01 AM 0 6.57 0.00 0.23 0.00 0.08 93.12 02:33:01 AM 1 2.65 0.00 0.20 0.00 0.07 97.09 02:34:01 AM all 7.72 0.00 0.26 0.00 0.06 91.96 02:34:01 AM 0 7.61 0.00 0.25 0.00 0.07 92.07 02:34:01 AM 1 7.82 0.00 0.27 0.00 0.05 91.86 02:34:01 AM CPU %user %nice %system %iowait %steal %idle 02:35:01 AM all 0.81 0.00 0.09 0.00 0.03 99.06 02:35:01 AM 0 0.62 0.00 0.08 0.00 0.03 99.27 02:35:01 AM 1 1.00 0.00 0.10 0.00 0.03 98.86 02:36:01 AM all 0.33 0.00 0.08 0.00 0.03 99.56 02:36:01 AM 0 0.10 0.00 0.08 0.00 0.02 99.80 02:36:01 AM 1 0.57 0.00 0.08 0.00 0.03 99.31 02:37:01 AM all 0.52 0.00 0.08 0.00 0.03 99.38 02:37:01 AM 0 0.15 0.00 0.08 0.00 0.03 99.73 02:37:01 AM 1 0.89 0.00 0.07 0.00 0.02 99.03 02:38:01 AM all 0.34 0.00 0.07 0.00 0.03 99.56 02:38:01 AM 0 0.23 0.00 0.08 0.00 0.03 99.65 02:38:01 AM 1 0.45 0.00 0.05 0.00 0.03 99.47 02:39:01 AM all 0.39 0.00 0.06 0.00 0.02 99.53 02:39:01 AM 0 0.20 0.00 0.08 0.00 0.02 99.70 02:39:01 AM 1 0.58 0.00 0.03 0.00 0.02 99.37 02:40:01 AM all 0.55 0.00 0.08 0.00 0.03 99.33 02:40:01 AM 0 0.50 0.00 0.08 0.00 0.03 99.38 02:40:01 AM 1 0.60 0.00 0.08 0.00 0.03 99.28 02:41:01 AM all 0.35 0.00 0.06 0.00 0.03 99.56 02:41:01 AM 0 0.48 0.00 0.03 0.00 0.02 99.47 02:41:01 AM 1 0.22 0.00 0.08 0.00 0.05 99.65 02:42:01 AM all 5.92 0.00 0.75 0.00 0.06 93.27 02:42:01 AM 0 2.78 0.00 0.22 0.00 0.05 96.96 02:42:01 AM 1 9.30 0.00 1.31 0.00 0.07 89.31 02:43:01 AM all 6.65 0.00 0.95 0.00 0.07 92.33 02:43:01 AM 0 5.41 0.00 0.76 0.00 0.05 93.78 02:43:01 AM 1 7.93 0.00 1.16 0.00 0.09 90.83 02:44:01 AM all 5.58 0.00 0.33 0.00 0.06 94.03 02:44:01 AM 0 8.27 0.00 0.49 0.00 0.05 91.18 02:44:01 AM 1 2.92 0.00 0.17 0.00 0.07 96.85 02:45:01 AM all 4.60 0.00 0.20 0.00 0.06 95.14 02:45:01 AM 0 5.71 0.00 0.22 0.00 0.07 94.01 02:45:01 AM 1 3.49 0.00 0.18 0.00 0.05 96.28 02:45:01 AM CPU %user %nice %system %iowait %steal %idle 02:46:01 AM all 4.52 0.00 0.21 0.00 0.05 95.22 02:46:01 AM 0 6.21 0.00 0.22 0.00 0.05 93.52 02:46:01 AM 1 2.83 0.00 0.20 0.00 0.05 96.92 02:47:01 AM all 4.47 0.00 0.18 0.00 0.05 95.29 02:47:01 AM 0 5.68 0.00 0.20 0.00 0.05 94.07 02:47:01 AM 1 3.26 0.00 0.17 0.00 0.05 96.52 02:48:01 AM all 4.32 0.00 0.18 0.00 0.04 95.46 02:48:01 AM 0 4.32 0.00 0.18 0.00 0.03 95.47 02:48:01 AM 1 4.31 0.00 0.18 0.00 0.05 95.45 02:49:01 AM all 4.51 0.00 0.18 0.00 0.04 95.26 02:49:01 AM 0 6.42 0.00 0.22 0.00 0.05 93.31 02:49:01 AM 1 2.61 0.00 0.15 0.00 0.03 97.21 02:50:01 AM all 6.19 0.00 0.23 0.00 0.06 93.51 02:50:01 AM 0 6.07 0.00 0.23 0.00 0.05 93.64 02:50:01 AM 1 6.31 0.00 0.23 0.00 0.07 93.39 02:51:01 AM all 0.68 0.00 0.10 0.00 0.03 99.18 02:51:01 AM 0 0.67 0.00 0.08 0.00 0.03 99.22 02:51:01 AM 1 0.70 0.00 0.12 0.00 0.03 99.15 02:52:01 AM all 0.36 0.00 0.07 0.00 0.03 99.54 02:52:01 AM 0 0.15 0.00 0.07 0.00 0.03 99.75 02:52:01 AM 1 0.57 0.00 0.07 0.00 0.03 99.33 02:53:01 AM all 0.57 0.00 0.08 0.00 0.03 99.32 02:53:01 AM 0 0.28 0.00 0.07 0.00 0.03 99.62 02:53:01 AM 1 0.85 0.00 0.08 0.00 0.03 99.03 02:54:01 AM all 0.33 0.00 0.06 0.00 0.02 99.59 02:54:01 AM 0 0.53 0.00 0.05 0.00 0.02 99.40 02:54:01 AM 1 0.13 0.00 0.07 0.00 0.02 99.78 02:55:01 AM all 0.56 0.00 0.07 0.00 0.03 99.34 02:55:01 AM 0 0.92 0.00 0.07 0.00 0.03 98.98 02:55:01 AM 1 0.20 0.00 0.07 0.00 0.03 99.70 02:56:01 AM all 0.36 0.00 0.07 0.00 0.03 99.54 02:56:01 AM 0 0.12 0.00 0.07 0.00 0.03 99.78 02:56:01 AM 1 0.60 0.00 0.07 0.00 0.03 99.30 02:56:01 AM CPU %user %nice %system %iowait %steal %idle 02:57:01 AM all 0.34 0.00 0.06 0.00 0.03 99.57 02:57:01 AM 0 0.12 0.00 0.08 0.00 0.03 99.77 02:57:01 AM 1 0.57 0.00 0.03 0.00 0.02 99.38 02:58:01 AM all 6.65 0.00 0.93 0.00 0.05 92.37 02:58:01 AM 0 0.83 0.00 0.13 0.00 0.03 99.00 02:58:01 AM 1 13.06 0.00 1.80 0.00 0.07 85.07 02:59:01 AM all 6.53 0.00 0.88 0.00 0.07 92.51 02:59:01 AM 0 0.78 0.00 0.15 0.00 0.05 99.02 02:59:01 AM 1 12.87 0.00 1.69 0.00 0.09 85.34 03:00:01 AM all 4.99 0.00 0.20 0.00 0.05 94.76 03:00:01 AM 0 3.78 0.00 0.20 0.00 0.05 95.97 03:00:01 AM 1 6.19 0.00 0.20 0.00 0.05 93.56 03:01:01 AM all 4.32 0.00 0.18 0.00 0.05 95.44 03:01:01 AM 0 3.77 0.00 0.18 0.00 0.05 96.00 03:01:01 AM 1 4.88 0.00 0.18 0.00 0.05 94.89 03:02:01 AM all 3.55 0.00 0.16 0.00 0.05 96.24 03:02:01 AM 0 3.43 0.00 0.15 0.00 0.05 96.37 03:02:01 AM 1 3.67 0.00 0.17 0.00 0.05 96.12 03:03:02 AM all 4.55 0.00 0.20 0.00 0.05 95.19 03:03:02 AM 0 5.67 0.00 0.22 0.00 0.05 94.06 03:03:02 AM 1 3.43 0.00 0.18 0.00 0.05 96.33 03:04:01 AM all 4.36 0.00 0.20 0.01 0.05 95.37 03:04:01 AM 0 6.18 0.00 0.24 0.02 0.05 93.51 03:04:01 AM 1 2.54 0.00 0.17 0.00 0.05 97.24 03:05:01 AM all 4.31 0.00 0.19 0.00 0.04 95.45 03:05:01 AM 0 5.07 0.00 0.22 0.00 0.05 94.66 03:05:01 AM 1 3.55 0.00 0.17 0.00 0.03 96.25 03:06:01 AM all 5.68 0.00 0.20 0.00 0.07 94.05 03:06:01 AM 0 5.77 0.00 0.23 0.00 0.07 93.92 03:06:01 AM 1 5.59 0.00 0.17 0.00 0.07 94.18 03:07:01 AM all 0.76 0.00 0.09 0.00 0.04 99.11 03:07:01 AM 0 1.29 0.00 0.10 0.00 0.05 98.56 03:07:01 AM 1 0.23 0.00 0.08 0.00 0.03 99.65 03:07:01 AM CPU %user %nice %system %iowait %steal %idle 03:08:01 AM all 0.36 0.00 0.05 0.00 0.03 99.57 03:08:01 AM 0 0.60 0.00 0.03 0.00 0.02 99.35 03:08:01 AM 1 0.12 0.00 0.07 0.00 0.03 99.78 03:09:01 AM all 0.52 0.00 0.07 0.00 0.03 99.39 03:09:01 AM 0 0.58 0.00 0.07 0.00 0.02 99.33 03:09:01 AM 1 0.45 0.00 0.07 0.00 0.03 99.45 03:10:01 AM all 0.18 0.00 0.08 0.00 0.03 99.71 03:10:01 AM 0 0.12 0.00 0.08 0.00 0.03 99.77 03:10:01 AM 1 0.25 0.00 0.08 0.00 0.02 99.65 03:11:01 AM all 0.31 0.00 0.07 0.00 0.03 99.60 03:11:01 AM 0 0.15 0.00 0.08 0.00 0.03 99.73 03:11:01 AM 1 0.47 0.00 0.05 0.00 0.02 99.47 03:12:01 AM all 0.50 0.00 0.05 0.00 0.03 99.42 03:12:01 AM 0 0.28 0.00 0.07 0.00 0.03 99.62 03:12:01 AM 1 0.72 0.00 0.03 0.00 0.02 99.23 03:13:01 AM all 0.34 0.00 0.08 0.00 0.03 99.54 03:13:01 AM 0 0.13 0.00 0.10 0.00 0.03 99.73 03:13:01 AM 1 0.55 0.00 0.07 0.00 0.03 99.35 03:14:01 AM all 6.40 0.00 0.70 0.00 0.06 92.84 03:14:01 AM 0 8.31 0.00 1.03 0.00 0.07 90.59 03:14:01 AM 1 4.54 0.00 0.37 0.00 0.05 95.03 03:15:01 AM all 6.34 0.00 0.77 0.00 0.06 92.82 03:15:01 AM 0 3.38 0.00 0.28 0.00 0.05 96.28 03:15:01 AM 1 9.53 0.00 1.30 0.00 0.07 89.10 03:16:01 AM all 7.50 0.00 0.82 0.00 0.05 91.63 03:16:01 AM 0 13.18 0.00 1.40 0.00 0.05 85.36 03:16:01 AM 1 2.07 0.00 0.25 0.00 0.05 97.63 03:17:01 AM all 6.40 0.00 0.74 0.00 0.05 92.81 03:17:01 AM 0 3.03 0.00 0.17 0.00 0.03 96.77 03:17:01 AM 1 10.05 0.00 1.36 0.00 0.07 88.52 03:18:01 AM all 6.47 0.00 0.76 0.00 0.07 92.70 03:18:01 AM 0 3.51 0.00 0.42 0.00 0.07 96.00 03:18:01 AM 1 9.60 0.00 1.13 0.00 0.07 89.20 03:18:01 AM CPU %user %nice %system %iowait %steal %idle 03:19:01 AM all 7.20 0.00 0.78 0.00 0.05 91.96 03:19:01 AM 0 5.08 0.00 0.42 0.00 0.03 94.47 03:19:01 AM 1 9.46 0.00 1.16 0.00 0.07 89.31 03:20:01 AM all 7.53 0.00 0.82 0.00 0.07 91.58 03:20:01 AM 0 12.23 0.00 1.10 0.00 0.07 86.61 03:20:01 AM 1 2.94 0.00 0.54 0.00 0.07 96.44 03:21:01 AM all 9.98 0.00 0.90 0.00 0.09 89.04 03:21:01 AM 0 17.71 0.00 1.32 0.00 0.09 80.89 03:21:01 AM 1 2.51 0.00 0.49 0.00 0.08 96.91 03:22:01 AM all 25.65 0.00 2.56 0.18 0.08 71.54 03:22:01 AM 0 40.73 0.00 3.27 0.18 0.08 55.73 03:22:01 AM 1 10.56 0.00 1.84 0.17 0.08 87.35 Average: all 3.72 0.08 0.35 0.02 0.05 95.77 Average: 0 3.92 0.14 0.34 0.03 0.05 95.52 Average: 1 3.53 0.03 0.35 0.01 0.05 96.03