Started by upstream project "integration-distribution-mri-test-calcium" build number 65 originally caused by: Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on prd-centos8-robot-2c-8g-883 (centos8-robot-2c-8g) in workspace /w/workspace/controller-csit-3node-clustering-ask-all-calcium [ssh-agent] Looking for ssh-agent implementation... [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) $ ssh-agent SSH_AUTH_SOCK=/tmp/ssh-d5NUJ1ET0IfY/agent.5339 SSH_AGENT_PID=5340 [ssh-agent] Started. Running ssh-add (command line suppressed) Identity added: /w/workspace/controller-csit-3node-clustering-ask-all-calcium@tmp/private_key_170138358802015127.key (/w/workspace/controller-csit-3node-clustering-ask-all-calcium@tmp/private_key_170138358802015127.key) [ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key) The recommended git tool is: NONE using credential opendaylight-jenkins-ssh Wiping out workspace first. Cloning the remote Git repository Cloning repository git://devvexx.opendaylight.org/mirror/integration/test > git init /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test > git --version # timeout=10 > git --version # 'git version 2.43.0' using GIT_SSH to set credentials Release Engineering Jenkins Key [INFO] Currently running in a labeled security context [INFO] Currently SELinux is 'enforcing' on the host > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test@tmp/jenkins-gitclient-ssh8993947655401935429.key Verifying host key using known hosts file You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test using GIT_SSH to set credentials Release Engineering Jenkins Key [INFO] Currently running in a labeled security context [INFO] Currently SELinux is 'enforcing' on the host > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test@tmp/jenkins-gitclient-ssh12032424385701725398.key Verifying host key using known hosts file You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10 > git rev-parse FETCH_HEAD^{commit} # timeout=10 Checking out Revision 2398daf6144d1f3f14dd440639962fb247a8c4d5 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 2398daf6144d1f3f14dd440639962fb247a8c4d5 # timeout=10 Commit message: "Adapt scale tests for new connection-status value" > git rev-parse FETCH_HEAD^{commit} # timeout=10 > git rev-list --no-walk 950cd65cd21fcdb2f4ef581980b030ffbe85b94b # timeout=10 No emails were triggered. provisioning config files... copy managed file [npmrc] to file:/home/jenkins/.npmrc copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins7465901356092258469.sh ---> python-tools-install.sh Setup pyenv: system * 3.8.13 (set by /opt/pyenv/version) * 3.9.13 (set by /opt/pyenv/version) * 3.10.13 (set by /opt/pyenv/version) * 3.11.7 (set by /opt/pyenv/version) lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-sVRI lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-sVRI/bin to PATH Generating Requirements File Python 3.11.7 pip 24.3.1 from /tmp/venv-sVRI/lib/python3.11/site-packages/pip (python 3.11) appdirs==1.4.4 argcomplete==3.5.2 aspy.yaml==1.3.0 attrs==24.2.0 autopage==0.5.2 beautifulsoup4==4.12.3 boto3==1.35.76 botocore==1.35.76 bs4==0.0.2 cachetools==5.5.0 certifi==2024.8.30 cffi==1.17.1 cfgv==3.4.0 chardet==5.2.0 charset-normalizer==3.4.0 click==8.1.7 cliff==4.8.0 cmd2==2.5.7 cryptography==3.3.2 debtcollector==3.0.0 decorator==5.1.1 defusedxml==0.7.1 Deprecated==1.2.15 distlib==0.3.9 dnspython==2.7.0 docker==4.2.2 dogpile.cache==1.3.3 durationpy==0.9 email_validator==2.2.0 filelock==3.16.1 future==1.0.0 gitdb==4.0.11 GitPython==3.1.43 google-auth==2.36.0 httplib2==0.22.0 identify==2.6.3 idna==3.10 importlib-resources==1.5.0 iso8601==2.1.0 Jinja2==3.1.4 jmespath==1.0.1 jsonpatch==1.33 jsonpointer==3.0.0 jsonschema==4.23.0 jsonschema-specifications==2024.10.1 keystoneauth1==5.9.1 kubernetes==31.0.0 lftools==0.37.10 lxml==5.3.0 MarkupSafe==3.0.2 msgpack==1.1.0 multi_key_dict==2.0.3 munch==4.0.0 netaddr==1.3.0 netifaces==0.11.0 niet==1.4.2 nodeenv==1.9.1 oauth2client==4.1.3 oauthlib==3.2.2 openstacksdk==4.1.0 os-client-config==2.1.0 os-service-types==1.7.0 osc-lib==3.2.0 oslo.config==9.7.0 oslo.context==5.7.0 oslo.i18n==6.5.0 oslo.log==6.2.0 oslo.serialization==5.6.0 oslo.utils==8.0.0 packaging==24.2 pbr==6.1.0 platformdirs==4.3.6 prettytable==3.12.0 psutil==6.1.0 pyasn1==0.6.1 pyasn1_modules==0.4.1 pycparser==2.22 pygerrit2==2.0.15 PyGithub==2.5.0 PyJWT==2.10.1 PyNaCl==1.5.0 pyparsing==2.4.7 pyperclip==1.9.0 pyrsistent==0.20.0 python-cinderclient==9.6.0 python-dateutil==2.9.0.post0 python-heatclient==4.0.0 python-jenkins==1.8.2 python-keystoneclient==5.5.0 python-magnumclient==4.7.0 python-openstackclient==7.2.1 python-swiftclient==4.6.0 PyYAML==6.0.2 referencing==0.35.1 requests==2.32.3 requests-oauthlib==2.0.0 requestsexceptions==1.4.0 rfc3986==2.0.0 rpds-py==0.22.3 rsa==4.9 ruamel.yaml==0.18.6 ruamel.yaml.clib==0.2.12 s3transfer==0.10.4 simplejson==3.19.3 six==1.17.0 smmap==5.0.1 soupsieve==2.6 stevedore==5.4.0 tabulate==0.9.0 toml==0.10.2 tomlkit==0.13.2 tqdm==4.67.1 typing_extensions==4.12.2 tzdata==2024.2 urllib3==1.26.20 virtualenv==20.28.0 wcwidth==0.2.13 websocket-client==1.8.0 wrapt==1.17.0 xdg==6.0.0 xmltodict==0.14.2 yq==3.4.3 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_STACK_TEMPLATE=csit-2-instance-type.yaml OS_CLOUD=vex OS_STACK_NAME=releng-controller-csit-3node-clustering-ask-all-calcium-65 OS_STACK_TEMPLATE_DIR=openstack-hot [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins3521457780455324783.sh ---> Create parameters file for OpenStack HOT OpenStack Heat parameters generated ----------------------------------- parameters: vm_0_count: '3' vm_0_flavor: 'v3-standard-4' vm_0_image: 'ZZCI - Ubuntu 20.04 - builder - x86_64 - 20241201-160151.330' vm_1_count: '0' vm_1_flavor: 'v3-standard-2' vm_1_image: 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 - 20241201-060156.310' job_name: '37733-65' silo: 'releng' [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash -l /tmp/jenkins16210823164579874638.sh ---> Create HEAT stack + source /home/jenkins/lf-env.sh + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ++ mktemp -d /tmp/venv-XXXX + lf_venv=/tmp/venv-qY3j + local venv_file=/tmp/.os_lf_venv + local python=python3 + local options + local set_path=true + local install_args= ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\''' + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\''' ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + true + case $1 in + python=python3 + shift 2 + true + case $1 in + shift + break + case $python in + local pkg_list= + [[ -d /opt/pyenv ]] + echo 'Setup pyenv:' Setup pyenv: + export PYENV_ROOT=/opt/pyenv + PYENV_ROOT=/opt/pyenv + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + pyenv versions system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version) + command -v pyenv ++ pyenv init - --no-rehash + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; fi; done; echo "${paths[*]}"'\'')" export PATH="/opt/pyenv/shims:${PATH}" export PYENV_SHELL=bash source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\'' pyenv() { local command command="${1:-}" if [ "$#" -gt 0 ]; then shift fi case "$command" in rehash|shell) eval "$(pyenv "sh-$command" "$@")" ;; *) command pyenv "$command" "$@" ;; esac }' +++ bash --norc -ec 'IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; fi; done; echo "${paths[*]}"' ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ export PYENV_SHELL=bash ++ PYENV_SHELL=bash ++ source /opt/pyenv/libexec/../completions/pyenv.bash +++ complete -F _pyenv pyenv ++ lf-pyver python3 ++ local py_version_xy=python3 ++ local py_version_xyz= ++ awk '{ print $1 }' ++ pyenv versions ++ local command ++ command=versions ++ '[' 1 -gt 0 ']' ++ shift ++ case "$command" in ++ command pyenv versions ++ pyenv versions ++ sed 's/^[ *]* //' ++ grep -E '^[0-9.]*[0-9]$' ++ [[ ! -s /tmp/.pyenv_versions ]] +++ tail -n 1 +++ grep '^3' /tmp/.pyenv_versions +++ sort -V ++ py_version_xyz=3.11.7 ++ [[ -z 3.11.7 ]] ++ echo 3.11.7 ++ return 0 + pyenv local 3.11.7 + local command + command=local + '[' 2 -gt 0 ']' + shift + case "$command" in + command pyenv local 3.11.7 + pyenv local 3.11.7 + for arg in "$@" + case $arg in + pkg_list+='lftools[openstack] ' + for arg in "$@" + case $arg in + pkg_list+='kubernetes ' + for arg in "$@" + case $arg in + pkg_list+='niet ' + for arg in "$@" + case $arg in + pkg_list+='python-heatclient ' + for arg in "$@" + case $arg in + pkg_list+='python-openstackclient ' + for arg in "$@" + case $arg in + pkg_list+='python-magnumclient ' + for arg in "$@" + case $arg in + pkg_list+='yq ' + [[ -f /tmp/.os_lf_venv ]] ++ cat /tmp/.os_lf_venv + lf_venv=/tmp/venv-sVRI + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-sVRI from' file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Reuse venv:/tmp/venv-sVRI from file:/tmp/.os_lf_venv + /tmp/venv-sVRI/bin/python3 -m pip install --upgrade --quiet pip virtualenv + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ]] + echo 'lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ' lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + /tmp/venv-sVRI/bin/python3 -m pip install --upgrade --quiet --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + type python3 + true + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-sVRI/bin to PATH' lf-activate-venv(): INFO: Adding /tmp/venv-sVRI/bin to PATH + PATH=/tmp/venv-sVRI/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + return 0 + openstack --os-cloud vex limits show --absolute +--------------------------+---------+ | Name | Value | +--------------------------+---------+ | maxTotalInstances | -1 | | maxTotalCores | 450 | | maxTotalRAMSize | 1000000 | | maxServerMeta | 128 | | maxImageMeta | 128 | | maxPersonality | 5 | | maxPersonalitySize | 10240 | | maxTotalKeypairs | 100 | | maxServerGroups | 10 | | maxServerGroupMembers | 10 | | maxTotalFloatingIps | -1 | | maxSecurityGroups | -1 | | maxSecurityGroupRules | -1 | | totalRAMUsed | 688128 | | totalCoresUsed | 168 | | totalInstancesUsed | 58 | | totalFloatingIpsUsed | 0 | | totalSecurityGroupsUsed | 0 | | totalServerGroupsUsed | 0 | | maxTotalVolumes | -1 | | maxTotalSnapshots | 10 | | maxTotalVolumeGigabytes | 4096 | | maxTotalBackups | 10 | | maxTotalBackupGigabytes | 1000 | | totalVolumesUsed | 3 | | totalGigabytesUsed | 60 | | totalSnapshotsUsed | 0 | | totalBackupsUsed | 0 | | totalBackupGigabytesUsed | 0 | +--------------------------+---------+ + pushd /opt/ciman/openstack-hot /opt/ciman/openstack-hot /w/workspace/controller-csit-3node-clustering-ask-all-calcium + lftools openstack --os-cloud vex stack create releng-controller-csit-3node-clustering-ask-all-calcium-65 csit-2-instance-type.yaml /w/workspace/controller-csit-3node-clustering-ask-all-calcium/stack-parameters.yaml Creating stack releng-controller-csit-3node-clustering-ask-all-calcium-65 Waiting to initialize infrastructure... Stack initialization successful. ------------------------------------ Stack Details ------------------------------------ {'added': None, 'capabilities': [], 'created_at': '2024-12-07T23:35:22Z', 'deleted': None, 'deleted_at': None, 'description': 'No description', 'environment': None, 'environment_files': None, 'files': None, 'files_container': None, 'id': '3dcacceb-6691-4e48-84d0-44566385d853', 'is_rollback_disabled': True, 'links': [{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-controller-csit-3node-clustering-ask-all-calcium-65/3dcacceb-6691-4e48-84d0-44566385d853', 'rel': 'self'}], 'location': Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}), 'name': 'releng-controller-csit-3node-clustering-ask-all-calcium-65', 'notification_topics': [], 'outputs': [{'description': 'IP addresses of the 1st vm types', 'output_key': 'vm_0_ips', 'output_value': ['10.30.170.56', '10.30.171.237', '10.30.170.137']}, {'description': 'IP addresses of the 2nd vm types', 'output_key': 'vm_1_ips', 'output_value': []}], 'owner_id': ****, 'parameters': {'OS::project_id': '12c36e260d8e4bb2913965203b1b491f', 'OS::stack_id': '3dcacceb-6691-4e48-84d0-44566385d853', 'OS::stack_name': 'releng-controller-csit-3node-clustering-ask-all-calcium-65', 'job_name': '37733-65', 'silo': 'releng', 'vm_0_count': '3', 'vm_0_flavor': 'v3-standard-4', 'vm_0_image': 'ZZCI - Ubuntu 20.04 - builder - x86_64 - ' '20241201-160151.330', 'vm_1_count': '0', 'vm_1_flavor': 'v3-standard-2', 'vm_1_image': 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 ' '- 20241201-060156.310'}, 'parent_id': None, 'replaced': None, 'status': 'CREATE_COMPLETE', 'status_reason': 'Stack CREATE completed successfully', 'tags': [], 'template': None, 'template_description': 'No description', 'template_url': None, 'timeout_mins': 15, 'unchanged': None, 'updated': None, 'updated_at': None, 'user_project_id': 'fd298dff3f7e49cf9c9a3901bb588ffe'} ------------------------------------ + popd /w/workspace/controller-csit-3node-clustering-ask-all-calcium [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash -l /tmp/jenkins9505024167395834086.sh ---> Copy SSH public keys to CSIT lab Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-sVRI from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient lf-activate-venv(): INFO: Adding /tmp/venv-sVRI/bin to PATH SSH not responding on 10.30.171.237. Retrying in 10 seconds... SSH not responding on 10.30.170.56. Retrying in 10 seconds... SSH not responding on 10.30.170.137. Retrying in 10 seconds... Ping to 10.30.171.237 successful. Ping to 10.30.170.56 successful. Ping to 10.30.170.137 successful. SSH not responding on 10.30.171.237. Retrying in 10 seconds... SSH not responding on 10.30.170.137. Retrying in 10 seconds... SSH not responding on 10.30.170.56. Retrying in 10 seconds... Ping to 10.30.171.237 successful. Ping to 10.30.170.137 successful. Ping to 10.30.170.56 successful. Warning: Permanently added '10.30.171.237' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.56' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.137' (ECDSA) to the list of known hosts. releng-37733-65-0-builder-1 Successfully copied public keys to slave 10.30.171.237 releng-37733-65-0-builder-0 Successfully copied public keys to slave 10.30.170.56 Process 6731 ready. Process 6732 ready. releng-37733-65-0-builder-2 Successfully copied public keys to slave 10.30.170.137 Process 6734 ready. SSH ready on all stack servers. [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash -l /tmp/jenkins15973821103206261748.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version) lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-mM5Z lf-activate-venv(): INFO: Save venv in file: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.robot_venv lf-activate-venv(): INFO: Installing: setuptools wheel lf-activate-venv(): INFO: Adding /tmp/venv-mM5Z/bin to PATH + echo 'Installing Python Requirements' Installing Python Requirements + cat + python -m pip install -r requirements.txt Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple Collecting docker-py (from -r requirements.txt (line 1)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-py/1.10.6/docker_py-1.10.6-py2.py3-none-any.whl (50 kB) Collecting ipaddr (from -r requirements.txt (line 2)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ipaddr/2.2.0/ipaddr-2.2.0.tar.gz (26 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting netaddr (from -r requirements.txt (line 3)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/netaddr/1.3.0/netaddr-1.3.0-py3-none-any.whl (2.3 MB) Collecting netifaces (from -r requirements.txt (line 4)) Using cached netifaces-0.11.0-cp311-cp311-linux_x86_64.whl Collecting pyhocon (from -r requirements.txt (line 5)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyhocon/0.3.61/pyhocon-0.3.61-py3-none-any.whl (25 kB) Collecting requests (from -r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/requests/2.32.3/requests-2.32.3-py3-none-any.whl (64 kB) Collecting robotframework (from -r requirements.txt (line 7)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework/7.1.1/robotframework-7.1.1-py3-none-any.whl (730 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 730.6/730.6 kB 8.6 MB/s eta 0:00:00 Collecting robotframework-httplibrary (from -r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-httplibrary/0.4.2/robotframework-httplibrary-0.4.2.tar.gz (9.1 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting robotframework-requests==0.9.7 (from -r requirements.txt (line 9)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-requests/0.9.7/robotframework_requests-0.9.7-py3-none-any.whl (21 kB) Collecting robotframework-selenium2library (from -r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-selenium2library/3.0.0/robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB) Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-sshlibrary/3.8.0/robotframework-sshlibrary-3.8.0.tar.gz (51 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting scapy (from -r requirements.txt (line 12)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scapy/2.6.1/scapy-2.6.1-py3-none-any.whl (2.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.4/2.4 MB 27.8 MB/s eta 0:00:00 Collecting jsonpath-rw (from -r requirements.txt (line 15)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpath-rw/1.4.0/jsonpath-rw-1.4.0.tar.gz (13 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting elasticsearch (from -r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/8.16.0/elasticsearch-8.16.0-py3-none-any.whl (543 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 543.1/543.1 kB 8.6 MB/s eta 0:00:00 Collecting elasticsearch-dsl (from -r requirements.txt (line 19)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.16.0/elasticsearch_dsl-8.16.0-py3-none-any.whl (158 kB) Collecting pyangbind (from -r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyangbind/0.8.6/pyangbind-0.8.6-py3-none-any.whl (52 kB) Collecting isodate (from -r requirements.txt (line 25)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/isodate/0.7.2/isodate-0.7.2-py3-none-any.whl (22 kB) Collecting jmespath (from -r requirements.txt (line 28)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jmespath/1.0.1/jmespath-1.0.1-py3-none-any.whl (20 kB) Collecting jsonpatch (from -r requirements.txt (line 31)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpatch/1.33/jsonpatch-1.33-py2.py3-none-any.whl (12 kB) Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/paramiko/3.5.0/paramiko-3.5.0-py3-none-any.whl (227 kB) Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scp/0.15.0/scp-0.15.0-py2.py3-none-any.whl (8.8 kB) Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-pycreds/0.4.0/docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB) Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/six/1.17.0/six-1.17.0-py2.py3-none-any.whl (11 kB) Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/websocket-client/1.8.0/websocket_client-1.8.0-py3-none-any.whl (58 kB) Collecting pyparsing<4,>=2 (from pyhocon->-r requirements.txt (line 5)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pyparsing/3.2.0/pyparsing-3.2.0-py3-none-any.whl (106 kB) Collecting charset-normalizer<4,>=2 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/charset-normalizer/3.4.0/charset_normalizer-3.4.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (142 kB) Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/idna/3.10/idna-3.10-py3-none-any.whl (70 kB) Collecting urllib3<3,>=1.21.1 (from requests->-r requirements.txt (line 6)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.2.3/urllib3-2.2.3-py3-none-any.whl (126 kB) Collecting certifi>=2017.4.17 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/certifi/2024.8.30/certifi-2024.8.30-py3-none-any.whl (167 kB) Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webtest/3.0.2/WebTest-3.0.2-py3-none-any.whl (32 kB) Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpointer/3.0.0/jsonpointer-3.0.0-py2.py3-none-any.whl (7.6 kB) Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-seleniumlibrary/6.6.1/robotframework_seleniumlibrary-6.6.1-py2.py3-none-any.whl (104 kB) Collecting ply (from jsonpath-rw->-r requirements.txt (line 15)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ply/3.11/ply-3.11-py2.py3-none-any.whl (49 kB) Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/decorator/5.1.1/decorator-5.1.1-py3-none-any.whl (9.1 kB) Collecting elastic-transport<9,>=8.15.1 (from elasticsearch->-r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/8.15.1/elastic_transport-8.15.1-py3-none-any.whl (64 kB) Collecting python-dateutil (from elasticsearch-dsl->-r requirements.txt (line 19)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/python-dateutil/2.9.0.post0/python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) Collecting typing-extensions (from elasticsearch-dsl->-r requirements.txt (line 19)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/typing-extensions/4.12.2/typing_extensions-4.12.2-py3-none-any.whl (37 kB) Collecting pyang (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyang/2.6.1/pyang-2.6.1-py2.py3-none-any.whl (594 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 594.7/594.7 kB 6.4 MB/s eta 0:00:00 Collecting lxml (from pyangbind->-r requirements.txt (line 22)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/lxml/5.3.0/lxml-5.3.0-cp311-cp311-manylinux_2_28_x86_64.whl (5.0 MB) Collecting regex (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/regex/2024.11.6/regex-2024.11.6-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (792 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 792.7/792.7 kB 14.4 MB/s eta 0:00:00 Collecting enum34 (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/enum34/1.1.10/enum34-1.1.10-py3-none-any.whl (11 kB) Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/bcrypt/4.2.1/bcrypt-4.2.1-cp39-abi3-manylinux_2_28_x86_64.whl (278 kB) Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cryptography/44.0.0/cryptography-44.0.0-cp39-abi3-manylinux_2_28_x86_64.whl (4.2 MB) Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pynacl/1.5.0/PyNaCl-1.5.0-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl (856 kB) Collecting selenium>=4.3.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/selenium/4.27.1/selenium-4.27.1-py3-none-any.whl (9.7 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9.7/9.7 MB 28.5 MB/s eta 0:00:00 Collecting robotframework-pythonlibcore>=4.4.1 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-pythonlibcore/4.4.1/robotframework_pythonlibcore-4.4.1-py2.py3-none-any.whl (12 kB) Collecting click>=8.1.7 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/click/8.1.7/click-8.1.7-py3-none-any.whl (97 kB) Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webob/1.8.9/WebOb-1.8.9-py2.py3-none-any.whl (115 kB) Collecting waitress>=3.0.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/waitress/3.0.2/waitress-3.0.2-py3-none-any.whl (56 kB) Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/beautifulsoup4/4.12.3/beautifulsoup4-4.12.3-py3-none-any.whl (147 kB) Collecting cffi>=1.12 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cffi/1.17.1/cffi-1.17.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (467 kB) Collecting trio~=0.17 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio/0.27.0/trio-0.27.0-py3-none-any.whl (481 kB) Collecting trio-websocket~=0.9 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-websocket/0.11.1/trio_websocket-0.11.1-py3-none-any.whl (17 kB) Collecting soupsieve>1.2 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/soupsieve/2.6/soupsieve-2.6-py3-none-any.whl (36 kB) Collecting pycparser (from cffi>=1.12->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pycparser/2.22/pycparser-2.22-py3-none-any.whl (117 kB) Collecting attrs>=23.2.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/attrs/24.2.0/attrs-24.2.0-py3-none-any.whl (63 kB) Collecting sortedcontainers (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sortedcontainers/2.4.0/sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB) Collecting outcome (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/outcome/1.3.0.post0/outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB) Collecting sniffio>=1.3.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sniffio/1.3.1/sniffio-1.3.1-py3-none-any.whl (10 kB) Collecting wsproto>=0.14 (from trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/wsproto/1.2.0/wsproto-1.2.0-py3-none-any.whl (24 kB) Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]<3,>=1.26->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pysocks/1.7.1/PySocks-1.7.1-py3-none-any.whl (16 kB) Collecting h11<1,>=0.9.0 (from wsproto>=0.14->trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/h11/0.14.0/h11-0.14.0-py3-none-any.whl (58 kB) Building wheels for collected packages: robotframework-sshlibrary, ipaddr, robotframework-httplibrary, jsonpath-rw Building wheel for robotframework-sshlibrary (setup.py): started Building wheel for robotframework-sshlibrary (setup.py): finished with status 'done' Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55118 sha256=fe4b09f5f3b6dd45fa6eb142405058256c91e16e7526c348857213a1ac0f72ab Stored in directory: /home/jenkins/.cache/pip/wheels/f7/c9/b3/a977b7bcc410d45ae27d240df3d00a12585509180e373ecccc Building wheel for ipaddr (setup.py): started Building wheel for ipaddr (setup.py): finished with status 'done' Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18281 sha256=54c362fe36d6df7e1d0e65751e88768defa19d8ee64bffd4c9a207de150c0e5d Stored in directory: /home/jenkins/.cache/pip/wheels/dc/6c/04/da2d847fa8d45c59af3e1d83e2acc29cb8adcbaf04c0898dbf Building wheel for robotframework-httplibrary (setup.py): started Building wheel for robotframework-httplibrary (setup.py): finished with status 'done' Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=9955 sha256=d1e6d6df356bee5d5f849867dc94961ccaebcb187deedfa7b909af237a350598 Stored in directory: /home/jenkins/.cache/pip/wheels/aa/bc/0d/9a20dd51effef392aae2733cb4c7b66c6fa29fca33d88b57ed Building wheel for jsonpath-rw (setup.py): started Building wheel for jsonpath-rw (setup.py): finished with status 'done' Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15128 sha256=d725b770ea50ca23149e236f8d6aeeca497e039e55df591f5bf2e9b420a48b99 Stored in directory: /home/jenkins/.cache/pip/wheels/f1/54/63/9a8da38cefae13755097b36cc852decc25d8ef69c37d58d4eb Successfully built robotframework-sshlibrary ipaddr robotframework-httplibrary jsonpath-rw Installing collected packages: sortedcontainers, ply, netifaces, ipaddr, enum34, websocket-client, WebOb, waitress, urllib3, typing-extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, netaddr, lxml, jsonpointer, jmespath, isodate, idna, h11, decorator, click, charset-normalizer, certifi, bcrypt, attrs, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library Successfully installed WebOb-1.8.9 attrs-24.2.0 bcrypt-4.2.1 beautifulsoup4-4.12.3 certifi-2024.8.30 cffi-1.17.1 charset-normalizer-3.4.0 click-8.1.7 cryptography-44.0.0 decorator-5.1.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.15.1 elasticsearch-8.16.0 elasticsearch-dsl-8.16.0 enum34-1.1.10 h11-0.14.0 idna-3.10 ipaddr-2.2.0 isodate-0.7.2 jmespath-1.0.1 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-3.0.0 lxml-5.3.0 netaddr-1.3.0 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-3.5.0 ply-3.11 pyang-2.6.1 pyangbind-0.8.6 pycparser-2.22 pyhocon-0.3.61 pynacl-1.5.0 pyparsing-3.2.0 pysocks-1.7.1 python-dateutil-2.9.0.post0 regex-2024.11.6 requests-2.32.3 robotframework-7.1.1 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.4.1 robotframework-requests-0.9.7 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.6.1 robotframework-sshlibrary-3.8.0 scapy-2.6.1 scp-0.15.0 selenium-4.27.1 six-1.17.0 sniffio-1.3.1 sortedcontainers-2.4.0 soupsieve-2.6 trio-0.27.0 trio-websocket-0.11.1 typing-extensions-4.12.2 urllib3-2.2.3 waitress-3.0.2 websocket-client-1.8.0 webtest-3.0.2 wsproto-1.2.0 + pip freeze attrs==24.2.0 bcrypt==4.2.1 beautifulsoup4==4.12.3 certifi==2024.8.30 cffi==1.17.1 charset-normalizer==3.4.0 click==8.1.7 cryptography==44.0.0 decorator==5.1.1 distlib==0.3.9 docker-py==1.10.6 docker-pycreds==0.4.0 elastic-transport==8.15.1 elasticsearch==8.16.0 elasticsearch-dsl==8.16.0 enum34==1.1.10 filelock==3.16.1 h11==0.14.0 idna==3.10 ipaddr==2.2.0 isodate==0.7.2 jmespath==1.0.1 jsonpatch==1.33 jsonpath-rw==1.4.0 jsonpointer==3.0.0 lxml==5.3.0 netaddr==1.3.0 netifaces==0.11.0 outcome==1.3.0.post0 paramiko==3.5.0 platformdirs==4.3.6 ply==3.11 pyang==2.6.1 pyangbind==0.8.6 pycparser==2.22 pyhocon==0.3.61 PyNaCl==1.5.0 pyparsing==3.2.0 PySocks==1.7.1 python-dateutil==2.9.0.post0 regex==2024.11.6 requests==2.32.3 robotframework==7.1.1 robotframework-httplibrary==0.4.2 robotframework-pythonlibcore==4.4.1 robotframework-requests==0.9.7 robotframework-selenium2library==3.0.0 robotframework-seleniumlibrary==6.6.1 robotframework-sshlibrary==3.8.0 scapy==2.6.1 scp==0.15.0 selenium==4.27.1 six==1.17.0 sniffio==1.3.1 sortedcontainers==2.4.0 soupsieve==2.6 trio==0.27.0 trio-websocket==0.11.1 typing_extensions==4.12.2 urllib3==2.2.3 virtualenv==20.28.0 waitress==3.0.2 WebOb==1.8.9 websocket-client==1.8.0 WebTest==3.0.2 wsproto==1.2.0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'env.properties' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash -l /tmp/jenkins1508439011295050449.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-sVRI from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient yq ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. lftools 0.37.10 requires urllib3<2.1.0, but you have urllib3 2.2.3 which is incompatible. lf-activate-venv(): INFO: Adding /tmp/venv-sVRI/bin to PATH + ODL_SYSTEM=() + TOOLS_SYSTEM=() + OPENSTACK_SYSTEM=() + OPENSTACK_CONTROLLERS=() + mapfile -t ADDR ++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]' ++ openstack stack show -f json -c outputs releng-controller-csit-3node-clustering-ask-all-calcium-65 + for i in "${ADDR[@]}" ++ ssh 10.30.170.56 hostname -s Warning: Permanently added '10.30.170.56' (ECDSA) to the list of known hosts. + REMHOST=releng-37733-65-0-builder-0 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + for i in "${ADDR[@]}" ++ ssh 10.30.171.237 hostname -s Warning: Permanently added '10.30.171.237' (ECDSA) to the list of known hosts. + REMHOST=releng-37733-65-0-builder-1 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + for i in "${ADDR[@]}" ++ ssh 10.30.170.137 hostname -s Warning: Permanently added '10.30.170.137' (ECDSA) to the list of known hosts. + REMHOST=releng-37733-65-0-builder-2 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + echo NUM_ODL_SYSTEM=3 + echo NUM_TOOLS_SYSTEM=0 + '[' '' == yes ']' + NUM_OPENSTACK_SYSTEM=0 + echo NUM_OPENSTACK_SYSTEM=0 + '[' 0 -eq 2 ']' + echo ODL_SYSTEM_IP=10.30.170.56 ++ seq 0 2 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_1_IP=10.30.170.56 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_2_IP=10.30.171.237 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_3_IP=10.30.170.137 + echo TOOLS_SYSTEM_IP= ++ seq 0 -1 + openstack_index=0 + NUM_OPENSTACK_CONTROL_NODES=1 + echo NUM_OPENSTACK_CONTROL_NODES=1 ++ seq 0 0 + for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1))) + echo OPENSTACK_CONTROL_NODE_1_IP= + NUM_OPENSTACK_COMPUTE_NODES=-1 + echo NUM_OPENSTACK_COMPUTE_NODES=-1 + '[' -1 -ge 2 ']' ++ seq 0 -2 + NUM_OPENSTACK_HAPROXY_NODES=0 + echo NUM_OPENSTACK_HAPROXY_NODES=0 ++ seq 0 -1 + echo 'Contents of slave_addresses.txt:' Contents of slave_addresses.txt: + cat slave_addresses.txt NUM_ODL_SYSTEM=3 NUM_TOOLS_SYSTEM=0 NUM_OPENSTACK_SYSTEM=0 ODL_SYSTEM_IP=10.30.170.56 ODL_SYSTEM_1_IP=10.30.170.56 ODL_SYSTEM_2_IP=10.30.171.237 ODL_SYSTEM_3_IP=10.30.170.137 TOOLS_SYSTEM_IP= NUM_OPENSTACK_CONTROL_NODES=1 OPENSTACK_CONTROL_NODE_1_IP= NUM_OPENSTACK_COMPUTE_NODES=-1 NUM_OPENSTACK_HAPROXY_NODES=0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-ask-all-calcium] $ /bin/sh /tmp/jenkins14234037735900270122.sh Preparing for JRE Version 17 Karaf artifact is karaf Karaf project is integration Java home is /usr/lib/jvm/java-17-openjdk-amd64 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'set_variables.env' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins14583508691391559518.sh 2024-12-07 23:37:06 URL:https://git.opendaylight.org/gerrit/gitweb?p=integration/distribution.git;a=blob_plain;f=pom.xml;hb=stable/calcium [2619/2619] -> "pom.xml" [1] Bundle version is 0.20.3-SNAPSHOT --2024-12-07 23:37:06-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.3-SNAPSHOT/maven-metadata.xml Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 1410 (1.4K) [application/xml] Saving to: ‘maven-metadata.xml’ 0K . 100% 71.8M=0s 2024-12-07 23:37:06 (71.8 MB/s) - ‘maven-metadata.xml’ saved [1410/1410] org.opendaylight.integration karaf 0.20.3-SNAPSHOT 20241207.204717 381 20241207204717 pom 0.20.3-20241207.204717-381 20241207204717 tar.gz 0.20.3-20241207.204717-381 20241207204717 zip 0.20.3-20241207.204717-381 20241207204717 cyclonedx xml 0.20.3-20241207.204717-381 20241207204717 cyclonedx json 0.20.3-20241207.204717-381 20241207204717 Nexus timestamp is 0.20.3-20241207.204717-381 Distribution bundle URL is https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.3-SNAPSHOT/karaf-0.20.3-20241207.204717-381.zip Distribution bundle is karaf-0.20.3-20241207.204717-381.zip Distribution bundle version is 0.20.3-SNAPSHOT Distribution folder is karaf-0.20.3-SNAPSHOT Nexus prefix is https://nexus.opendaylight.org [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash -l /tmp/jenkins7787084956406687539.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-sVRI from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient lf-activate-venv(): INFO: Adding /tmp/venv-sVRI/bin to PATH Copying common-functions.sh to /tmp Copying common-functions.sh to 10.30.170.56:/tmp Warning: Permanently added '10.30.170.56' (ECDSA) to the list of known hosts. Copying common-functions.sh to 10.30.171.237:/tmp Warning: Permanently added '10.30.171.237' (ECDSA) to the list of known hosts. Copying common-functions.sh to 10.30.170.137:/tmp Warning: Permanently added '10.30.170.137' (ECDSA) to the list of known hosts. [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins5621780340258135277.sh common-functions.sh is being sourced common-functions environment: MAVENCONF: /tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.20.3-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.20.3-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.20.3-SNAPSHOT/bin/setenv CONTROLLERMEM: 2048m AKKACONF: /tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ################################################# ## Configure Cluster and Start ## ################################################# ACTUALFEATURES: odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app SPACE_SEPARATED_FEATURES: odl-integration-compatible-with-all odl-jolokia odl-restconf odl-clustering-test-app Locating script plan to use... script plan exists!!! Changing the script plan path... # Place the scripts in run order: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/scripts/car_people_shard.sh Executing /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/scripts/car_people_shard.sh... Add car-people shards file Copy shard config to member-1 with IP address 10.30.170.56 Warning: Permanently added '10.30.170.56' (ECDSA) to the list of known hosts. Copy shard config to member-2 with IP address 10.30.171.237 Warning: Permanently added '10.30.171.237' (ECDSA) to the list of known hosts. Copy shard config to member-3 with IP address 10.30.170.137 Warning: Permanently added '10.30.170.137' (ECDSA) to the list of known hosts. Finished running script plans Configuring member-1 with IP address 10.30.170.56 Warning: Permanently added '10.30.170.56' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.56' (ECDSA) to the list of known hosts. + source /tmp/common-functions.sh karaf-0.20.3-SNAPSHOT common-functions.sh is being sourced ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.20.3-SNAPSHOT ++ export MAVENCONF=/tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.20.3-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.20.3-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.20.3-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.20.3-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.20.3-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.20.3-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ export AKKACONF=/tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/akka.conf ++ AKKACONF=/tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/akka.conf ++ export MODULESCONF=/tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.20.3-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.20.3-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.20.3-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.3-SNAPSHOT/karaf-0.20.3-20241207.204717-381.zip + echo 'Changing to /tmp' + cd /tmp + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.3-SNAPSHOT/karaf-0.20.3-20241207.204717-381.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.3-SNAPSHOT/karaf-0.20.3-20241207.204717-381.zip --2024-12-07 23:37:18-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.3-SNAPSHOT/karaf-0.20.3-20241207.204717-381.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 268937293 (256M) [application/zip] Saving to: ‘karaf-0.20.3-20241207.204717-381.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 83.0M 3s 3072K ........ ........ ........ ........ ........ ........ 2% 146M 2s 6144K ........ ........ ........ ........ ........ ........ 3% 140M 2s 9216K ........ ........ ........ ........ ........ ........ 4% 170M 2s 12288K ........ ........ ........ ........ ........ ........ 5% 164M 2s 15360K ........ ........ ........ ........ ........ ........ 7% 223M 2s 18432K ........ ........ ........ ........ ........ ........ 8% 246M 2s 21504K ........ ........ ........ ........ ........ ........ 9% 236M 1s 24576K ........ ........ ........ ........ ........ ........ 10% 265M 1s 27648K ........ ........ ........ ........ ........ ........ 11% 285M 1s 30720K ........ ........ ........ ........ ........ ........ 12% 318M 1s 33792K ........ ........ ........ ........ ........ ........ 14% 298M 1s 36864K ........ ........ ........ ........ ........ ........ 15% 297M 1s 39936K ........ ........ ........ ........ ........ ........ 16% 306M 1s 43008K ........ ........ ........ ........ ........ ........ 17% 359M 1s 46080K ........ ........ ........ ........ ........ ........ 18% 368M 1s 49152K ........ ........ ........ ........ ........ ........ 19% 358M 1s 52224K ........ ........ ........ ........ ........ ........ 21% 386M 1s 55296K ........ ........ ........ ........ ........ ........ 22% 377M 1s 58368K ........ ........ ........ ........ ........ ........ 23% 369M 1s 61440K ........ ........ ........ ........ ........ ........ 24% 376M 1s 64512K ........ ........ ........ ........ ........ ........ 25% 371M 1s 67584K ........ ........ ........ ........ ........ ........ 26% 341M 1s 70656K ........ ........ ........ ........ ........ ........ 28% 287M 1s 73728K ........ ........ ........ ........ ........ ........ 29% 384M 1s 76800K ........ ........ ........ ........ ........ ........ 30% 457M 1s 79872K ........ ........ ........ ........ ........ ........ 31% 356M 1s 82944K ........ ........ ........ ........ ........ ........ 32% 346M 1s 86016K ........ ........ ........ ........ ........ ........ 33% 364M 1s 89088K ........ ........ ........ ........ ........ ........ 35% 341M 1s 92160K ........ ........ ........ ........ ........ ........ 36% 255M 1s 95232K ........ ........ ........ ........ ........ ........ 37% 278M 1s 98304K ........ ........ ........ ........ ........ ........ 38% 310M 1s 101376K ........ ........ ........ ........ ........ ........ 39% 359M 1s 104448K ........ ........ ........ ........ ........ ........ 40% 372M 1s 107520K ........ ........ ........ ........ ........ ........ 42% 301M 1s 110592K ........ ........ ........ ........ ........ ........ 43% 283M 1s 113664K ........ ........ ........ ........ ........ ........ 44% 269M 1s 116736K ........ ........ ........ ........ ........ ........ 45% 320M 1s 119808K ........ ........ ........ ........ ........ ........ 46% 363M 1s 122880K ........ ........ ........ ........ ........ ........ 47% 359M 0s 125952K ........ ........ ........ ........ ........ ........ 49% 329M 0s 129024K ........ ........ ........ ........ ........ ........ 50% 345M 0s 132096K ........ ........ ........ ........ ........ ........ 51% 302M 0s 135168K ........ ........ ........ ........ ........ ........ 52% 327M 0s 138240K ........ ........ ........ ........ ........ ........ 53% 359M 0s 141312K ........ ........ ........ ........ ........ ........ 54% 416M 0s 144384K ........ ........ ........ ........ ........ ........ 56% 377M 0s 147456K ........ ........ ........ ........ ........ ........ 57% 386M 0s 150528K ........ ........ ........ ........ ........ ........ 58% 385M 0s 153600K ........ ........ ........ ........ ........ ........ 59% 383M 0s 156672K ........ ........ ........ ........ ........ ........ 60% 382M 0s 159744K ........ ........ ........ ........ ........ ........ 61% 380M 0s 162816K ........ ........ ........ ........ ........ ........ 63% 374M 0s 165888K ........ ........ ........ ........ ........ ........ 64% 375M 0s 168960K ........ ........ ........ ........ ........ ........ 65% 376M 0s 172032K ........ ........ ........ ........ ........ ........ 66% 373M 0s 175104K ........ ........ ........ ........ ........ ........ 67% 353M 0s 178176K ........ ........ ........ ........ ........ ........ 69% 366M 0s 181248K ........ ........ ........ ........ ........ ........ 70% 354M 0s 184320K ........ ........ ........ ........ ........ ........ 71% 366M 0s 187392K ........ ........ ........ ........ ........ ........ 72% 371M 0s 190464K ........ ........ ........ ........ ........ ........ 73% 376M 0s 193536K ........ ........ ........ ........ ........ ........ 74% 373M 0s 196608K ........ ........ ........ ........ ........ ........ 76% 366M 0s 199680K ........ ........ ........ ........ ........ ........ 77% 380M 0s 202752K ........ ........ ........ ........ ........ ........ 78% 371M 0s 205824K ........ ........ ........ ........ ........ ........ 79% 376M 0s 208896K ........ ........ ........ ........ ........ ........ 80% 369M 0s 211968K ........ ........ ........ ........ ........ ........ 81% 385M 0s 215040K ........ ........ ........ ........ ........ ........ 83% 371M 0s 218112K ........ ........ ........ ........ ........ ........ 84% 370M 0s 221184K ........ ........ ........ ........ ........ ........ 85% 364M 0s 224256K ........ ........ ........ ........ ........ ........ 86% 372M 0s 227328K ........ ........ ........ ........ ........ ........ 87% 373M 0s 230400K ........ ........ ........ ........ ........ ........ 88% 377M 0s 233472K ........ ........ ........ ........ ........ ........ 90% 374M 0s 236544K ........ ........ ........ ........ ........ ........ 91% 377M 0s 239616K ........ ........ ........ ........ ........ ........ 92% 351M 0s 242688K ........ ........ ........ ........ ........ ........ 93% 337M 0s 245760K ........ ........ ........ ........ ........ ........ 94% 374M 0s 248832K ........ ........ ........ ........ ........ ........ 95% 292M 0s 251904K ........ ........ ........ ........ ........ ........ 97% 264M 0s 254976K ........ ........ ........ ........ ........ ........ 98% 246M 0s 258048K ........ ........ ........ ........ ........ ........ 99% 297M 0s 261120K ........ ........ ....... 100% 237M=0.8s 2024-12-07 23:37:18 (309 MB/s) - ‘karaf-0.20.3-20241207.204717-381.zip’ saved [268937293/268937293] Extracting the new controller... + echo 'Extracting the new controller...' + unzip -q karaf-0.20.3-20241207.204717-381.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features... + [[ True == \T\r\u\e ]] + echo 'Configuring the startup features...' + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.20.3-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.20.3-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.3-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.20.3-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.20.3-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.3-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/5e5050db-40ca-421d-9bae-7f1184ff177c.xml # # Comma separated list of features to install at startup # featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 0e40eeae-cd58-4c7f-8426-0d565115c16b # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + logapi=log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg controllerdebugmap: cat /tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' + unset IFS + echo 'controllerdebugmap: ' + '[' -n '' ']' + echo 'cat /tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN Configure + set_java_vars /usr/lib/jvm/java-17-openjdk-amd64 3072m /tmp/karaf-0.20.3-SNAPSHOT/bin/setenv + local -r java_home=/usr/lib/jvm/java-17-openjdk-amd64 + local -r controllermem=3072m + local -r memconf=/tmp/karaf-0.20.3-SNAPSHOT/bin/setenv + echo Configure java home: /usr/lib/jvm/java-17-openjdk-amd64 max memory: 3072m memconf: /tmp/karaf-0.20.3-SNAPSHOT/bin/setenv + echo ' java home: /usr/lib/jvm/java-17-openjdk-amd64' + echo ' max memory: 3072m' + echo ' memconf: /tmp/karaf-0.20.3-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk-amd64}%g' /tmp/karaf-0.20.3-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.20.3-SNAPSHOT/bin/setenv cat /tmp/karaf-0.20.3-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.20.3-SNAPSHOT/bin/setenv' + cat /tmp/karaf-0.20.3-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk-amd64} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk-amd64/bin/java 1 sudo: /usr/sbin/alternatives: command not found + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk-amd64/bin/java sudo: /usr/sbin/alternatives: command not found JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "11.0.25" 2024-10-15 OpenJDK Runtime Environment (build 11.0.25+9-post-Ubuntu-1ubuntu120.04) OpenJDK 64-Bit Server VM (build 11.0.25+9-post-Ubuntu-1ubuntu120.04, mixed mode, sharing) Set JAVA_HOME Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-amd64/bin/java Listing all open ports on controller system... Custom shard config exists!!! Copying the shard config... + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-17-openjdk-amd64 + JAVA_HOME=/usr/lib/jvm/java-17-openjdk-amd64 ++ readlink -e /usr/lib/jvm/java-17-openjdk-amd64/bin/java + JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-amd64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-amd64/bin/java' + echo 'Listing all open ports on controller system...' + netstat -pnatu /tmp/configuration-script.sh: line 40: netstat: command not found + '[' -f /tmp/custom_shard_config.txt ']' + echo 'Custom shard config exists!!!' + echo 'Copying the shard config...' + cp /tmp/custom_shard_config.txt /tmp/karaf-0.20.3-SNAPSHOT/bin/ Configuring cluster + echo 'Configuring cluster' + /tmp/karaf-0.20.3-SNAPSHOT/bin/configure_cluster.sh 1 10.30.170.56 10.30.171.237 10.30.170.137 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.20.3-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/9.0.5 Configuring unique name in akka.conf Configuring hostname in akka.conf Configuring data and rpc seed nodes in akka.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump akka.conf + echo 'Dump akka.conf' + cat /tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/akka.conf odl-cluster-data { akka { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.170.56" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["akka://opendaylight-cluster-data@10.30.170.56:2550", "akka://opendaylight-cluster-data@10.30.171.237:2550", "akka://opendaylight-cluster-data@10.30.170.137:2550"] roles = ["member-1"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" # Use lz4 compression for LocalSnapshotStore snapshots snapshot-store.local.use-lz4-compression = false # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB snapshot-store.local.lz4-blocksize = 256KB } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car" shards = [ { name="car" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "people" shards = [ { name="people" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car-people" shards = [ { name="car-people" replicas = ["member-1", "member-2", "member-3"] } ] } ] Configuring member-2 with IP address 10.30.171.237 Warning: Permanently added '10.30.171.237' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.237' (ECDSA) to the list of known hosts. + source /tmp/common-functions.sh karaf-0.20.3-SNAPSHOT common-functions.sh is being sourced ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.20.3-SNAPSHOT ++ export MAVENCONF=/tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.20.3-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.20.3-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.20.3-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.20.3-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.20.3-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.20.3-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ export AKKACONF=/tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/akka.conf ++ AKKACONF=/tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/akka.conf ++ export MODULESCONF=/tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.20.3-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.20.3-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.20.3-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.3-SNAPSHOT/karaf-0.20.3-20241207.204717-381.zip + echo 'Changing to /tmp' + cd /tmp + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.3-SNAPSHOT/karaf-0.20.3-20241207.204717-381.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.3-SNAPSHOT/karaf-0.20.3-20241207.204717-381.zip --2024-12-07 23:37:22-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.3-SNAPSHOT/karaf-0.20.3-20241207.204717-381.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 268937293 (256M) [application/zip] Saving to: ‘karaf-0.20.3-20241207.204717-381.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 73.0M 3s 3072K ........ ........ ........ ........ ........ ........ 2% 139M 3s 6144K ........ ........ ........ ........ ........ ........ 3% 164M 2s 9216K ........ ........ ........ ........ ........ ........ 4% 189M 2s 12288K ........ ........ ........ ........ ........ ........ 5% 183M 2s 15360K ........ ........ ........ ........ ........ ........ 7% 178M 2s 18432K ........ ........ ........ ........ ........ ........ 8% 185M 2s 21504K ........ ........ ........ ........ ........ ........ 9% 200M 2s 24576K ........ ........ ........ ........ ........ ........ 10% 207M 1s 27648K ........ ........ ........ ........ ........ ........ 11% 256M 1s 30720K ........ ........ ........ ........ ........ ........ 12% 255M 1s 33792K ........ ........ ........ ........ ........ ........ 14% 299M 1s 36864K ........ ........ ........ ........ ........ ........ 15% 311M 1s 39936K ........ ........ ........ ........ ........ ........ 16% 275M 1s 43008K ........ ........ ........ ........ ........ ........ 17% 292M 1s 46080K ........ ........ ........ ........ ........ ........ 18% 270M 1s 49152K ........ ........ ........ ........ ........ ........ 19% 297M 1s 52224K ........ ........ ........ ........ ........ ........ 21% 269M 1s 55296K ........ ........ ........ ........ ........ ........ 22% 275M 1s 58368K ........ ........ ........ ........ ........ ........ 23% 344M 1s 61440K ........ ........ ........ ........ ........ ........ 24% 309M 1s 64512K ........ ........ ........ ........ ........ ........ 25% 324M 1s 67584K ........ ........ ........ ........ ........ ........ 26% 353M 1s 70656K ........ ........ ........ ........ ........ ........ 28% 377M 1s 73728K ........ ........ ........ ........ ........ ........ 29% 281M 1s 76800K ........ ........ ........ ........ ........ ........ 30% 322M 1s 79872K ........ ........ ........ ........ ........ ........ 31% 362M 1s 82944K ........ ........ ........ ........ ........ ........ 32% 364M 1s 86016K ........ ........ ........ ........ ........ ........ 33% 244M 1s 89088K ........ ........ ........ ........ ........ ........ 35% 313M 1s 92160K ........ ........ ........ ........ ........ ........ 36% 369M 1s 95232K ........ ........ ........ ........ ........ ........ 37% 378M 1s 98304K ........ ........ ........ ........ ........ ........ 38% 369M 1s 101376K ........ ........ ........ ........ ........ ........ 39% 370M 1s 104448K ........ ........ ........ ........ ........ ........ 40% 321M 1s 107520K ........ ........ ........ ........ ........ ........ 42% 286M 1s 110592K ........ ........ ........ ........ ........ ........ 43% 304M 1s 113664K ........ ........ ........ ........ ........ ........ 44% 359M 1s 116736K ........ ........ ........ ........ ........ ........ 45% 358M 1s 119808K ........ ........ ........ ........ ........ ........ 46% 352M 1s 122880K ........ ........ ........ ........ ........ ........ 47% 356M 1s 125952K ........ ........ ........ ........ ........ ........ 49% 357M 1s 129024K ........ ........ ........ ........ ........ ........ 50% 360M 0s 132096K ........ ........ ........ ........ ........ ........ 51% 369M 0s 135168K ........ ........ ........ ........ ........ ........ 52% 352M 0s 138240K ........ ........ ........ ........ ........ ........ 53% 358M 0s 141312K ........ ........ ........ ........ ........ ........ 54% 360M 0s 144384K ........ ........ ........ ........ ........ ........ 56% 323M 0s 147456K ........ ........ ........ ........ ........ ........ 57% 349M 0s 150528K ........ ........ ........ ........ ........ ........ 58% 351M 0s 153600K ........ ........ ........ ........ ........ ........ 59% 344M 0s 156672K ........ ........ ........ ........ ........ ........ 60% 270M 0s 159744K ........ ........ ........ ........ ........ ........ 61% 200M 0s 162816K ........ ........ ........ ........ ........ ........ 63% 313M 0s 165888K ........ ........ ........ ........ ........ ........ 64% 345M 0s 168960K ........ ........ ........ ........ ........ ........ 65% 346M 0s 172032K ........ ........ ........ ........ ........ ........ 66% 341M 0s 175104K ........ ........ ........ ........ ........ ........ 67% 341M 0s 178176K ........ ........ ........ ........ ........ ........ 69% 351M 0s 181248K ........ ........ ........ ........ ........ ........ 70% 350M 0s 184320K ........ ........ ........ ........ ........ ........ 71% 351M 0s 187392K ........ ........ ........ ........ ........ ........ 72% 350M 0s 190464K ........ ........ ........ ........ ........ ........ 73% 343M 0s 193536K ........ ........ ........ ........ ........ ........ 74% 347M 0s 196608K ........ ........ ........ ........ ........ ........ 76% 338M 0s 199680K ........ ........ ........ ........ ........ ........ 77% 349M 0s 202752K ........ ........ ........ ........ ........ ........ 78% 327M 0s 205824K ........ ........ ........ ........ ........ ........ 79% 340M 0s 208896K ........ ........ ........ ........ ........ ........ 80% 348M 0s 211968K ........ ........ ........ ........ ........ ........ 81% 336M 0s 215040K ........ ........ ........ ........ ........ ........ 83% 341M 0s 218112K ........ ........ ........ ........ ........ ........ 84% 343M 0s 221184K ........ ........ ........ ........ ........ ........ 85% 345M 0s 224256K ........ ........ ........ ........ ........ ........ 86% 342M 0s 227328K ........ ........ ........ ........ ........ ........ 87% 339M 0s 230400K ........ ........ ........ ........ ........ ........ 88% 347M 0s 233472K ........ ........ ........ ........ ........ ........ 90% 323M 0s 236544K ........ ........ ........ ........ ........ ........ 91% 326M 0s 239616K ........ ........ ........ ........ ........ ........ 92% 325M 0s 242688K ........ ........ ........ ........ ........ ........ 93% 330M 0s 245760K ........ ........ ........ ........ ........ ........ 94% 330M 0s 248832K ........ ........ ........ ........ ........ ........ 95% 329M 0s 251904K ........ ........ ........ ........ ........ ........ 97% 338M 0s 254976K ........ ........ ........ ........ ........ ........ 98% 338M 0s 258048K ........ ........ ........ ........ ........ ........ 99% 328M 0s 261120K ........ ........ ....... 100% 350M=0.9s 2024-12-07 23:37:22 (291 MB/s) - ‘karaf-0.20.3-20241207.204717-381.zip’ saved [268937293/268937293] Extracting the new controller... + echo 'Extracting the new controller...' + unzip -q karaf-0.20.3-20241207.204717-381.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features... + [[ True == \T\r\u\e ]] + echo 'Configuring the startup features...' + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.20.3-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.20.3-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.3-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.20.3-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.20.3-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.3-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/5e5050db-40ca-421d-9bae-7f1184ff177c.xml # # Comma separated list of features to install at startup # featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 0e40eeae-cd58-4c7f-8426-0d565115c16b # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + logapi=log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg controllerdebugmap: cat /tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' + unset IFS + echo 'controllerdebugmap: ' + '[' -n '' ']' + echo 'cat /tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN Configure java home: /usr/lib/jvm/java-17-openjdk-amd64 max memory: 3072m memconf: /tmp/karaf-0.20.3-SNAPSHOT/bin/setenv + set_java_vars /usr/lib/jvm/java-17-openjdk-amd64 3072m /tmp/karaf-0.20.3-SNAPSHOT/bin/setenv + local -r java_home=/usr/lib/jvm/java-17-openjdk-amd64 + local -r controllermem=3072m + local -r memconf=/tmp/karaf-0.20.3-SNAPSHOT/bin/setenv + echo Configure + echo ' java home: /usr/lib/jvm/java-17-openjdk-amd64' + echo ' max memory: 3072m' + echo ' memconf: /tmp/karaf-0.20.3-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk-amd64}%g' /tmp/karaf-0.20.3-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.20.3-SNAPSHOT/bin/setenv cat /tmp/karaf-0.20.3-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.20.3-SNAPSHOT/bin/setenv' + cat /tmp/karaf-0.20.3-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk-amd64} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk-amd64/bin/java 1 sudo: /usr/sbin/alternatives: command not found + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk-amd64/bin/java sudo: /usr/sbin/alternatives: command not found JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "11.0.25" 2024-10-15 OpenJDK Runtime Environment (build 11.0.25+9-post-Ubuntu-1ubuntu120.04) OpenJDK 64-Bit Server VM (build 11.0.25+9-post-Ubuntu-1ubuntu120.04, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-17-openjdk-amd64 + JAVA_HOME=/usr/lib/jvm/java-17-openjdk-amd64 ++ readlink -e /usr/lib/jvm/java-17-openjdk-amd64/bin/java Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-amd64/bin/java Listing all open ports on controller system... Custom shard config exists!!! Copying the shard config... + JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-amd64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-amd64/bin/java' + echo 'Listing all open ports on controller system...' + netstat -pnatu /tmp/configuration-script.sh: line 40: netstat: command not found + '[' -f /tmp/custom_shard_config.txt ']' + echo 'Custom shard config exists!!!' + echo 'Copying the shard config...' + cp /tmp/custom_shard_config.txt /tmp/karaf-0.20.3-SNAPSHOT/bin/ Configuring cluster + echo 'Configuring cluster' + /tmp/karaf-0.20.3-SNAPSHOT/bin/configure_cluster.sh 2 10.30.170.56 10.30.171.237 10.30.170.137 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.20.3-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/9.0.5 Configuring unique name in akka.conf Configuring hostname in akka.conf Configuring data and rpc seed nodes in akka.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump akka.conf + echo 'Dump akka.conf' + cat /tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/akka.conf odl-cluster-data { akka { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.171.237" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["akka://opendaylight-cluster-data@10.30.170.56:2550", "akka://opendaylight-cluster-data@10.30.171.237:2550", "akka://opendaylight-cluster-data@10.30.170.137:2550"] roles = ["member-2"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" # Use lz4 compression for LocalSnapshotStore snapshots snapshot-store.local.use-lz4-compression = false # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB snapshot-store.local.lz4-blocksize = 256KB } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car" shards = [ { name="car" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "people" shards = [ { name="people" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car-people" shards = [ { name="car-people" replicas = ["member-1", "member-2", "member-3"] } ] } ] Configuring member-3 with IP address 10.30.170.137 Warning: Permanently added '10.30.170.137' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.137' (ECDSA) to the list of known hosts. common-functions.sh is being sourced + source /tmp/common-functions.sh karaf-0.20.3-SNAPSHOT ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.20.3-SNAPSHOT ++ export MAVENCONF=/tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.20.3-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.20.3-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.20.3-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.20.3-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.20.3-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.20.3-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ export AKKACONF=/tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/akka.conf ++ AKKACONF=/tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/akka.conf ++ export MODULESCONF=/tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.20.3-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.20.3-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.20.3-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.3-SNAPSHOT/karaf-0.20.3-20241207.204717-381.zip + echo 'Changing to /tmp' + cd /tmp + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.3-SNAPSHOT/karaf-0.20.3-20241207.204717-381.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.3-SNAPSHOT/karaf-0.20.3-20241207.204717-381.zip --2024-12-07 23:37:26-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.3-SNAPSHOT/karaf-0.20.3-20241207.204717-381.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 268937293 (256M) [application/zip] Saving to: ‘karaf-0.20.3-20241207.204717-381.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 70.9M 4s 3072K ........ ........ ........ ........ ........ ........ 2% 118M 3s 6144K ........ ........ ........ ........ ........ ........ 3% 171M 2s 9216K ........ ........ ........ ........ ........ ........ 4% 204M 2s 12288K ........ ........ ........ ........ ........ ........ 5% 242M 2s 15360K ........ ........ ........ ........ ........ ........ 7% 231M 2s 18432K ........ ........ ........ ........ ........ ........ 8% 226M 2s 21504K ........ ........ ........ ........ ........ ........ 9% 281M 1s 24576K ........ ........ ........ ........ ........ ........ 10% 258M 1s 27648K ........ ........ ........ ........ ........ ........ 11% 267M 1s 30720K ........ ........ ........ ........ ........ ........ 12% 260M 1s 33792K ........ ........ ........ ........ ........ ........ 14% 261M 1s 36864K ........ ........ ........ ........ ........ ........ 15% 242M 1s 39936K ........ ........ ........ ........ ........ ........ 16% 250M 1s 43008K ........ ........ ........ ........ ........ ........ 17% 259M 1s 46080K ........ ........ ........ ........ ........ ........ 18% 238M 1s 49152K ........ ........ ........ ........ ........ ........ 19% 242M 1s 52224K ........ ........ ........ ........ ........ ........ 21% 301M 1s 55296K ........ ........ ........ ........ ........ ........ 22% 235M 1s 58368K ........ ........ ........ ........ ........ ........ 23% 284M 1s 61440K ........ ........ ........ ........ ........ ........ 24% 343M 1s 64512K ........ ........ ........ ........ ........ ........ 25% 199M 1s 67584K ........ ........ ........ ........ ........ ........ 26% 240M 1s 70656K ........ ........ ........ ........ ........ ........ 28% 268M 1s 73728K ........ ........ ........ ........ ........ ........ 29% 319M 1s 76800K ........ ........ ........ ........ ........ ........ 30% 205M 1s 79872K ........ ........ ........ ........ ........ ........ 31% 228M 1s 82944K ........ ........ ........ ........ ........ ........ 32% 278M 1s 86016K ........ ........ ........ ........ ........ ........ 33% 329M 1s 89088K ........ ........ ........ ........ ........ ........ 35% 338M 1s 92160K ........ ........ ........ ........ ........ ........ 36% 328M 1s 95232K ........ ........ ........ ........ ........ ........ 37% 342M 1s 98304K ........ ........ ........ ........ ........ ........ 38% 336M 1s 101376K ........ ........ ........ ........ ........ ........ 39% 339M 1s 104448K ........ ........ ........ ........ ........ ........ 40% 329M 1s 107520K ........ ........ ........ ........ ........ ........ 42% 331M 1s 110592K ........ ........ ........ ........ ........ ........ 43% 329M 1s 113664K ........ ........ ........ ........ ........ ........ 44% 342M 1s 116736K ........ ........ ........ ........ ........ ........ 45% 334M 1s 119808K ........ ........ ........ ........ ........ ........ 46% 341M 1s 122880K ........ ........ ........ ........ ........ ........ 47% 363M 1s 125952K ........ ........ ........ ........ ........ ........ 49% 341M 1s 129024K ........ ........ ........ ........ ........ ........ 50% 337M 1s 132096K ........ ........ ........ ........ ........ ........ 51% 329M 0s 135168K ........ ........ ........ ........ ........ ........ 52% 330M 0s 138240K ........ ........ ........ ........ ........ ........ 53% 327M 0s 141312K ........ ........ ........ ........ ........ ........ 54% 341M 0s 144384K ........ ........ ........ ........ ........ ........ 56% 322M 0s 147456K ........ ........ ........ ........ ........ ........ 57% 327M 0s 150528K ........ ........ ........ ........ ........ ........ 58% 351M 0s 153600K ........ ........ ........ ........ ........ ........ 59% 339M 0s 156672K ........ ........ ........ ........ ........ ........ 60% 333M 0s 159744K ........ ........ ........ ........ ........ ........ 61% 332M 0s 162816K ........ ........ ........ ........ ........ ........ 63% 331M 0s 165888K ........ ........ ........ ........ ........ ........ 64% 340M 0s 168960K ........ ........ ........ ........ ........ ........ 65% 337M 0s 172032K ........ ........ ........ ........ ........ ........ 66% 336M 0s 175104K ........ ........ ........ ........ ........ ........ 67% 333M 0s 178176K ........ ........ ........ ........ ........ ........ 69% 298M 0s 181248K ........ ........ ........ ........ ........ ........ 70% 292M 0s 184320K ........ ........ ........ ........ ........ ........ 71% 478M 0s 187392K ........ ........ ........ ........ ........ ........ 72% 334M 0s 190464K ........ ........ ........ ........ ........ ........ 73% 339M 0s 193536K ........ ........ ........ ........ ........ ........ 74% 279M 0s 196608K ........ ........ ........ ........ ........ ........ 76% 222M 0s 199680K ........ ........ ........ ........ ........ ........ 77% 236M 0s 202752K ........ ........ ........ ........ ........ ........ 78% 257M 0s 205824K ........ ........ ........ ........ ........ ........ 79% 226M 0s 208896K ........ ........ ........ ........ ........ ........ 80% 249M 0s 211968K ........ ........ ........ ........ ........ ........ 81% 312M 0s 215040K ........ ........ ........ ........ ........ ........ 83% 323M 0s 218112K ........ ........ ........ ........ ........ ........ 84% 276M 0s 221184K ........ ........ ........ ........ ........ ........ 85% 281M 0s 224256K ........ ........ ........ ........ ........ ........ 86% 335M 0s 227328K ........ ........ ........ ........ ........ ........ 87% 326M 0s 230400K ........ ........ ........ ........ ........ ........ 88% 342M 0s 233472K ........ ........ ........ ........ ........ ........ 90% 334M 0s 236544K ........ ........ ........ ........ ........ ........ 91% 329M 0s 239616K ........ ........ ........ ........ ........ ........ 92% 332M 0s 242688K ........ ........ ........ ........ ........ ........ 93% 319M 0s 245760K ........ ........ ........ ........ ........ ........ 94% 311M 0s 248832K ........ ........ ........ ........ ........ ........ 95% 313M 0s 251904K ........ ........ ........ ........ ........ ........ 97% 302M 0s 254976K ........ ........ ........ ........ ........ ........ 98% 293M 0s 258048K ....Extracting the new controller... .... ........ ........ ........ ........ ........ 99% 301M 0s 261120K ........ ........ ....... 100% 326M=0.9s 2024-12-07 23:37:27 (276 MB/s) - ‘karaf-0.20.3-20241207.204717-381.zip’ saved [268937293/268937293] + echo 'Extracting the new controller...' + unzip -q karaf-0.20.3-20241207.204717-381.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.+ [[ True == \T\r\u\e ]] + echo 'Configuring the startup features...' Configuring the startup features... + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.20.3-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.20.3-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.3-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.20.3-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.20.3-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.3-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/5e5050db-40ca-421d-9bae-7f1184ff177c.xml # # Comma separated list of features to install at startup # featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 0e40eeae-cd58-4c7f-8426-0d565115c16b # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE + logapi=log4j2 Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' controllerdebugmap: + unset IFS + echo 'controllerdebugmap: ' + '[' -n '' ']' + echo 'cat /tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' cat /tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + cat /tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN + set_java_vars /usr/lib/jvm/java-17-openjdk-amd64 3072m /tmp/karaf-0.20.3-SNAPSHOT/bin/setenv + local -r java_home=/usr/lib/jvm/java-17-openjdk-amd64 + local -r controllermem=3072m + local -r memconf=/tmp/karaf-0.20.3-SNAPSHOT/bin/setenv + echo Configure Configure java home: /usr/lib/jvm/java-17-openjdk-amd64 + echo ' java home: /usr/lib/jvm/java-17-openjdk-amd64' + echo ' max memory: 3072m' max memory: 3072m memconf: /tmp/karaf-0.20.3-SNAPSHOT/bin/setenv + echo ' memconf: /tmp/karaf-0.20.3-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk-amd64}%g' /tmp/karaf-0.20.3-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.20.3-SNAPSHOT/bin/setenv cat /tmp/karaf-0.20.3-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.20.3-SNAPSHOT/bin/setenv' + cat /tmp/karaf-0.20.3-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk-amd64} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk-amd64/bin/java 1 sudo: /usr/sbin/alternatives: command not found + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk-amd64/bin/java sudo: /usr/sbin/alternatives: command not found + echo 'JDK default version ...' JDK default version ... + java -version openjdk version "11.0.25" 2024-10-15 OpenJDK Runtime Environment (build 11.0.25+9-post-Ubuntu-1ubuntu120.04) OpenJDK 64-Bit Server VM (build 11.0.25+9-post-Ubuntu-1ubuntu120.04, mixed mode, sharing) Set JAVA_HOME Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-amd64/bin/java Listing all open ports on controller system... + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-17-openjdk-amd64 + JAVA_HOME=/usr/lib/jvm/java-17-openjdk-amd64 ++ readlink -e /usr/lib/jvm/java-17-openjdk-amd64/bin/java + JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-amd64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-amd64/bin/java' + echo 'Listing all open ports on controller system...' + netstat -pnatu /tmp/configuration-script.sh: line 40: netstat: command not found Custom shard config exists!!! Copying the shard config... + '[' -f /tmp/custom_shard_config.txt ']' + echo 'Custom shard config exists!!!' + echo 'Copying the shard config...' + cp /tmp/custom_shard_config.txt /tmp/karaf-0.20.3-SNAPSHOT/bin/ Configuring cluster + echo 'Configuring cluster' + /tmp/karaf-0.20.3-SNAPSHOT/bin/configure_cluster.sh 3 10.30.170.56 10.30.171.237 10.30.170.137 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.20.3-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/9.0.5 Configuring unique name in akka.conf Configuring hostname in akka.conf Configuring data and rpc seed nodes in akka.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump akka.conf + echo 'Dump akka.conf' + cat /tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/akka.conf odl-cluster-data { akka { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.170.137" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["akka://opendaylight-cluster-data@10.30.170.56:2550", "akka://opendaylight-cluster-data@10.30.171.237:2550", "akka://opendaylight-cluster-data@10.30.170.137:2550"] roles = ["member-3"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" # Use lz4 compression for LocalSnapshotStore snapshots snapshot-store.local.use-lz4-compression = false # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB snapshot-store.local.lz4-blocksize = 256KB } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car" shards = [ { name="car" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "people" shards = [ { name="people" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car-people" shards = [ { name="car-people" replicas = ["member-1", "member-2", "member-3"] } ] } ] Locating config plan to use... Finished running config plans Starting member-1 with IP address 10.30.170.56 Warning: Permanently added '10.30.170.56' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.56' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.20.3-SNAPSHOT/data/log/karaf_console.log Starting member-2 with IP address 10.30.171.237 Warning: Permanently added '10.30.171.237' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.237' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.20.3-SNAPSHOT/data/log/karaf_console.log Starting member-3 with IP address 10.30.170.137 Warning: Permanently added '10.30.170.137' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.137' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.20.3-SNAPSHOT/data/log/karaf_console.log [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins16329481588269260881.sh common-functions.sh is being sourced common-functions environment: MAVENCONF: /tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.20.3-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.20.3-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.20.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.20.3-SNAPSHOT/bin/setenv CONTROLLERMEM: 2048m AKKACONF: /tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.20.3-SNAPSHOT/configuration/initial/module-shards.conf SUITES: + echo '#################################################' ################################################# + echo '## Verify Cluster is UP ##' ## Verify Cluster is UP ## + echo '#################################################' ################################################# + create_post_startup_script + cat + copy_and_run_post_startup_script + seed_index=1 ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Execute the post startup script on controller 10.30.170.56' Execute the post startup script on controller 10.30.170.56 + scp /w/workspace/controller-csit-3node-clustering-ask-all-calcium/post-startup-script.sh 10.30.170.56:/tmp/ Warning: Permanently added '10.30.170.56' (ECDSA) to the list of known hosts. + ssh 10.30.170.56 'bash /tmp/post-startup-script.sh 1' Warning: Permanently added '10.30.170.56' (ECDSA) to the list of known hosts. /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2024-12-07T23:38:25,477 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 297 - org.opendaylight.infrautils.ready-api - 6.0.10 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2024-12-07T23:38:25,477 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 297 - org.opendaylight.infrautils.ready-api - 6.0.10 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... /tmp/post-startup-script.sh: line 51: netstat: command not found looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 1 == 0 ']' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Execute the post startup script on controller 10.30.171.237' Execute the post startup script on controller 10.30.171.237 + scp /w/workspace/controller-csit-3node-clustering-ask-all-calcium/post-startup-script.sh 10.30.171.237:/tmp/ Warning: Permanently added '10.30.171.237' (ECDSA) to the list of known hosts. + ssh 10.30.171.237 'bash /tmp/post-startup-script.sh 2' Warning: Permanently added '10.30.171.237' (ECDSA) to the list of known hosts. /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2024-12-07T23:38:25,950 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 297 - org.opendaylight.infrautils.ready-api - 6.0.10 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2024-12-07T23:38:25,950 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 297 - org.opendaylight.infrautils.ready-api - 6.0.10 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... /tmp/post-startup-script.sh: line 51: netstat: command not found looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 2 == 0 ']' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Execute the post startup script on controller 10.30.170.137' Execute the post startup script on controller 10.30.170.137 + scp /w/workspace/controller-csit-3node-clustering-ask-all-calcium/post-startup-script.sh 10.30.170.137:/tmp/ Warning: Permanently added '10.30.170.137' (ECDSA) to the list of known hosts. + ssh 10.30.170.137 'bash /tmp/post-startup-script.sh 3' Warning: Permanently added '10.30.170.137' (ECDSA) to the list of known hosts. /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2024-12-07T23:38:25,049 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 297 - org.opendaylight.infrautils.ready-api - 6.0.10 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2024-12-07T23:38:25,049 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 297 - org.opendaylight.infrautils.ready-api - 6.0.10 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... /tmp/post-startup-script.sh: line 51: netstat: command not found looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 0 == 0 ']' + seed_index=1 + dump_controller_threads ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.170.56 'sudo ps aux' Warning: Permanently added '10.30.170.56' (ECDSA) to the list of known hosts. ++ tr -s ' ' ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-calcium/ps_before.log ++ grep -v grep ++ cut -f2 '-d ' + pid=28722 + echo 'karaf main: org.apache.karaf.main.Main, pid:28722' karaf main: org.apache.karaf.main.Main, pid:28722 + ssh 10.30.170.56 '/usr/lib/jvm/java-17-openjdk-amd64/bin/jstack -l 28722' Warning: Permanently added '10.30.170.56' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.171.237 'sudo ps aux' Warning: Permanently added '10.30.171.237' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-calcium/ps_before.log ++ grep -v grep ++ tr -s ' ' ++ cut -f2 '-d ' + pid=28784 + echo 'karaf main: org.apache.karaf.main.Main, pid:28784' karaf main: org.apache.karaf.main.Main, pid:28784 + ssh 10.30.171.237 '/usr/lib/jvm/java-17-openjdk-amd64/bin/jstack -l 28784' Warning: Permanently added '10.30.171.237' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.170.137 'sudo ps aux' Warning: Permanently added '10.30.170.137' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-calcium/ps_before.log ++ grep -v grep ++ tr -s ' ' ++ cut -f2 '-d ' + pid=28741 + echo 'karaf main: org.apache.karaf.main.Main, pid:28741' karaf main: org.apache.karaf.main.Main, pid:28741 + ssh 10.30.170.137 '/usr/lib/jvm/java-17-openjdk-amd64/bin/jstack -l 28741' Warning: Permanently added '10.30.170.137' (ECDSA) to the list of known hosts. + '[' 0 -gt 0 ']' + echo 'Generating controller variables...' Generating controller variables... ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.56' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.56 -v ODL_SYSTEM_2_IP:10.30.171.237' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.56 -v ODL_SYSTEM_2_IP:10.30.171.237 -v ODL_SYSTEM_3_IP:10.30.170.137' + echo 'Generating mininet variables...' Generating mininet variables... ++ seq 1 0 + get_test_suites SUITES + local __suite_list=SUITES + echo 'Locating test plan to use...' Locating test plan to use... + testplan_filepath=/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/testplans/controller-clustering-ask-calcium.txt + '[' '!' -f /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/testplans/controller-clustering-ask-calcium.txt ']' + testplan_filepath=/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/testplans/controller-clustering-ask.txt + '[' disabled '!=' disabled ']' + echo 'Changing the testplan path...' Changing the testplan path... + sed s:integration:/w/workspace/controller-csit-3node-clustering-ask-all-calcium: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/testplans/controller-clustering-ask.txt + cat testplan.txt # Place the suites in run order: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot + '[' -z '' ']' ++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt ++ tr '\012' ' ' + suite_list='/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ' + eval 'SUITES='\''/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '\''' ++ SUITES='/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ' + echo 'Starting Robot test suites /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ...' Starting Robot test suites /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ... + robot -N controller-clustering-ask.txt --removekeywords wuks -e exclude -e skip_if_calcium -v BUNDLEFOLDER:karaf-0.20.3-SNAPSHOT -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.3-SNAPSHOT/karaf-0.20.3-20241207.204717-381.zip -v CONTROLLER:10.30.170.56 -v CONTROLLER1:10.30.171.237 -v CONTROLLER2:10.30.170.137 -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-17-openjdk-amd64 -v JDKVERSION:openjdk17 -v JENKINS_WORKSPACE:/w/workspace/controller-csit-3node-clustering-ask-all-calcium -v MININET: -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:3 -v NUM_TOOLS_SYSTEM:0 -v ODL_STREAM:calcium -v ODL_SYSTEM_IP:10.30.170.56 -v ODL_SYSTEM_1_IP:10.30.170.56 -v ODL_SYSTEM_2_IP:10.30.171.237 -v ODL_SYSTEM_3_IP:10.30.170.137 -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP: -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ============================================================================== controller-clustering-ask.txt ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.137', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Rpc Provider Precedence :: DOMRpcBroker testi... ============================================================================== Register_Rpc_On_Each_Node :: Register global rpc on each node of t... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_precedence_register_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_register_rpc_on_each_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.137', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Invoke_Rpc_On_Each_Node :: Verify that the rpc response comes from... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.137', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Unregister_Rpc_On_Node :: Unregister the rpc on one of the cluster... | PASS | ------------------------------------------------------------------------------ Invoke_Rpc_On_Node_With_Unregistered_Rpc :: Invoke rcp on the node... | PASS | ------------------------------------------------------------------------------ Invoke_Rpc_On_Remaining_Nodes :: Verify that the rpc response come... | PASS | ------------------------------------------------------------------------------ Reregister_Rpc_On_Node :: Reregister the rpc. | PASS | ------------------------------------------------------------------------------ Invoke_Rpc_On_Each_Node_Again :: Verify that the rpc response come... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node_again" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node_again&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.137', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Unregister_Rpc_On_Each_Node :: Unregister rpc on every node. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_precedence_unregister_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_unregister_rpc_on_each_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.137', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Rpc Provider Precedence :: DOMRpcBro... | FAIL | 8 tests, 4 passed, 4 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.137', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Rpc Provider Partition And Heal :: DOMRpcBrok... ============================================================================== Register_Rpc_On_Two_Nodes :: Register rpc on two nodes of the odl ... | PASS | ------------------------------------------------------------------------------ Invoke_Rpc_On_Each_Node :: Invoke get-constant rpc on every node o... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node&order=bug_status" Keyword 'Verify_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.137', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Isolate_One_Node :: Isolate one node with registered rpc. From the... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_partition_and_heal_isolate_one_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_isolate_one_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.137', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Invoke_Rpc_On_Nonisolated_Nodes :: Invoke rpc on non-islolated nodes. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_nonisolated_nodes" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_nonisolated_nodes&order=bug_status" Keyword 'DrbCommons.Verify_Constant_On_Active_Nodes' failed after retrying for 1 minute. The last error was: Keyword 'Verify_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.137', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Rejoin_Isolated_Member :: Rejoin isolated node | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_partition_and_heal_rejoin_isolated_member" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_rejoin_isolated_member&order=bug_status" Variable '${isolated_idx}' not found. ------------------------------------------------------------------------------ Invoke_Rpc_On_Each_Node_Again :: Invoke rpc get-constant on every ... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node_again" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node_again&order=bug_status" Keyword 'Verify_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.137', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Unregister_Rpc_On_Each_Node :: Inregister rpc on both nodes. | PASS | ------------------------------------------------------------------------------ controller-clustering-ask.txt.Rpc Provider Partition And Heal :: D... | FAIL | 7 tests, 2 passed, 5 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.137', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Action Provider Precedence :: DOMRpcBroker te... ============================================================================== Register_Rpc_On_Each_Node :: Register routed rpc on each node of t... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_precedence_register_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_register_rpc_on_each_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.137', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Invoke_Rpc_On_Each_Node :: Verify that the rpc response comes from... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.137', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Unregister_Rpc_On_Node :: Unregister the rpc on one of the cluster... | PASS | ------------------------------------------------------------------------------ Invoke_Rpc_On_Node_With_Unregistered_Rpc :: Invoke rcp on the node... | PASS | ------------------------------------------------------------------------------ Invoke_Rpc_On_Remaining_Nodes :: Verify that the rpc response come... | PASS | ------------------------------------------------------------------------------ Reregister_Rpc_On_Node :: Reregister the rpc. | PASS | ------------------------------------------------------------------------------ Invoke_Rpc_On_Each_Node_Again :: Verify that the rpc response come... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node_again" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node_again&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.137', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Unregister_Rpc_On_Each_Node :: Unregister rpc on every node. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_precedence_unregister_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_unregister_rpc_on_each_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.137', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Action Provider Precedence :: DOMRpc... | FAIL | 8 tests, 4 passed, 4 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.137', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Action Provider Partition And Heal :: DOMRpcB... ============================================================================== Register_Rpc_On_Two_Nodes :: Register rpc on two nodes of the odl ... | PASS | ------------------------------------------------------------------------------ Invoke_Rpc_On_Each_Node :: Invoke get-contexted-constant rpc on ev... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node&order=bug_status" Keyword 'Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.137', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Isolate_One_Node :: Isolate one node with registered rpc. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_partition_and_heal_isolate_one_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_isolate_one_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.137', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Invoke_Rpc_On_Remaining_Nodes :: Invoke rpc on non-islolated nodes... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_remaining_nodes" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_remaining_nodes&order=bug_status" Keyword 'DrbCommons.Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 1 minute. The last error was: Keyword 'Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.137', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Rejoin_Isolated_Member :: Rejoin isolated node | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_partition_and_heal_rejoin_isolated_member" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_rejoin_isolated_member&order=bug_status" Variable '${isolated_idx}' not found. ------------------------------------------------------------------------------ Invoke_Rpc_On_Each_Node_Again :: Invoke rpc get-contexted-constant... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node_again" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node_again&order=bug_status" Keyword 'Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.137', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Unregister_Rpc_On_Each_Node :: Inregister rpc on both nodes. | PASS | ------------------------------------------------------------------------------ controller-clustering-ask.txt.Action Provider Partition And Heal :... | FAIL | 7 tests, 2 passed, 5 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.137', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Master Stability :: Cluster Singleton testing... ============================================================================== Register_Singleton_Constant_On_Each_Node_And_Verify :: Register a ... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_master_stability_register_singleton_constant_on_each_node_and_verify" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_register_singleton_constant_on_each_node_and_verify&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.137', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Unregister_Singleton_Constant_On_Non_Master_Node :: Unregister the... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_non_master_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_non_master_node&order=bug_status" Variable '@{cs_candidates}' not found. Did you mean: @{cs_exp_candidates} ------------------------------------------------------------------------------ Monitor_Stability_While_Unregistered :: Verify that the owner rema... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_master_stability_monitor_stability_while_unregistered" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_monitor_stability_while_unregistered&order=bug_status" Variable '${cs_owner}' not found. ------------------------------------------------------------------------------ Reregister_Singleton_Constant :: Re-register the unregistered cand... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_master_stability_reregister_singleton_constant" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_reregister_singleton_constant&order=bug_status" Variable '${unregistered_node}' not found. ------------------------------------------------------------------------------ Verify_Stability_After_Reregistration :: Verify that the owner rem... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_master_stability_verify_stability_after_reregistration" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_verify_stability_after_reregistration&order=bug_status" Variable '${cs_owner}' not found. ------------------------------------------------------------------------------ Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_each_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.137', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Master Stability :: Cluster Singleto... | FAIL | 6 tests, 0 passed, 6 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ConnectionError: HTTPConnectionPool(host='10.30.171.237', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Partition And Heal :: Cluster Singleton testi... ============================================================================== Register_Singleton_Constant_On_Each_Node :: Register a candidate a... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_partition_and_heal_register_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_register_singleton_constant_on_each_node&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.171.237', port=8181): Max retries exceeded with url: /rests/operations/odl-mdsal-lowlevel-control:register-singleton-constant (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ Verify_Singleton_Constant_On_Each_Node :: Store the owner and cand... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_partition_and_heal_verify_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_verify_singleton_constant_on_each_node&order=bug_status" Could not parse owner and candidates for device get-singleton-constant-service'] ------------------------------------------------------------------------------ Isolate_Owner_Node :: Isolate the cluster node which is the owner.... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_partition_and_heal_isolate_owner_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_isolate_owner_node&order=bug_status" Variable '${cs_owner}' not found. ------------------------------------------------------------------------------ Monitor_Stability_While_Isolated :: Monitor the stability of the s... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_partition_and_heal_monitor_stability_while_isolated" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_monitor_stability_while_isolated&order=bug_status" Invalid IF condition: Evaluating expression '"${index}" == "${cs_isolated_index}"' failed: Variable '${cs_isolated_index}' not found. ------------------------------------------------------------------------------ Rejoin_Isolated_node :: Rejoin isolated node. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_partition_and_heal_rejoin_isolated_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_rejoin_isolated_node&order=bug_status" Variable '${cs_isolated_index}' not found. ------------------------------------------------------------------------------ Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_partition_and_heal_unregister_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_unregister_singleton_constant_on_each_node&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.171.237', port=8181): Max retries exceeded with url: /rests/operations/odl-mdsal-lowlevel-control:unregister-singleton-constant (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Partition And Heal :: Cluster Single... | FAIL | 6 tests, 0 passed, 6 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ConnectionError: HTTPConnectionPool(host='10.30.171.237', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Chasing The Leader :: Cluster Singleton testi... ============================================================================== Register_Candidates :: Register a candidate application on each no... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_chasing_the_leader_register_candidates" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_chasing_the_leader_register_candidates&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.171.237', port=8181): Max retries exceeded with url: /rests/operations/odl-mdsal-lowlevel-control:register-flapping-singleton (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ Do_Nothing :: Do nothing for the time of the test duration, becaus... | PASS | ------------------------------------------------------------------------------ Unregister_Candidates_And_Validate_Criteria :: Unregister the test... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_chasing_the_leader_unregister_candidates_and_validate_criteria" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_chasing_the_leader_unregister_candidates_and_validate_criteria&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.171.237', port=8181): Max retries exceeded with url: /rests/operations/odl-mdsal-lowlevel-control:unregister-flapping-singleton (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Chasing The Leader :: Cluster Single... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Global Rpc Kill :: Controller functional HA t... ============================================================================== Get_Basic_Rpc_Test_Owner :: Find a service owner and successors. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_Before_Stopping_On_Owner :: Run rpc on the service owner. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_Before_Stop_On_Successors :: Run rpc on non owher cluster nodes. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Stop_Current_Owner_Member :: Stop cluster node which is the owner. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Verify_New_Basic_Rpc_Test_Owner_Elected :: Verify new owner of the... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_On_Remained_Cluster_Nodes :: Run rpc on remained cluster nodes. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Restart_Stopped_Member :: Restart stopped node | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Verify_New_Owner_Remained_After_Rejoin :: Verify no owner change h... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_New_Owner :: Run rpc on the new service owner ... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_Old_Owner :: Run rpc on rejoined cluster node. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_All :: Run rpc again on all nodes. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ controller-clustering-ask.txt.Global Rpc Kill :: Controller functi... | FAIL | Suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . 11 tests, 0 passed, 11 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Global Rpc Freeze :: Controller functional HA... ============================================================================== Get_Basic_Rpc_Test_Owner :: Find a service owner and successors. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_Before_Freezing_On_Owner :: Run rpc on the service owner. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_Before_Freeze_On_Successors :: Run rpc on non owher cluster no... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Freeze_Current_Owner_Member :: Stop cluster node which is the owner. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Verify_New_Basic_Rpc_Test_Owner_Elected :: Verify new owner of the... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_On_Remained_Cluster_Nodes :: Run rpc on remained cluster nodes. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Unfreeze_Frozen_Member :: Restart frozen node | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_New_Owner :: Run rpc on the new service owner ... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_Old_Owner :: Run rpc on rejoined cluster node. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_All :: Run rpc again on all nodes. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ controller-clustering-ask.txt.Global Rpc Freeze :: Controller func... | FAIL | Suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . 10 tests, 0 passed, 10 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Global Rpc Isolate :: Controller functional H... ============================================================================== Get_Basic_Rpc_Test_Owner :: Find a service owner and successors. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_Before_Isolation_On_Owner :: Run rpc on the service owner. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_Before_Isolation_On_Successors :: Run rpc on non owher cluster... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Isolate_Current_Owner_Member :: Isolating cluster node which is th... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Verify_New_Basic_Rpc_Test_Owner_Elected :: Verify new owner of the... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_On_Isolated_Node :: Run rpc on isolated cluster node. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_On_Non_Isolated_Cluster_Nodes :: Run rpc on remained cluster n... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rejoin_Isolated_Member :: Rejoin isolated node | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_New_Owner :: Run rpc on the new service owner ... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_Old_Owner :: Run rpc on rejoined cluster node. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_All :: Run rpc again on all nodes. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ controller-clustering-ask.txt.Global Rpc Isolate :: Controller fun... | FAIL | Suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . 11 tests, 0 passed, 11 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Carpeople Crud :: Suite for performing basic ... ============================================================================== Add_Cars_To_Leader :: Add 30 cars to car Leader by one big PUT. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_Cars_On_Leader :: GET response from Leader should match ... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_Cars_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_People_To_First_Follower :: Add 30 people to people first Foll... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_People_On_Leader :: GET response from Leader should matc... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_People_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader :: Buy some cars on car-people Leader, loop of ... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Followers :: On each Follower buy corresponding ID seg... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_CarPeople_On_Leader :: GET car-person mappings from Lead... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_CarPeople_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_CarPeople_On_Leader :: DELETE car-people container. No ... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_People_On_Leader :: DELETE people container. No verific... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_Cars_On_Leader :: DELETE cars container. No verificatio... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-ask.txt.Carpeople Crud :: Suite for performi... | FAIL | Suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 13 tests, 0 passed, 13 failed ============================================================================== controller-clustering-ask.txt.Car Failover Crud :: Suite mixing basic opera... ============================================================================== Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Stop_Original_Car_Leader :: Stop the car Leader to cause a new lea... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Start_Old_Car_Leader :: Start the stopped member without deleting ... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-ask.txt.Car Failover Crud :: Suite mixing ba... | FAIL | Suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 16 tests, 0 passed, 16 failed ============================================================================== controller-clustering-ask.txt.Car Persistence Recovery :: This test restart... ============================================================================== Add_Cars_On_Leader_And_Verify :: Single big PUT to datastore to ad... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Stop_All_Members :: Stop all controllers. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Start_All_Members :: Start all controllers (should restore the per... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Memorize_Leader_And_Followers :: Locate current Leader of car Shard. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Cars_On_Leader :: GET cars from Leader, should match the PUT d... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Cars_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Cars_On_Leader :: Delete cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-ask.txt.Car Persistence Recovery :: This tes... | FAIL | Suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 7 tests, 0 passed, 7 failed ============================================================================== controller-clustering-ask.txt.Buycar Failover :: This test focuses on testi... ============================================================================== Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Reboot_People_Leader :: Previous people Leader is rebooted. We sho... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader_After_Reboot_And_Verify :: Buy some cars on the... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Follower_After_Reboot_And_Verify :: Buy some cars on t... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_People :: DELETE people container. No verification beyo... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-ask.txt.Buycar Failover :: This test focuses... | FAIL | Suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 10 tests, 0 passed, 10 failed ============================================================================== controller-clustering-ask.txt.Entity Isolate :: Suite for performing member... ============================================================================== Check All Shards Before Isolate :: Check all shards in controller. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Isolate Entity Leader :: Isolate the entity-ownership Leader to ca... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Check All Shards After Isolate :: Check all shards in controller. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Rejoin Entity Leader :: Rejoin the entity-ownership Leader. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Check All Shards After Rejoin :: Check all shards in controller. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-ask.txt.Entity Isolate :: Suite for performi... | FAIL | Suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 5 tests, 0 passed, 5 failed ============================================================================== controller-clustering-ask.txt.Buycar Failover Isolation :: This test focuse... ============================================================================== Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Isolate_and_Rejoin_People_Leader :: Previous people Leader is isol... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader_After_Rejoin_And_Verify :: Buy some cars on the... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Follower_After_Rejoin_And_Verify :: Buy some cars on t... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_People :: DELETE people container. No verification beyo... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-ask.txt.Buycar Failover Isolation :: This te... | FAIL | Suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 10 tests, 0 passed, 10 failed ============================================================================== controller-clustering-ask.txt.Car Failover Crud Isolation :: Suite mixing b... ============================================================================== Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Isolate_Original_Car_Leader :: Isolate the car Leader to cause a n... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Rejoin_Old_Car_Leader :: Rejoin the isolated member without deleti... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-ask.txt.Car Failover Crud Isolation :: Suite... | FAIL | Suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 16 tests, 0 passed, 16 failed ============================================================================== controller-clustering-ask.txt.Car Outage Corners :: Cluster suite for testi... ============================================================================== Stop_Majority_Of_The_Followers :: Stop half plus one car Follower ... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Attempt_To_Add_Cars_To_Leader :: Adding cars should fail, as major... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Start_Tipping_Follower :: Start one Follower member without persis... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_Cars_On_Tipping_Follower :: Add cars on the tipping Follower. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Cars_On_Existing_Members :: On each up member: GET cars, shoul... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Start_Other_Followers :: Start other followers without persisted d... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Cars_On_New_Follower_Leader :: GET cars from a new follower to... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Cars_On_Leader :: Delete cars on Leader. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-ask.txt.Car Outage Corners :: Cluster suite ... | FAIL | Suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.56:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 8 tests, 0 passed, 8 failed ============================================================================== controller-clustering-ask.txt | FAIL | 195 tests, 24 passed, 171 failed ============================================================================== Output: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/output.xml Log: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/log.html Report: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/report.html + true + echo 'Examining the files in data/log and checking filesize' Examining the files in data/log and checking filesize + ssh 10.30.170.56 'ls -altr /tmp/karaf-0.20.3-SNAPSHOT/data/log/' Warning: Permanently added '10.30.170.56' (ECDSA) to the list of known hosts. total 16512 drwxrwxr-x 2 jenkins jenkins 4096 Dec 7 23:37 . -rw-rw-r-- 1 jenkins jenkins 1720 Dec 7 23:37 karaf_console.log drwxrwxr-x 4 jenkins jenkins 4096 Dec 8 03:25 .. -rw-rw-r-- 1 jenkins jenkins 16891637 Dec 8 03:39 karaf.log + ssh 10.30.170.56 'du -hs /tmp/karaf-0.20.3-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.170.56' (ECDSA) to the list of known hosts. 17M /tmp/karaf-0.20.3-SNAPSHOT/data/log/karaf.log 4.0K /tmp/karaf-0.20.3-SNAPSHOT/data/log/karaf_console.log + ssh 10.30.171.237 'ls -altr /tmp/karaf-0.20.3-SNAPSHOT/data/log/' Warning: Permanently added '10.30.171.237' (ECDSA) to the list of known hosts. total 9928 drwxrwxr-x 2 jenkins jenkins 4096 Dec 7 23:37 . -rw-rw-r-- 1 jenkins jenkins 1720 Dec 7 23:37 karaf_console.log drwxrwxr-x 7 jenkins jenkins 4096 Dec 8 03:25 .. -rw-rw-r-- 1 jenkins jenkins 10151480 Dec 8 03:25 karaf.log + ssh 10.30.171.237 'du -hs /tmp/karaf-0.20.3-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.171.237' (ECDSA) to the list of known hosts. 9.7M /tmp/karaf-0.20.3-SNAPSHOT/data/log/karaf.log 4.0K /tmp/karaf-0.20.3-SNAPSHOT/data/log/karaf_console.log + ssh 10.30.170.137 'ls -altr /tmp/karaf-0.20.3-SNAPSHOT/data/log/' Warning: Permanently added '10.30.170.137' (ECDSA) to the list of known hosts. total 6700 drwxrwxr-x 2 jenkins jenkins 4096 Dec 7 23:37 . -rw-rw-r-- 1 jenkins jenkins 143410 Dec 7 23:48 karaf_console.log drwxrwxr-x 4 jenkins jenkins 4096 Dec 8 03:25 .. -rw-rw-r-- 1 jenkins jenkins 6703214 Dec 8 03:39 karaf.log + ssh 10.30.170.137 'du -hs /tmp/karaf-0.20.3-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.170.137' (ECDSA) to the list of known hosts. 6.4M /tmp/karaf-0.20.3-SNAPSHOT/data/log/karaf.log 144K /tmp/karaf-0.20.3-SNAPSHOT/data/log/karaf_console.log + set +e ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.170.56 'sudo ps aux' Warning: Permanently added '10.30.170.56' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-calcium/ps_after.log ++ grep -v grep ++ tr -s ' ' ++ cut -f2 '-d ' + pid=47766 + echo 'karaf main: org.apache.karaf.main.Main, pid:47766' karaf main: org.apache.karaf.main.Main, pid:47766 + ssh 10.30.170.56 '/usr/lib/jvm/java-17-openjdk-amd64/bin/jstack -l 47766' Warning: Permanently added '10.30.170.56' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.170.56 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.170.56' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.171.237 'sudo ps aux' Warning: Permanently added '10.30.171.237' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-calcium/ps_after.log ++ grep -v grep ++ tr -s ' ' ++ cut -f2 '-d ' + pid=63836 + echo 'karaf main: org.apache.karaf.main.Main, pid:63836' karaf main: org.apache.karaf.main.Main, pid:63836 + ssh 10.30.171.237 '/usr/lib/jvm/java-17-openjdk-amd64/bin/jstack -l 63836' Warning: Permanently added '10.30.171.237' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.171.237 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.171.237' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.170.137 'sudo ps aux' Warning: Permanently added '10.30.170.137' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-calcium/ps_after.log ++ tr -s ' ' ++ grep -v grep ++ cut -f2 '-d ' + pid=28741 + echo 'karaf main: org.apache.karaf.main.Main, pid:28741' karaf main: org.apache.karaf.main.Main, pid:28741 + ssh 10.30.170.137 '/usr/lib/jvm/java-17-openjdk-amd64/bin/jstack -l 28741' Warning: Permanently added '10.30.170.137' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.170.137 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.170.137' (ECDSA) to the list of known hosts. + sleep 5 ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Compressing karaf.log 1' Compressing karaf.log 1 + ssh 10.30.170.56 gzip --best /tmp/karaf-0.20.3-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.170.56' (ECDSA) to the list of known hosts. + echo 'Fetching compressed karaf.log 1' Fetching compressed karaf.log 1 + scp 10.30.170.56:/tmp/karaf-0.20.3-SNAPSHOT/data/log/karaf.log.gz odl1_karaf.log.gz Warning: Permanently added '10.30.170.56' (ECDSA) to the list of known hosts. + ssh 10.30.170.56 rm -f /tmp/karaf-0.20.3-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.170.56' (ECDSA) to the list of known hosts. + scp 10.30.170.56:/tmp/karaf-0.20.3-SNAPSHOT/data/log/karaf_console.log odl1_karaf_console.log Warning: Permanently added '10.30.170.56' (ECDSA) to the list of known hosts. + ssh 10.30.170.56 rm -f /tmp/karaf-0.20.3-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.170.56' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-1 + scp '10.30.170.56:/tmp/karaf-0.20.3-SNAPSHOT/data/log/*.log' gclogs-1/ Warning: Permanently added '10.30.170.56' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.20.3-SNAPSHOT/data/log/*.log: No such file or directory + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Compressing karaf.log 2' Compressing karaf.log 2 + ssh 10.30.171.237 gzip --best /tmp/karaf-0.20.3-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.171.237' (ECDSA) to the list of known hosts. + echo 'Fetching compressed karaf.log 2' Fetching compressed karaf.log 2 + scp 10.30.171.237:/tmp/karaf-0.20.3-SNAPSHOT/data/log/karaf.log.gz odl2_karaf.log.gz Warning: Permanently added '10.30.171.237' (ECDSA) to the list of known hosts. + ssh 10.30.171.237 rm -f /tmp/karaf-0.20.3-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.171.237' (ECDSA) to the list of known hosts. + scp 10.30.171.237:/tmp/karaf-0.20.3-SNAPSHOT/data/log/karaf_console.log odl2_karaf_console.log Warning: Permanently added '10.30.171.237' (ECDSA) to the list of known hosts. + ssh 10.30.171.237 rm -f /tmp/karaf-0.20.3-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.171.237' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-2 + scp '10.30.171.237:/tmp/karaf-0.20.3-SNAPSHOT/data/log/*.log' gclogs-2/ Warning: Permanently added '10.30.171.237' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.20.3-SNAPSHOT/data/log/*.log: No such file or directory + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Compressing karaf.log 3' Compressing karaf.log 3 + ssh 10.30.170.137 gzip --best /tmp/karaf-0.20.3-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.170.137' (ECDSA) to the list of known hosts. + echo 'Fetching compressed karaf.log 3' Fetching compressed karaf.log 3 + scp 10.30.170.137:/tmp/karaf-0.20.3-SNAPSHOT/data/log/karaf.log.gz odl3_karaf.log.gz Warning: Permanently added '10.30.170.137' (ECDSA) to the list of known hosts. + ssh 10.30.170.137 rm -f /tmp/karaf-0.20.3-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.170.137' (ECDSA) to the list of known hosts. + scp 10.30.170.137:/tmp/karaf-0.20.3-SNAPSHOT/data/log/karaf_console.log odl3_karaf_console.log Warning: Permanently added '10.30.170.137' (ECDSA) to the list of known hosts. + ssh 10.30.170.137 rm -f /tmp/karaf-0.20.3-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.170.137' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-3 + scp '10.30.170.137:/tmp/karaf-0.20.3-SNAPSHOT/data/log/*.log' gclogs-3/ Warning: Permanently added '10.30.170.137' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.20.3-SNAPSHOT/data/log/*.log: No such file or directory + echo 'Examine copied files' Examine copied files + ls -lt total 54228 drwxrwxr-x. 2 jenkins jenkins 6 Dec 8 03:39 gclogs-3 -rw-rw-r--. 1 jenkins jenkins 143410 Dec 8 03:39 odl3_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 246605 Dec 8 03:39 odl3_karaf.log.gz drwxrwxr-x. 2 jenkins jenkins 6 Dec 8 03:39 gclogs-2 -rw-rw-r--. 1 jenkins jenkins 1720 Dec 8 03:39 odl2_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 622029 Dec 8 03:39 odl2_karaf.log.gz drwxrwxr-x. 2 jenkins jenkins 6 Dec 8 03:39 gclogs-1 -rw-rw-r--. 1 jenkins jenkins 1720 Dec 8 03:39 odl1_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 860082 Dec 8 03:39 odl1_karaf.log.gz -rw-rw-r--. 1 jenkins jenkins 153108 Dec 8 03:39 karaf_3_28741_threads_after.log -rw-rw-r--. 1 jenkins jenkins 15400 Dec 8 03:39 ps_after.log -rw-rw-r--. 1 jenkins jenkins 16067 Dec 8 03:39 karaf_2_63836_threads_after.log -rw-rw-r--. 1 jenkins jenkins 149708 Dec 8 03:39 karaf_1_47766_threads_after.log -rw-rw-r--. 1 jenkins jenkins 300361 Dec 8 03:39 report.html -rw-rw-r--. 1 jenkins jenkins 3381208 Dec 8 03:39 log.html -rw-rw-r--. 1 jenkins jenkins 49151296 Dec 8 03:39 output.xml -rw-rw-r--. 1 jenkins jenkins 4091 Dec 7 23:40 testplan.txt -rw-rw-r--. 1 jenkins jenkins 124783 Dec 7 23:40 karaf_3_28741_threads_before.log -rw-rw-r--. 1 jenkins jenkins 16441 Dec 7 23:40 ps_before.log -rw-rw-r--. 1 jenkins jenkins 124825 Dec 7 23:40 karaf_2_28784_threads_before.log -rw-rw-r--. 1 jenkins jenkins 125602 Dec 7 23:40 karaf_1_28722_threads_before.log -rw-rw-r--. 1 jenkins jenkins 3106 Dec 7 23:37 post-startup-script.sh -rw-rw-r--. 1 jenkins jenkins 252 Dec 7 23:37 startup-script.sh -rw-rw-r--. 1 jenkins jenkins 3460 Dec 7 23:37 configuration-script.sh -rw-rw-r--. 1 jenkins jenkins 695 Dec 7 23:37 custom_shard_config.txt -rw-rw-r--. 1 jenkins jenkins 134 Dec 7 23:37 scriptplan.txt -rw-rw-r--. 1 jenkins jenkins 337 Dec 7 23:37 detect_variables.env -rw-rw-r--. 1 jenkins jenkins 2619 Dec 7 23:37 pom.xml -rw-rw-r--. 1 jenkins jenkins 92 Dec 7 23:37 set_variables.env -rw-rw-r--. 1 jenkins jenkins 312 Dec 7 23:37 slave_addresses.txt -rw-rw-r--. 1 jenkins jenkins 570 Dec 7 23:36 requirements.txt -rw-rw-r--. 1 jenkins jenkins 26 Dec 7 23:36 env.properties -rw-rw-r--. 1 jenkins jenkins 333 Dec 7 23:34 stack-parameters.yaml drwxrwxr-x. 7 jenkins jenkins 4096 Dec 7 23:33 test drwxrwxr-x. 2 jenkins jenkins 6 Dec 7 23:33 test@tmp -rw-rw-r--. 1 jenkins jenkins 1410 Dec 7 20:47 maven-metadata.xml + true [controller-csit-3node-clustering-ask-all-calcium] $ /bin/sh /tmp/jenkins18176678077780811044.sh Cleaning up Robot installation... $ ssh-agent -k unset SSH_AUTH_SOCK; unset SSH_AGENT_PID; echo Agent pid 5340 killed; [ssh-agent] Stopped. Recording plot data Robot results publisher started... INFO: Checking test criticality is deprecated and will be dropped in a future release! -Parsing output xml: Done! -Copying log files to build dir: Done! -Assigning results to build: Done! -Checking thresholds: Done! Done publishing Robot results. Build step 'Publish Robot Framework test results' changed build result to UNSTABLE [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins2015206079147871783.sh Archiving csit artifacts mv: cannot stat '*_1.png': No such file or directory mv: cannot stat '/tmp/odl1_*': No such file or directory mv: cannot stat '*_2.png': No such file or directory mv: cannot stat '/tmp/odl2_*': No such file or directory mv: cannot stat '*_3.png': No such file or directory mv: cannot stat '/tmp/odl3_*': No such file or directory % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 1262 0 1262 0 0 1073 0 --:--:-- 0:00:01 --:--:-- 1073 100 13916 0 13916 0 0 7658 0 --:--:-- 0:00:01 --:--:-- 7654 100 160k 0 160k 0 0 42555 0 --:--:-- 0:00:03 --:--:-- 42544 100 160k 0 160k 0 0 27997 0 --:--:-- 0:00:05 --:--:-- 27992 100 840k 0 840k 0 0 125k 0 --:--:-- 0:00:06 --:--:-- 125k 100 4364k 0 4364k 0 0 581k 0 --:--:-- 0:00:07 --:--:-- 689k Archive: robot-plugin.zip inflating: ./archives/robot-plugin/log.html inflating: ./archives/robot-plugin/output.xml inflating: ./archives/robot-plugin/report.html mv: cannot stat '*.log.gz': No such file or directory mv: cannot stat '*.csv': No such file or directory mv: cannot stat '*.png': No such file or directory [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins12966550339231809844.sh [PostBuildScript] - [INFO] Executing post build scripts. [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_CLOUD=vex OS_STACK_NAME=releng-controller-csit-3node-clustering-ask-all-calcium-65 [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins10562070892310058517.sh ---> openstack-stack-delete.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-sVRI from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient lf-activate-venv(): INFO: Adding /tmp/venv-sVRI/bin to PATH INFO: Retrieving stack cost for: releng-controller-csit-3node-clustering-ask-all-calcium-65 DEBUG: Successfully retrieved stack cost: total: 1.6500000000000001 INFO: Deleting stack releng-controller-csit-3node-clustering-ask-all-calcium-65 Waiting for stack to delete... Successfully deleted stack releng-controller-csit-3node-clustering-ask-all-calcium-65 [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins4205709629195853930.sh ---> sysstat.sh [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins1289838847243320813.sh ---> package-listing.sh ++ facter osfamily ++ tr '[:upper:]' '[:lower:]' + OS_FAMILY=redhat + workspace=/w/workspace/controller-csit-3node-clustering-ask-all-calcium + START_PACKAGES=/tmp/packages_start.txt + END_PACKAGES=/tmp/packages_end.txt + DIFF_PACKAGES=/tmp/packages_diff.txt + PACKAGES=/tmp/packages_start.txt + '[' /w/workspace/controller-csit-3node-clustering-ask-all-calcium ']' + PACKAGES=/tmp/packages_end.txt + case "${OS_FAMILY}" in + rpm -qa + sort + '[' -f /tmp/packages_start.txt ']' + '[' -f /tmp/packages_end.txt ']' + diff /tmp/packages_start.txt /tmp/packages_end.txt + '[' /w/workspace/controller-csit-3node-clustering-ask-all-calcium ']' + mkdir -p /w/workspace/controller-csit-3node-clustering-ask-all-calcium/archives/ + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/controller-csit-3node-clustering-ask-all-calcium/archives/ [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins3231199385611374145.sh ---> capture-instance-metadata.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-sVRI from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-sVRI/bin to PATH INFO: Running in OpenStack, capturing instance metadata [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins8551779517466522132.sh provisioning config files... Could not find credentials [logs] for controller-csit-3node-clustering-ask-all-calcium #65 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/controller-csit-3node-clustering-ask-all-calcium@tmp/config7099052489438348642tmp Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] Run condition [Regular expression match] enabling perform for step [Provide Configuration files] provisioning config files... copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content SERVER_ID=logs [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins16726073895485032666.sh ---> create-netrc.sh WARN: Log server credential not found. [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins4804911821617324068.sh ---> python-tools-install.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-sVRI from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-sVRI/bin to PATH [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins11840974357406441446.sh ---> sudo-logs.sh Archiving 'sudo' log.. [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins373366356033819094.sh ---> job-cost.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-sVRI from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 lf-activate-venv(): INFO: Adding /tmp/venv-sVRI/bin to PATH DEBUG: total: 1.6500000000000001 INFO: Retrieving Stack Cost... INFO: Retrieving Pricing Info for: v3-standard-2 INFO: Archiving Costs [controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash -l /tmp/jenkins10035999062889771547.sh ---> logs-deploy.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-sVRI from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-sVRI/bin to PATH WARNING: Nexus logging server not set INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/controller-csit-3node-clustering-ask-all-calcium/65/ INFO: archiving logs to S3 ---> uname -a: Linux prd-centos8-robot-2c-8g-883.novalocal 4.18.0-553.5.1.el8.x86_64 #1 SMP Tue May 21 05:46:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux ---> lscpu: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 1 Socket(s): 2 NUMA node(s): 1 Vendor ID: AuthenticAMD CPU family: 23 Model: 49 Model name: AMD EPYC-Rome Processor Stepping: 0 CPU MHz: 2800.000 BogoMIPS: 5600.00 Virtualization: AMD-V Hypervisor vendor: KVM Virtualization type: full L1d cache: 32K L1i cache: 32K L2 cache: 512K L3 cache: 16384K NUMA node0 CPU(s): 0,1 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities ---> nproc: 2 ---> df -h: Filesystem Size Used Avail Use% Mounted on devtmpfs 3.8G 0 3.8G 0% /dev tmpfs 3.8G 0 3.8G 0% /dev/shm tmpfs 3.8G 17M 3.8G 1% /run tmpfs 3.8G 0 3.8G 0% /sys/fs/cgroup /dev/vda1 40G 8.4G 32G 21% / tmpfs 770M 0 770M 0% /run/user/1001 ---> free -m: total used free shared buff/cache available Mem: 7697 624 4817 19 2255 6776 Swap: 1023 0 1023 ---> ip addr: 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: mtu 1458 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:e6:22:8d brd ff:ff:ff:ff:ff:ff altname enp0s3 altname ens3 inet 10.30.170.190/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0 valid_lft 71430sec preferred_lft 71430sec inet6 fe80::f816:3eff:fee6:228d/64 scope link valid_lft forever preferred_lft forever ---> sar -b -r -n DEV: Linux 4.18.0-553.5.1.el8.x86_64 (prd-centos8-robot-2c-8g-883.novalocal) 12/08/2024 _x86_64_ (2 CPU) 12:00:01 AM tps rtps wtps bread/s bwrtn/s 12:01:01 AM 1.07 0.00 1.07 0.00 198.90 12:02:01 AM 0.47 0.08 0.38 1.87 7.96 12:03:01 AM 0.42 0.00 0.42 0.00 9.63 12:04:01 AM 0.18 0.00 0.18 0.00 8.92 12:05:01 AM 0.25 0.00 0.25 0.00 10.58 12:06:01 AM 0.47 0.00 0.47 0.00 5.83 12:07:01 AM 0.40 0.00 0.40 0.00 5.55 12:08:01 AM 0.58 0.07 0.52 7.60 15.59 12:09:01 AM 0.13 0.00 0.13 0.00 1.43 12:10:01 AM 0.12 0.00 0.12 0.00 0.80 12:11:01 AM 0.30 0.00 0.30 0.00 12.48 12:12:01 AM 0.32 0.00 0.32 0.00 20.28 12:13:01 AM 0.35 0.00 0.35 0.00 13.40 12:14:01 AM 0.22 0.00 0.22 0.00 17.06 12:15:01 AM 0.15 0.00 0.15 0.00 14.13 12:16:01 AM 0.48 0.32 0.17 6.93 8.01 12:17:01 AM 0.90 0.00 0.90 0.00 33.36 12:18:01 AM 0.32 0.00 0.32 0.00 23.63 12:19:01 AM 0.13 0.00 0.13 0.00 1.60 12:20:01 AM 0.15 0.00 0.15 0.00 1.07 12:21:01 AM 0.15 0.00 0.15 0.00 3.93 12:22:01 AM 0.25 0.00 0.25 0.00 3.05 12:23:01 AM 0.35 0.00 0.35 0.00 7.72 12:24:01 AM 0.22 0.00 0.22 0.00 2.83 12:25:01 AM 0.15 0.00 0.15 0.00 7.21 12:26:01 AM 0.13 0.00 0.13 0.00 8.00 12:27:01 AM 0.17 0.00 0.17 0.00 6.42 12:28:01 AM 0.30 0.00 0.30 0.00 5.05 12:29:01 AM 0.13 0.00 0.13 0.00 3.18 12:30:01 AM 0.15 0.00 0.15 0.00 2.17 12:31:01 AM 0.23 0.00 0.23 0.00 3.63 12:32:01 AM 0.28 0.00 0.28 0.00 5.20 12:33:01 AM 0.28 0.00 0.28 0.00 9.30 12:34:01 AM 0.30 0.00 0.30 0.00 3.98 12:35:01 AM 0.17 0.00 0.17 0.00 3.23 12:36:02 AM 0.18 0.00 0.18 0.00 8.30 12:37:01 AM 0.34 0.00 0.34 0.00 4.98 12:38:01 AM 0.30 0.00 0.30 0.00 7.03 12:39:01 AM 0.18 0.00 0.18 0.00 9.50 12:40:01 AM 0.18 0.00 0.18 0.00 13.38 12:41:01 AM 0.22 0.00 0.22 0.00 11.95 12:42:01 AM 0.25 0.00 0.25 0.00 17.18 12:43:01 AM 0.32 0.00 0.32 0.00 12.00 12:44:01 AM 0.15 0.00 0.15 0.00 14.96 12:45:01 AM 0.30 0.00 0.30 0.00 18.81 12:46:01 AM 0.17 0.00 0.17 0.00 20.01 12:47:01 AM 0.17 0.00 0.17 0.00 5.32 12:48:01 AM 0.23 0.00 0.23 0.00 4.48 12:49:01 AM 0.15 0.00 0.15 0.00 3.60 12:50:01 AM 0.13 0.00 0.13 0.00 1.43 12:51:01 AM 0.13 0.00 0.13 0.00 3.37 12:52:01 AM 0.30 0.00 0.30 0.00 4.93 12:53:01 AM 0.28 0.00 0.28 0.00 4.25 12:54:01 AM 0.15 0.00 0.15 0.00 8.97 12:55:01 AM 0.18 0.00 0.18 0.00 7.11 12:56:01 AM 0.15 0.00 0.15 0.00 1.48 12:57:01 AM 0.33 0.00 0.33 0.00 6.82 12:58:01 AM 0.28 0.00 0.28 0.00 8.95 12:59:01 AM 0.22 0.00 0.22 0.00 3.05 01:00:01 AM 0.17 0.00 0.17 0.00 3.90 01:01:01 AM 0.23 0.03 0.20 0.27 6.31 01:02:01 AM 0.32 0.00 0.32 0.00 11.43 01:03:01 AM 0.43 0.00 0.43 0.00 13.76 01:04:01 AM 0.35 0.00 0.35 0.00 3.95 01:05:01 AM 0.23 0.00 0.23 0.00 3.87 01:06:01 AM 0.22 0.00 0.22 0.00 6.68 01:07:01 AM 0.40 0.00 0.40 0.00 4.47 01:08:01 AM 0.48 0.00 0.48 0.00 11.03 01:09:01 AM 0.20 0.00 0.20 0.00 12.20 01:10:01 AM 0.17 0.00 0.17 0.00 9.30 01:11:01 AM 0.32 0.00 0.32 0.00 19.04 01:12:01 AM 0.30 0.00 0.30 0.00 17.14 01:13:01 AM 0.32 0.00 0.32 0.00 17.30 01:14:01 AM 0.18 0.00 0.18 0.00 8.82 01:15:01 AM 0.18 0.00 0.18 0.00 28.56 01:16:01 AM 0.15 0.00 0.15 0.00 5.62 01:17:01 AM 0.20 0.00 0.20 0.00 3.07 01:18:01 AM 0.27 0.00 0.27 0.00 4.13 01:19:01 AM 0.32 0.00 0.32 0.00 6.81 01:20:01 AM 0.20 0.00 0.20 0.00 2.32 01:21:01 AM 0.18 0.00 0.18 0.00 3.93 01:22:01 AM 0.22 0.00 0.22 0.00 3.15 01:23:01 AM 0.28 0.00 0.28 0.00 9.83 01:24:01 AM 0.13 0.00 0.13 0.00 8.27 01:25:01 AM 0.23 0.00 0.23 0.00 7.73 01:26:01 AM 0.18 0.00 0.18 0.00 1.90 01:27:01 AM 0.13 0.00 0.13 0.00 3.18 01:28:01 AM 0.27 0.00 0.27 0.00 5.20 01:29:01 AM 0.13 0.00 0.13 0.00 1.70 01:30:01 AM 0.13 0.00 0.13 0.00 2.78 01:31:01 AM 0.15 0.00 0.15 0.00 6.43 01:32:01 AM 0.33 0.00 0.33 0.00 4.63 01:33:01 AM 0.98 0.00 0.98 0.00 18.76 01:34:01 AM 0.32 0.00 0.32 0.00 11.33 01:35:01 AM 0.33 0.00 0.33 0.00 4.12 01:36:01 AM 0.37 0.00 0.37 0.00 5.70 01:37:01 AM 0.22 0.00 0.22 0.00 10.50 01:38:01 AM 0.30 0.00 0.30 0.00 13.45 01:39:01 AM 0.23 0.00 0.23 0.00 15.10 01:40:01 AM 0.42 0.00 0.42 0.00 20.80 01:41:01 AM 0.52 0.00 0.52 0.00 16.13 01:42:01 AM 0.53 0.00 0.53 0.00 16.10 01:43:01 AM 0.30 0.00 0.30 0.00 18.38 01:44:02 AM 0.17 0.00 0.17 0.00 19.88 01:45:01 AM 0.27 0.00 0.27 0.00 7.08 01:46:01 AM 0.17 0.00 0.17 0.00 2.15 01:47:01 AM 0.18 0.00 0.18 0.00 4.00 01:48:01 AM 0.23 0.00 0.23 0.00 4.08 01:49:01 AM 0.13 0.00 0.13 0.00 3.87 01:50:01 AM 0.17 0.00 0.17 0.00 1.62 01:51:01 AM 0.15 0.00 0.15 0.00 1.23 01:52:01 AM 0.30 0.00 0.30 0.00 11.85 01:53:01 AM 0.32 0.00 0.32 0.00 9.60 01:54:01 AM 0.15 0.00 0.15 0.00 2.13 01:55:01 AM 0.15 0.00 0.15 0.00 3.73 01:56:01 AM 0.17 0.00 0.17 0.00 3.00 01:57:01 AM 0.22 0.00 0.22 0.00 5.63 01:58:01 AM 0.25 0.00 0.25 0.00 5.35 01:59:01 AM 0.20 0.00 0.20 0.00 6.93 02:00:01 AM 0.12 0.00 0.12 0.00 0.93 02:01:01 AM 0.43 0.00 0.43 0.00 13.80 02:02:01 AM 0.60 0.00 0.60 0.00 16.59 02:03:01 AM 0.60 0.00 0.60 0.00 17.58 02:04:01 AM 0.17 0.00 0.17 0.00 15.63 02:05:01 AM 0.13 0.00 0.13 0.00 8.55 02:06:01 AM 0.25 0.00 0.25 0.00 17.35 02:07:01 AM 0.23 0.00 0.23 0.00 15.33 02:08:01 AM 0.23 0.00 0.23 0.00 23.98 02:09:01 AM 0.18 0.00 0.18 0.00 10.25 02:10:01 AM 0.13 0.00 0.13 0.00 7.33 02:11:01 AM 0.17 0.00 0.17 0.00 14.30 02:12:01 AM 0.18 0.00 0.18 0.00 9.17 02:13:01 AM 0.42 0.00 0.42 0.00 14.48 02:14:01 AM 0.18 0.00 0.18 0.00 16.16 02:15:01 AM 0.13 0.00 0.13 0.00 3.07 02:16:01 AM 0.12 0.00 0.12 0.00 8.66 02:17:01 AM 0.23 0.00 0.23 0.00 5.65 02:18:01 AM 0.22 0.00 0.22 0.00 7.63 02:19:01 AM 0.17 0.00 0.17 0.00 10.96 02:20:01 AM 0.13 0.00 0.13 0.00 9.23 02:21:01 AM 0.28 0.00 0.28 0.00 17.93 02:22:01 AM 0.25 0.00 0.25 0.00 10.38 02:23:01 AM 0.45 0.00 0.45 0.00 23.56 02:24:01 AM 0.50 0.00 0.50 0.00 16.69 02:25:01 AM 0.48 0.00 0.48 0.00 16.53 02:26:01 AM 0.37 0.00 0.37 0.00 23.56 02:27:01 AM 0.48 0.00 0.48 0.00 11.40 02:28:01 AM 0.42 0.00 0.42 0.00 10.83 02:29:01 AM 0.20 0.00 0.20 0.00 16.15 02:30:01 AM 0.23 0.00 0.23 0.00 10.91 02:31:01 AM 0.22 0.00 0.22 0.00 8.75 02:32:01 AM 0.22 0.00 0.22 0.00 18.38 02:33:01 AM 0.28 0.00 0.28 0.00 5.98 02:34:01 AM 0.23 0.00 0.23 0.00 8.88 02:35:01 AM 0.13 0.00 0.13 0.00 2.00 02:36:01 AM 0.13 0.00 0.13 0.00 2.53 02:37:01 AM 0.28 0.00 0.28 0.00 15.73 02:38:01 AM 0.50 0.00 0.50 0.00 20.53 02:39:01 AM 0.57 0.00 0.57 0.00 17.41 02:40:01 AM 0.32 0.00 0.32 0.00 14.15 02:41:01 AM 0.15 0.00 0.15 0.00 8.30 02:42:01 AM 0.23 0.00 0.23 0.00 16.01 02:43:01 AM 0.30 0.00 0.30 0.00 24.76 02:44:01 AM 0.43 0.00 0.43 0.00 13.80 02:45:01 AM 0.45 0.00 0.45 0.00 7.55 02:46:01 AM 0.45 0.00 0.45 0.00 7.33 02:47:01 AM 0.43 0.00 0.43 0.00 7.17 02:48:01 AM 0.55 0.00 0.55 0.00 10.28 02:49:01 AM 0.45 0.00 0.45 0.00 11.76 02:50:01 AM 0.13 0.00 0.13 0.00 2.27 02:51:01 AM 0.33 0.00 0.33 0.00 9.81 02:52:01 AM 0.28 0.00 0.28 0.00 14.80 02:53:02 AM 0.27 0.00 0.27 0.00 16.78 02:54:01 AM 0.25 0.00 0.25 0.00 15.10 02:55:01 AM 0.25 0.00 0.25 0.00 15.18 02:56:01 AM 0.17 0.00 0.17 0.00 12.11 02:57:01 AM 0.17 0.00 0.17 0.00 14.51 02:58:01 AM 0.22 0.00 0.22 0.00 20.14 02:59:01 AM 0.23 0.00 0.23 0.00 6.33 03:00:01 AM 0.13 0.00 0.13 0.00 3.22 03:01:01 AM 0.28 0.00 0.28 0.00 7.11 03:02:01 AM 0.22 0.00 0.22 0.00 4.92 03:03:01 AM 0.27 0.00 0.27 0.00 7.32 03:04:01 AM 0.13 0.00 0.13 0.00 7.73 03:05:01 AM 0.27 0.00 0.27 0.00 9.07 03:06:01 AM 0.28 0.00 0.28 0.00 13.60 03:07:01 AM 0.53 0.00 0.53 0.00 16.90 03:08:01 AM 0.60 0.00 0.60 0.00 19.56 03:09:01 AM 0.50 0.00 0.50 0.00 16.16 03:10:01 AM 0.50 0.00 0.50 0.00 16.68 03:11:01 AM 0.40 0.00 0.40 0.00 10.83 03:12:01 AM 0.25 0.00 0.25 0.00 27.15 03:13:01 AM 0.30 0.00 0.30 0.00 8.26 03:14:01 AM 0.13 0.00 0.13 0.00 3.07 03:15:01 AM 0.15 0.00 0.15 0.00 5.06 03:16:01 AM 0.12 0.00 0.12 0.00 3.07 03:17:01 AM 0.18 0.00 0.18 0.00 5.43 03:18:01 AM 0.22 0.00 0.22 0.00 5.98 03:19:01 AM 0.28 0.00 0.28 0.00 9.08 03:20:01 AM 0.13 0.00 0.13 0.00 10.00 03:21:01 AM 0.28 0.00 0.28 0.00 16.63 03:22:01 AM 1.02 0.00 1.02 0.00 26.88 03:23:01 AM 1.03 0.00 1.03 0.00 28.01 03:24:01 AM 0.57 0.00 0.57 0.00 18.06 03:25:01 AM 0.22 0.00 0.22 0.00 10.91 03:26:01 AM 0.13 0.00 0.13 0.00 22.81 03:27:01 AM 0.32 0.00 0.32 0.00 11.03 03:28:01 AM 0.22 0.00 0.22 0.00 5.18 03:29:01 AM 0.13 0.00 0.13 0.00 5.33 03:30:01 AM 0.15 0.00 0.15 0.00 4.80 03:31:01 AM 0.25 0.00 0.25 0.00 5.23 03:32:01 AM 0.37 0.00 0.37 0.00 14.75 03:33:01 AM 0.25 0.00 0.25 0.00 5.50 03:34:01 AM 0.17 0.00 0.17 0.00 14.73 03:35:01 AM 0.17 0.00 0.17 0.00 2.88 03:36:01 AM 0.15 0.00 0.15 0.00 14.68 03:37:01 AM 0.27 0.00 0.27 0.00 5.10 03:38:01 AM 0.38 0.00 0.38 0.00 21.00 03:39:01 AM 0.23 0.00 0.23 0.00 12.20 03:40:01 AM 2.63 0.28 2.35 33.85 232.92 03:41:01 AM 25.04 0.23 24.81 21.59 2980.21 Average: 0.40 0.00 0.40 0.33 25.39 12:00:01 AM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 12:01:01 AM 4939960 7010500 2942472 37.33 2688 2239616 719604 8.06 267300 2300716 4 12:02:01 AM 4940172 7010900 2942260 37.33 2688 2239828 719604 8.06 267440 2300508 88 12:03:01 AM 4940036 7010868 2942396 37.33 2688 2239932 719604 8.06 267440 2300612 96 12:04:01 AM 4940192 7011220 2942240 37.33 2688 2240128 719604 8.06 267440 2300672 96 12:05:01 AM 4939784 7010960 2942648 37.33 2688 2240284 719604 8.06 267440 2300856 4 12:06:01 AM 4940156 7011332 2942276 37.33 2688 2240284 719604 8.06 267440 2300656 4 12:07:01 AM 4939440 7010656 2942992 37.34 2688 2240324 735500 8.24 267440 2301164 4 12:08:01 AM 4939552 7011204 2942880 37.33 2688 2240760 718988 8.05 267492 2301280 4 12:09:01 AM 4939504 7011156 2942928 37.34 2688 2240760 718988 8.05 267492 2301160 4 12:10:01 AM 4939088 7010876 2943344 37.34 2688 2240896 711776 7.97 267492 2301684 144 12:11:01 AM 4939096 7011188 2943336 37.34 2688 2241200 728236 8.15 267492 2301788 168 12:12:01 AM 4938672 7011124 2943760 37.35 2688 2241560 728236 8.15 267492 2302168 32 12:13:01 AM 4938380 7011196 2944052 37.35 2688 2241924 728236 8.15 267492 2302500 144 12:14:01 AM 4938048 7011220 2944384 37.35 2688 2242280 728236 8.15 267492 2302916 64 12:15:01 AM 4937536 7011076 2944896 37.36 2688 2242648 728236 8.15 267492 2303228 40 12:16:01 AM 4936384 7010488 2946048 37.37 2688 2243212 728236 8.15 267628 2304256 220 12:17:01 AM 4935112 7009876 2947320 37.39 2688 2243872 728236 8.15 267628 2305736 476 12:18:01 AM 4934732 7009596 2947700 37.40 2688 2243972 728236 8.15 267628 2305840 4 12:19:01 AM 4934740 7009608 2947692 37.40 2688 2243976 728236 8.15 267628 2305920 4 12:20:01 AM 4934296 7009244 2948136 37.40 2688 2244056 721512 8.08 267628 2306280 88 12:21:01 AM 4934104 7009056 2948328 37.40 2688 2244060 721512 8.08 267628 2306492 4 12:22:01 AM 4934136 7009160 2948296 37.40 2688 2244132 721512 8.08 267628 2306352 80 12:23:01 AM 4934096 7009120 2948336 37.40 2688 2244132 721512 8.08 267628 2306472 8 12:24:01 AM 4933996 7009024 2948436 37.41 2688 2244136 721512 8.08 267632 2306548 16 12:25:01 AM 4933860 7009116 2948572 37.41 2688 2244364 721512 8.08 267632 2306784 76 12:26:01 AM 4933968 7009368 2948464 37.41 2688 2244508 721512 8.08 267632 2306732 8 12:27:01 AM 4933616 7009172 2948816 37.41 2688 2244664 736924 8.25 267632 2307012 4 12:28:01 AM 4933208 7008764 2949224 37.42 2688 2244664 736924 8.25 267632 2307312 4 12:29:01 AM 4933644 7009264 2948788 37.41 2688 2244728 736924 8.25 267632 2307032 4 12:30:01 AM 4933156 7008808 2949276 37.42 2688 2244760 721528 8.08 267632 2307344 4 12:31:01 AM 4933348 7009004 2949084 37.41 2688 2244764 721528 8.08 267632 2307216 4 12:32:01 AM 4933352 7009208 2949080 37.41 2688 2244964 721528 8.08 267632 2307220 152 12:33:01 AM 4933084 7008944 2949348 37.42 2688 2244968 721528 8.08 267632 2307568 4 12:34:01 AM 4933176 7009084 2949256 37.42 2688 2245016 721528 8.08 267632 2307336 56 12:35:01 AM 4933104 7009068 2949328 37.42 2688 2245072 721528 8.08 267632 2307472 68 12:36:02 AM 4933108 7009212 2949324 37.42 2688 2245216 721528 8.08 267660 2307584 16 12:37:01 AM 4933308 7009412 2949124 37.41 2688 2245216 721528 8.08 267660 2307468 4 12:38:01 AM 4932872 7009040 2949560 37.42 2688 2245280 721528 8.08 267660 2307516 4 12:39:01 AM 4932700 7009128 2949732 37.42 2688 2245540 721528 8.08 267660 2307864 40 12:40:01 AM 4931748 7008580 2950684 37.43 2688 2245944 721544 8.08 267660 2308820 92 12:41:01 AM 4931732 7008928 2950700 37.43 2688 2246308 721544 8.08 267660 2308928 152 12:42:01 AM 4931348 7008904 2951084 37.44 2688 2246668 721544 8.08 267660 2309172 72 12:43:01 AM 4930772 7008688 2951660 37.45 2688 2247028 721544 8.08 267660 2309904 184 12:44:01 AM 4930380 7008664 2952052 37.45 2688 2247392 721544 8.08 267660 2310316 148 12:45:01 AM 4930256 7008896 2952176 37.45 2688 2247748 721544 8.08 267660 2310304 36 12:46:01 AM 4929708 7008920 2952724 37.46 2688 2248320 721544 8.08 267660 2310968 56 12:47:01 AM 4929756 7009044 2952676 37.46 2688 2248396 721544 8.08 267660 2311048 4 12:48:01 AM 4929448 7008736 2952984 37.46 2688 2248396 721544 8.08 267660 2311316 4 12:49:01 AM 4929596 7008960 2952836 37.46 2688 2248472 721544 8.08 267660 2311196 4 12:50:01 AM 4928968 7008336 2953464 37.47 2688 2248476 718316 8.04 267660 2311480 4 12:51:01 AM 4929180 7008624 2953252 37.47 2688 2248548 718316 8.04 267660 2311412 4 12:52:01 AM 4929004 7008452 2953428 37.47 2688 2248552 718316 8.04 267660 2311624 4 12:53:01 AM 4929268 7008892 2953164 37.47 2688 2248728 718316 8.04 267660 2311396 184 12:54:01 AM 4928960 7008648 2953472 37.47 2688 2248792 734064 8.22 267660 2311588 16 12:55:01 AM 4928932 7008772 2953500 37.47 2688 2248944 734064 8.22 267668 2311604 4 12:56:01 AM 4928396 7008236 2954036 37.48 2688 2248944 734064 8.22 267668 2311996 16 12:57:01 AM 4929224 7009112 2953208 37.47 2688 2249000 734064 8.22 267664 2311536 8 12:58:01 AM 4929184 7009216 2953248 37.47 2688 2249144 734064 8.22 267672 2311556 4 12:59:01 AM 4929000 7009032 2953432 37.47 2688 2249144 734064 8.22 267672 2311624 4 01:00:01 AM 4927640 7007816 2954792 37.49 2688 2249288 751076 8.41 267672 2312368 104 01:01:01 AM 4927472 7007780 2954960 37.49 2688 2249412 734760 8.23 267676 2312636 116 01:02:01 AM 4928616 7009116 2953816 37.47 2688 2249604 718684 8.05 267704 2311988 96 01:03:01 AM 4928220 7008880 2954212 37.48 2688 2249764 718684 8.05 267704 2312292 4 01:04:01 AM 4928480 7009140 2953952 37.48 2688 2249764 718684 8.05 267704 2312232 4 01:05:01 AM 4928116 7008824 2954316 37.48 2688 2249812 718684 8.05 267704 2312488 16 01:06:01 AM 4928184 7009036 2954248 37.48 2688 2249956 718684 8.05 267712 2312356 4 01:07:01 AM 4928316 7009172 2954116 37.48 2688 2249960 718684 8.05 267712 2312360 4 01:08:01 AM 4927624 7008624 2954808 37.49 2688 2250104 718684 8.05 267712 2312844 20 01:09:01 AM 4927908 7009232 2954524 37.48 2688 2250428 718684 8.05 267712 2312904 24 01:10:01 AM 4926936 7008624 2955496 37.49 2688 2250792 736732 8.25 267712 2313548 168 01:11:01 AM 4926836 7008884 2955596 37.50 2688 2251152 711380 7.97 267712 2313676 96 01:12:01 AM 4926712 7009140 2955720 37.50 2688 2251532 711380 7.97 267712 2314004 80 01:13:01 AM 4926352 7009136 2956080 37.50 2688 2251888 711380 7.97 267712 2314360 40 01:14:01 AM 4925916 7009060 2956516 37.51 2688 2252248 711380 7.97 267712 2314788 200 01:15:01 AM 4925188 7008980 2957244 37.52 2688 2252892 711380 7.97 267712 2315608 24 01:16:01 AM 4924860 7008756 2957572 37.52 2688 2252996 711380 7.97 267712 2315796 16 01:17:01 AM 4924896 7008792 2957536 37.52 2688 2252996 711380 7.97 267712 2315876 4 01:18:01 AM 4924980 7008956 2957452 37.52 2688 2253076 711380 7.97 267712 2315684 84 01:19:01 AM 4925016 7008992 2957416 37.52 2688 2253076 711380 7.97 267712 2315752 4 01:20:01 AM 4924592 7008644 2957840 37.52 2688 2253152 711496 7.97 267712 2316104 84 01:21:01 AM 4924792 7008848 2957640 37.52 2688 2253156 711496 7.97 267712 2315968 4 01:22:01 AM 4924636 7008692 2957796 37.52 2688 2253156 711496 7.97 267712 2316108 4 01:23:01 AM 4924380 7008672 2958052 37.53 2688 2253392 711496 7.97 267712 2316220 64 01:24:01 AM 4924152 7008596 2958280 37.53 2688 2253544 726916 8.14 267712 2316228 4 01:25:01 AM 4924140 7008740 2958292 37.53 2688 2253700 726916 8.14 267712 2316440 4 01:26:01 AM 4924360 7008964 2958072 37.53 2688 2253704 726916 8.14 267712 2316328 0 01:27:01 AM 4923856 7008516 2958576 37.53 2688 2253768 726916 8.14 267712 2316580 16 01:28:01 AM 4924088 7008796 2958344 37.53 2688 2253808 726916 8.14 267712 2316424 8 01:29:01 AM 4923932 7008644 2958500 37.53 2688 2253812 726916 8.14 267712 2316496 4 01:30:01 AM 4923544 7008456 2958888 37.54 2688 2254012 721424 8.08 267712 2316868 152 01:31:01 AM 4923344 7008252 2959088 37.54 2688 2254016 721424 8.08 267712 2317132 4 01:32:01 AM 4923516 7008472 2958916 37.54 2688 2254064 721932 8.08 277076 2307712 292 01:33:01 AM 4923332 7008352 2959100 37.54 2688 2254128 721932 8.08 277076 2307804 56 01:34:01 AM 4923424 7008600 2959008 37.54 2688 2254284 721932 8.08 277076 2307776 4 01:35:01 AM 4923352 7008528 2959080 37.54 2688 2254284 721932 8.08 277076 2308020 4 01:36:01 AM 4923344 7008584 2959088 37.54 2688 2254348 721932 8.08 277076 2307932 4 01:37:01 AM 4923252 7008788 2959180 37.54 2688 2254644 721932 8.08 277076 2308132 60 01:38:01 AM 4922680 7008608 2959752 37.55 2688 2255036 721932 8.08 277076 2308620 192 01:39:01 AM 4922436 7008712 2959996 37.55 2688 2255392 721932 8.08 277076 2308924 172 01:40:01 AM 4921632 7008272 2960800 37.56 2688 2255756 721236 8.08 277076 2309564 4 01:41:01 AM 4921408 7008412 2961024 37.56 2688 2256116 721236 8.08 277076 2309800 40 01:42:01 AM 4921020 7008380 2961412 37.57 2688 2256472 721236 8.08 277076 2310248 120 01:43:01 AM 4920716 7008440 2961716 37.57 2688 2256836 721236 8.08 277076 2310628 40 01:44:02 AM 4920416 7008712 2962016 37.58 2688 2257400 721236 8.08 277076 2311000 56 01:45:01 AM 4920420 7008788 2962012 37.58 2688 2257472 721236 8.08 277076 2311012 4 01:46:01 AM 4920312 7008684 2962120 37.58 2688 2257476 721236 8.08 277076 2311132 4 01:47:01 AM 4920404 7008852 2962028 37.58 2688 2257552 721236 8.08 277076 2311100 4 01:48:01 AM 4920204 7008652 2962228 37.58 2688 2257552 721236 8.08 277076 2311216 8 01:49:01 AM 4919972 7008496 2962460 37.58 2688 2257628 721236 8.08 277076 2311256 4 01:50:01 AM 4919452 7007976 2962980 37.59 2688 2257628 744640 8.34 277076 2311652 4 01:51:01 AM 4919792 7008500 2962640 37.59 2688 2257812 725176 8.12 277076 2311592 184 01:52:01 AM 4919552 7008316 2962880 37.59 2688 2257868 725176 8.12 277076 2311656 16 01:53:01 AM 4919364 7008272 2963068 37.59 2688 2258012 725176 8.12 277084 2311792 4 01:54:01 AM 4919480 7008392 2962952 37.59 2688 2258016 725176 8.12 277084 2311864 4 01:55:01 AM 4919336 7008304 2963096 37.59 2688 2258072 725176 8.12 277084 2311636 4 01:56:01 AM 4919364 7008424 2963068 37.59 2688 2258164 725176 8.12 277084 2311732 48 01:57:01 AM 4919448 7008576 2962984 37.59 2688 2258232 725176 8.12 277084 2311800 4 01:58:01 AM 4919196 7008512 2963236 37.59 2688 2258420 725176 8.12 277088 2311988 136 01:59:01 AM 4918972 7008288 2963460 37.60 2688 2258420 725176 8.12 277088 2312068 4 02:00:01 AM 4918468 7007892 2963964 37.60 2688 2258528 729280 8.17 277088 2312456 112 02:01:01 AM 4917468 7007072 2964964 37.61 2688 2258708 729468 8.17 277088 2313444 4 02:02:01 AM 4918188 7008112 2964244 37.61 2688 2259036 729468 8.17 277096 2312984 24 02:03:01 AM 4915788 7006088 2966644 37.64 2688 2259412 729468 8.17 277096 2315156 88 02:04:01 AM 4916304 7006960 2966128 37.63 2688 2259768 729468 8.17 277096 2314944 24 02:05:01 AM 4916016 7007036 2966416 37.63 2688 2260132 729468 8.17 277096 2315124 160 02:06:01 AM 4914856 7006240 2967576 37.65 2688 2260488 729468 8.17 277096 2316036 92 02:07:01 AM 4914880 7006852 2967552 37.65 2688 2261072 729468 8.17 277096 2316244 280 02:08:01 AM 4914292 7006592 2968140 37.66 2688 2261408 729468 8.17 277096 2316708 20 02:09:01 AM 4913840 7006432 2968592 37.66 2688 2261700 729468 8.17 277096 2317248 56 02:10:01 AM 4913316 7006196 2969116 37.67 2688 2261996 723384 8.10 277096 2317816 160 02:11:01 AM 4913308 7006444 2969124 37.67 2688 2262236 723384 8.10 277096 2318028 4 02:12:01 AM 4912924 7006352 2969508 37.67 2688 2262528 723384 8.10 277096 2318340 100 02:13:01 AM 4912696 7006408 2969736 37.68 2688 2262828 723384 8.10 277096 2318448 160 02:14:01 AM 4912524 7006560 2969908 37.68 2688 2263136 723384 8.10 277156 2318652 24 02:15:01 AM 4912232 7006468 2970200 37.68 2688 2263336 723384 8.10 277156 2318780 160 02:16:01 AM 4912324 7006652 2970108 37.68 2688 2263428 723384 8.10 277164 2318872 24 02:17:01 AM 4912068 7006520 2970364 37.68 2688 2263552 723384 8.10 277164 2318980 80 02:18:01 AM 4912060 7006584 2970372 37.68 2688 2263624 723384 8.10 277164 2319088 16 02:19:01 AM 4911688 7006496 2970744 37.69 2688 2263908 723384 8.10 277164 2319420 4 02:20:01 AM 4910832 7006008 2971600 37.70 2688 2264276 739960 8.29 277164 2320252 128 02:21:01 AM 4910592 7006132 2971840 37.70 2688 2264644 739960 8.29 277164 2320392 52 02:22:01 AM 4910452 7006360 2971980 37.70 2688 2265012 739960 8.29 277164 2320556 204 02:23:01 AM 4910280 7006552 2972152 37.71 2688 2265376 739960 8.29 277164 2320920 40 02:24:01 AM 4909588 7006224 2972844 37.71 2688 2265740 739960 8.29 277164 2321356 40 02:25:01 AM 4909376 7006376 2973056 37.72 2688 2266104 739960 8.29 277164 2321652 20 02:26:01 AM 4908552 7006160 2973880 37.73 2688 2266704 739960 8.29 277164 2322480 4 02:27:01 AM 4908020 7005888 2974412 37.73 2688 2266964 739960 8.29 277164 2323040 64 02:28:01 AM 4907316 7005468 2975116 37.74 2688 2267256 739960 8.29 277164 2323580 200 02:29:01 AM 4906996 7005392 2975436 37.75 2688 2267500 739960 8.29 277164 2324000 4 02:30:01 AM 4906340 7005024 2976092 37.76 2688 2267796 716824 8.03 277164 2324576 56 02:31:01 AM 4906128 7005116 2976304 37.76 2688 2268084 716824 8.03 277164 2324816 152 02:32:01 AM 4906140 7005492 2976292 37.76 2688 2268448 716824 8.03 277164 2324912 40 02:33:01 AM 4905740 7005148 2976692 37.76 2688 2268504 716824 8.03 277164 2325140 56 02:34:01 AM 4905584 7005148 2976848 37.77 2688 2268660 716824 8.03 277168 2325344 28 02:35:01 AM 4905840 7005436 2976592 37.76 2688 2268692 716824 8.03 277168 2325172 44 02:36:01 AM 4905524 7005364 2976908 37.77 2688 2268936 716824 8.03 277172 2325404 232 02:37:01 AM 4905236 7005288 2977196 37.77 2688 2269156 732792 8.21 277172 2325632 96 02:38:01 AM 4904924 7005336 2977508 37.77 2688 2269512 732792 8.21 277172 2326104 24 02:39:01 AM 4903940 7004712 2978492 37.79 2688 2269872 732792 8.21 277172 2327116 24 02:40:01 AM 4903120 7004244 2979312 37.80 2688 2270216 732648 8.20 277172 2327748 40 02:41:01 AM 4903048 7004536 2979384 37.80 2688 2270576 732648 8.20 277172 2327868 184 02:42:01 AM 4902512 7004364 2979920 37.80 2688 2270940 732648 8.20 277172 2328368 144 02:43:01 AM 4902188 7004716 2980244 37.81 2688 2271624 732648 8.20 277172 2328928 204 02:44:01 AM 4902272 7004900 2980160 37.81 2688 2271716 732648 8.20 277172 2328888 4 02:45:01 AM 4901880 7004600 2980552 37.81 2688 2271816 732648 8.20 277172 2329184 24 02:46:01 AM 4901772 7004588 2980660 37.81 2688 2271908 732648 8.20 277172 2329120 24 02:47:01 AM 4901816 7004716 2980616 37.81 2688 2271984 732648 8.20 277172 2329092 4 02:48:01 AM 4901268 7004264 2981164 37.82 2688 2272080 732648 8.20 277172 2329728 8 02:49:01 AM 4901536 7004756 2980896 37.82 2688 2272304 732648 8.20 277172 2329500 4 02:50:01 AM 4900936 7004228 2981496 37.82 2688 2272376 714700 8.00 277172 2329748 44 02:51:01 AM 4901052 7004564 2981380 37.82 2688 2272600 714700 8.00 277172 2330056 100 02:52:01 AM 4900648 7004520 2981784 37.83 2688 2272960 714700 8.00 277172 2330304 128 02:53:02 AM 4900460 7004696 2981972 37.83 2688 2273320 714700 8.00 277172 2330564 84 02:54:01 AM 4900184 7004780 2982248 37.83 2688 2273680 714700 8.00 277172 2330876 56 02:55:01 AM 4899604 7004560 2982828 37.84 2688 2274040 714700 8.00 277172 2331288 40 02:56:01 AM 4899380 7004696 2983052 37.84 2688 2274400 714700 8.00 277172 2331528 96 02:57:01 AM 4899116 7004824 2983316 37.85 2688 2274784 714700 8.00 277172 2331932 80 02:58:01 AM 4898544 7004736 2983888 37.85 2688 2275268 714700 8.00 277172 2332404 56 02:59:01 AM 4898380 7004660 2984052 37.86 2688 2275356 714700 8.00 277172 2332560 4 03:00:01 AM 4897944 7004320 2984488 37.86 2688 2275452 716264 8.02 277172 2332936 36 03:01:01 AM 4897028 7003496 2985404 37.87 2688 2275544 716264 8.02 277172 2333580 4 03:02:01 AM 4898016 7004580 2984416 37.86 2688 2275640 716264 8.02 277172 2332776 40 03:03:01 AM 4898036 7004688 2984396 37.86 2688 2275728 716264 8.02 277172 2332980 4 03:04:01 AM 4897876 7004736 2984556 37.86 2688 2275936 716264 8.02 277172 2333152 16 03:05:01 AM 4897712 7004744 2984720 37.87 2688 2276108 716264 8.02 277172 2333248 16 03:06:01 AM 4897396 7004744 2985036 37.87 2688 2276432 716264 8.02 277172 2333572 24 03:07:01 AM 4897040 7004748 2985392 37.87 2688 2276792 716264 8.02 277172 2333936 24 03:08:01 AM 4896684 7004768 2985748 37.88 2688 2277168 716264 8.02 277172 2334324 24 03:09:01 AM 4895980 7004424 2986452 37.89 2688 2277528 716264 8.02 277172 2334776 40 03:10:01 AM 4895448 7004248 2986984 37.89 2688 2277884 732496 8.20 277172 2335412 24 03:11:01 AM 4895480 7004652 2986952 37.89 2688 2278248 732496 8.20 277172 2335440 192 03:12:01 AM 4894868 7004624 2987564 37.90 2688 2278828 747936 8.37 277172 2336020 40 03:13:01 AM 4894784 7004636 2987648 37.90 2688 2278924 731788 8.19 277172 2336116 4 03:14:01 AM 4894804 7004748 2987628 37.90 2688 2279016 731788 8.19 277172 2336276 40 03:15:01 AM 4894860 7004892 2987572 37.90 2688 2279104 731788 8.19 277172 2336296 4 03:16:01 AM 4894772 7004900 2987660 37.90 2688 2279200 731788 8.19 277172 2336404 40 03:17:01 AM 4894508 7004728 2987924 37.91 2688 2279292 731788 8.19 277172 2336496 4 03:18:01 AM 4894400 7004848 2988032 37.91 2688 2279520 713568 7.99 277172 2336736 152 03:19:01 AM 4893980 7004596 2988452 37.91 2688 2279688 713568 7.99 277172 2336968 136 03:20:01 AM 4893352 7004176 2989080 37.92 2688 2279904 724456 8.11 277172 2337572 80 03:21:01 AM 4893488 7004700 2988944 37.92 2688 2280284 724456 8.11 277172 2337688 56 03:22:01 AM 4892708 7004288 2989724 37.93 2688 2280652 725228 8.12 278464 2336824 16 03:23:01 AM 4892516 7004456 2989916 37.93 2688 2281012 725228 8.12 278464 2337184 40 03:24:01 AM 4891696 7004012 2990736 37.94 2688 2281388 725228 8.12 278464 2337872 40 03:25:01 AM 4892168 7004844 2990264 37.94 2688 2281748 725228 8.12 278464 2337704 144 03:26:01 AM 4891244 7004608 2991188 37.95 2688 2282436 725228 8.12 278464 2338392 176 03:27:01 AM 4891104 7004564 2991328 37.95 2688 2282532 725228 8.12 278464 2338488 36 03:28:01 AM 4891144 7004704 2991288 37.95 2688 2282624 725228 8.12 278464 2338572 68 03:29:01 AM 4891128 7004772 2991304 37.95 2688 2282716 725228 8.12 278464 2338740 40 03:30:01 AM 4890496 7004236 2991936 37.96 2688 2282812 740792 8.29 278464 2339232 24 03:31:01 AM 4890168 7003996 2992264 37.96 2688 2282892 740792 8.29 278464 2339396 40 03:32:01 AM 4890428 7004508 2992004 37.96 2688 2283144 740792 8.29 278464 2339320 4 03:33:01 AM 4890092 7004404 2992340 37.96 2688 2283376 725096 8.12 278464 2339500 184 03:34:01 AM 4887708 7002280 2994724 37.99 2688 2283636 725096 8.12 278468 2341808 52 03:35:01 AM 4887364 7002152 2995068 38.00 2688 2283852 758628 8.49 278468 2342096 216 03:36:01 AM 4887008 7002024 2995424 38.00 2688 2284080 776288 8.69 278468 2342452 48 03:37:01 AM 4886512 7001788 2995920 38.01 2688 2284340 776288 8.69 278468 2342852 252 03:38:01 AM 4883784 6999288 2998648 38.04 2688 2284564 793468 8.88 278468 2345236 48 03:39:01 AM 4883104 6998844 2999328 38.05 2688 2284800 810388 9.07 278468 2345636 16 03:40:01 AM 4978712 6985568 2903720 36.84 2688 2177636 667788 7.48 320380 2219688 60868 03:41:01 AM 4971108 6972028 2911324 36.93 2688 2176012 683184 7.65 515124 2044788 960 Average: 4916880 7006961 2965552 37.62 2688 2259213 725245 8.12 274606 2316880 339 12:00:01 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 12:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:01:01 AM eth0 0.38 0.13 0.04 0.02 0.00 0.00 0.00 0.00 12:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:02:01 AM eth0 9.40 9.15 1.34 0.68 0.00 0.00 0.00 0.00 12:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:03:01 AM eth0 4.98 4.43 0.74 0.35 0.00 0.00 0.00 0.00 12:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:04:01 AM eth0 9.57 8.75 1.51 0.76 0.00 0.00 0.00 0.00 12:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:05:01 AM eth0 1.17 0.67 0.35 0.28 0.00 0.00 0.00 0.00 12:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:06:01 AM eth0 0.32 0.00 0.01 0.00 0.00 0.00 0.00 0.00 12:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:07:01 AM eth0 4.30 4.10 0.62 0.29 0.00 0.00 0.00 0.00 12:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:08:01 AM eth0 0.80 0.47 0.08 0.09 0.00 0.00 0.00 0.00 12:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:09:01 AM eth0 0.50 0.10 0.15 0.06 0.00 0.00 0.00 0.00 12:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:10:01 AM eth0 9.50 8.40 1.50 0.85 0.00 0.00 0.00 0.00 12:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:11:01 AM eth0 10.50 7.65 2.08 1.47 0.00 0.00 0.00 0.00 12:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:12:01 AM eth0 13.00 9.23 2.64 1.77 0.00 0.00 0.00 0.00 12:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:13:01 AM eth0 13.25 9.10 2.63 1.76 0.00 0.00 0.00 0.00 12:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:14:01 AM eth0 13.13 9.26 2.74 1.83 0.00 0.00 0.00 0.00 12:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:15:01 AM eth0 13.30 9.28 2.64 1.81 0.00 0.00 0.00 0.00 12:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:16:01 AM eth0 13.41 9.40 2.70 1.79 0.00 0.00 0.00 0.00 12:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:17:01 AM eth0 22.96 16.18 4.69 3.00 0.00 0.00 0.00 0.00 12:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:18:01 AM eth0 3.53 0.50 0.43 0.07 0.00 0.00 0.00 0.00 12:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:19:01 AM eth0 0.52 0.18 0.15 0.07 0.00 0.00 0.00 0.00 12:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:20:01 AM eth0 0.57 0.40 0.08 0.05 0.00 0.00 0.00 0.00 12:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:21:01 AM eth0 0.40 0.05 0.02 0.00 0.00 0.00 0.00 0.00 12:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:22:01 AM eth0 0.43 0.32 0.07 0.04 0.00 0.00 0.00 0.00 12:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:23:01 AM eth0 0.43 0.07 0.02 0.00 0.00 0.00 0.00 0.00 12:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:24:01 AM eth0 1.08 0.37 0.44 0.26 0.00 0.00 0.00 0.00 12:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:25:01 AM eth0 16.19 14.20 2.77 1.61 0.00 0.00 0.00 0.00 12:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:26:01 AM eth0 5.32 5.13 0.74 0.40 0.00 0.00 0.00 0.00 12:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:27:01 AM eth0 1.27 0.53 0.14 0.09 0.00 0.00 0.00 0.00 12:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:28:01 AM eth0 0.58 0.30 0.27 0.20 0.00 0.00 0.00 0.00 12:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:29:01 AM eth0 5.23 4.78 0.83 0.44 0.00 0.00 0.00 0.00 12:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:30:01 AM eth0 0.32 0.10 0.01 0.01 0.00 0.00 0.00 0.00 12:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:31:01 AM eth0 0.98 0.53 0.29 3.29 0.00 0.00 0.00 0.00 12:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:32:01 AM eth0 7.18 5.55 1.00 0.44 0.00 0.00 0.00 0.00 12:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:33:01 AM eth0 0.87 0.35 0.52 0.38 0.00 0.00 0.00 0.00 12:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:34:01 AM eth0 4.27 3.92 0.75 0.34 0.00 0.00 0.00 0.00 12:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:35:01 AM eth0 5.02 4.20 1.02 0.55 0.00 0.00 0.00 0.00 12:36:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:36:02 AM eth0 0.67 0.42 0.08 0.08 0.00 0.00 0.00 0.00 12:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:37:01 AM eth0 0.31 0.07 0.01 0.00 0.00 0.00 0.00 0.00 12:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:38:01 AM eth0 5.10 4.77 0.73 0.37 0.00 0.00 0.00 0.00 12:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:39:01 AM eth0 10.33 8.73 1.80 1.03 0.00 0.00 0.00 0.00 12:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:40:01 AM eth0 14.93 10.51 3.24 2.21 0.00 0.00 0.00 0.00 12:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:41:01 AM eth0 13.38 9.21 2.71 1.77 0.00 0.00 0.00 0.00 12:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:42:01 AM eth0 13.55 9.23 2.67 1.77 0.00 0.00 0.00 0.00 12:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:43:01 AM eth0 14.23 9.50 2.98 1.96 0.00 0.00 0.00 0.00 12:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:44:01 AM eth0 13.80 9.55 3.08 2.05 0.00 0.00 0.00 0.00 12:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:45:01 AM eth0 13.56 9.32 2.77 1.80 0.00 0.00 0.00 0.00 12:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:46:01 AM eth0 17.26 12.78 3.65 2.35 0.00 0.00 0.00 0.00 12:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:47:01 AM eth0 0.53 0.35 0.08 0.05 0.00 0.00 0.00 0.00 12:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:48:01 AM eth0 1.10 0.20 0.32 0.19 0.00 0.00 0.00 0.00 12:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:49:01 AM eth0 0.72 0.42 0.21 0.11 0.00 0.00 0.00 0.00 12:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:50:01 AM eth0 0.35 0.07 0.02 0.00 0.00 0.00 0.00 0.00 12:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:51:01 AM eth0 0.80 0.33 0.12 0.05 0.00 0.00 0.00 0.00 12:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:52:01 AM eth0 0.65 0.17 0.27 0.19 0.00 0.00 0.00 0.00 12:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:53:01 AM eth0 11.06 9.46 1.81 1.06 0.00 0.00 0.00 0.00 12:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:54:01 AM eth0 5.62 5.12 1.13 0.66 0.00 0.00 0.00 0.00 12:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:55:01 AM eth0 2.73 0.52 0.34 0.11 0.00 0.00 0.00 0.00 12:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:56:01 AM eth0 0.98 0.28 0.31 0.19 0.00 0.00 0.00 0.00 12:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:57:01 AM eth0 4.88 4.62 0.68 0.36 0.00 0.00 0.00 0.00 12:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:58:01 AM eth0 0.47 0.20 0.04 0.04 0.00 0.00 0.00 0.00 12:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:59:01 AM eth0 5.18 0.17 0.65 0.07 0.00 0.00 0.00 0.00 01:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:00:01 AM eth0 12.08 10.10 2.57 1.51 0.00 0.00 0.00 0.00 01:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:01:01 AM eth0 4.95 4.61 0.71 0.37 0.00 0.00 0.00 0.00 01:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:02:01 AM eth0 13.39 8.81 1.98 0.73 0.00 0.00 0.00 0.00 01:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:03:01 AM eth0 4.37 0.82 0.74 0.34 0.00 0.00 0.00 0.00 01:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:04:01 AM eth0 1.28 0.18 0.22 0.07 0.00 0.00 0.00 0.00 01:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:05:01 AM eth0 4.97 4.33 0.89 0.48 0.00 0.00 0.00 0.00 01:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:06:01 AM eth0 0.98 0.48 0.10 0.10 0.00 0.00 0.00 0.00 01:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:07:01 AM eth0 1.53 0.07 0.10 0.00 0.00 0.00 0.00 0.00 01:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:08:01 AM eth0 11.16 8.78 1.89 1.06 0.00 0.00 0.00 0.00 01:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:09:01 AM eth0 14.93 8.68 2.64 1.69 0.00 0.00 0.00 0.00 01:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:10:01 AM eth0 15.26 9.27 2.76 1.77 0.00 0.00 0.00 0.00 01:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:11:01 AM eth0 13.05 8.96 2.61 1.75 0.00 0.00 0.00 0.00 01:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:12:01 AM eth0 13.80 9.68 2.75 1.84 0.00 0.00 0.00 0.00 01:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:13:01 AM eth0 13.31 9.28 2.64 1.77 0.00 0.00 0.00 0.00 01:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:14:01 AM eth0 13.36 9.32 2.81 1.83 0.00 0.00 0.00 0.00 01:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:15:01 AM eth0 22.76 15.51 4.62 2.91 0.00 0.00 0.00 0.00 01:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:16:01 AM eth0 4.28 0.65 0.80 0.29 0.00 0.00 0.00 0.00 01:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:17:01 AM eth0 0.92 0.38 0.52 0.38 0.00 0.00 0.00 0.00 01:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:18:01 AM eth0 5.32 0.32 0.78 0.04 0.00 0.00 0.00 0.00 01:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:19:01 AM eth0 3.08 0.17 0.37 0.07 0.00 0.00 0.00 0.00 01:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:20:01 AM eth0 1.03 0.38 0.13 0.06 0.00 0.00 0.00 0.00 01:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:21:01 AM eth0 1.17 0.03 0.08 0.00 0.00 0.00 0.00 0.00 01:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:22:01 AM eth0 1.02 0.32 0.33 0.23 0.00 0.00 0.00 0.00 01:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:23:01 AM eth0 16.83 15.03 2.58 1.48 0.00 0.00 0.00 0.00 01:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:24:01 AM eth0 6.15 5.40 0.95 0.49 0.00 0.00 0.00 0.00 01:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:25:01 AM eth0 1.20 0.63 0.18 0.11 0.00 0.00 0.00 0.00 01:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:26:01 AM eth0 0.77 0.03 0.06 0.00 0.00 0.00 0.00 0.00 01:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:27:01 AM eth0 5.48 4.82 0.96 0.56 0.00 0.00 0.00 0.00 01:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:28:01 AM eth0 0.48 0.07 0.02 0.01 0.00 0.00 0.00 0.00 01:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:29:01 AM eth0 0.62 0.15 0.15 0.07 0.00 0.00 0.00 0.00 01:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:30:01 AM eth0 5.97 5.57 0.80 0.45 0.00 0.00 0.00 0.00 01:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:31:01 AM eth0 1.10 0.22 0.36 0.19 0.00 0.00 0.00 0.00 01:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:32:01 AM eth0 5.27 4.38 0.73 0.32 0.00 0.00 0.00 0.00 01:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:33:01 AM eth0 5.76 5.08 1.01 0.58 0.00 0.00 0.00 0.00 01:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:34:01 AM eth0 1.65 0.62 0.28 0.17 0.00 0.00 0.00 0.00 01:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:35:01 AM eth0 0.97 0.25 0.28 0.20 0.00 0.00 0.00 0.00 01:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:36:01 AM eth0 5.93 5.05 0.89 0.40 0.00 0.00 0.00 0.00 01:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:37:01 AM eth0 11.70 10.26 1.94 1.22 0.00 0.00 0.00 0.00 01:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:38:01 AM eth0 14.48 9.96 2.92 1.87 0.00 0.00 0.00 0.00 01:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:39:01 AM eth0 13.25 9.48 2.77 1.85 0.00 0.00 0.00 0.00 01:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:40:01 AM eth0 13.11 9.27 2.67 1.77 0.00 0.00 0.00 0.00 01:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:41:01 AM eth0 13.23 9.18 2.62 1.76 0.00 0.00 0.00 0.00 01:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:42:01 AM eth0 13.81 9.52 2.95 2.00 0.00 0.00 0.00 0.00 01:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:43:01 AM eth0 12.93 9.10 2.82 1.93 0.00 0.00 0.00 0.00 01:44:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:44:02 AM eth0 18.76 13.38 3.97 2.50 0.00 0.00 0.00 0.00 01:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:45:01 AM eth0 0.61 0.32 0.08 0.05 0.00 0.00 0.00 0.00 01:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:46:01 AM eth0 0.35 0.03 0.02 0.00 0.00 0.00 0.00 0.00 01:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:47:01 AM eth0 0.53 0.33 0.07 0.04 0.00 0.00 0.00 0.00 01:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:48:01 AM eth0 0.25 0.03 0.01 0.00 0.00 0.00 0.00 0.00 01:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:49:01 AM eth0 0.75 0.42 0.21 0.11 0.00 0.00 0.00 0.00 01:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:50:01 AM eth0 0.30 0.00 0.07 0.00 0.00 0.00 0.00 0.00 01:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:51:01 AM eth0 10.68 9.43 1.75 1.06 0.00 0.00 0.00 0.00 01:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:52:01 AM eth0 5.56 5.31 0.77 0.40 0.00 0.00 0.00 0.00 01:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:53:01 AM eth0 0.83 0.55 0.09 0.10 0.00 0.00 0.00 0.00 01:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:54:01 AM eth0 0.77 0.25 0.23 0.07 0.00 0.00 0.00 0.00 01:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:55:01 AM eth0 3.62 3.42 0.64 0.29 0.00 0.00 0.00 0.00 01:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:56:01 AM eth0 8.50 8.30 1.25 0.63 0.00 0.00 0.00 0.00 01:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:57:01 AM eth0 5.38 4.97 0.76 0.43 0.00 0.00 0.00 0.00 01:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:58:01 AM eth0 5.18 5.06 0.73 0.41 0.00 0.00 0.00 0.00 01:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:59:01 AM eth0 0.53 0.15 0.15 0.07 0.00 0.00 0.00 0.00 02:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:00:01 AM eth0 3.32 2.28 0.67 0.45 0.00 0.00 0.00 0.00 02:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:01:01 AM eth0 11.61 10.23 1.93 1.16 0.00 0.00 0.00 0.00 02:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:02:01 AM eth0 12.26 8.31 2.44 1.61 0.00 0.00 0.00 0.00 02:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:03:01 AM eth0 13.05 9.27 2.82 1.95 0.00 0.00 0.00 0.00 02:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:04:01 AM eth0 13.11 9.23 2.70 1.82 0.00 0.00 0.00 0.00 02:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:05:01 AM eth0 13.18 9.00 2.63 1.75 0.00 0.00 0.00 0.00 02:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:06:01 AM eth0 13.33 9.37 2.87 1.95 0.00 0.00 0.00 0.00 02:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:07:01 AM eth0 19.65 13.85 4.30 2.65 0.00 0.00 0.00 0.00 02:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:08:01 AM eth0 9.58 6.60 1.90 1.30 0.00 0.00 0.00 0.00 02:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:09:01 AM eth0 1.60 0.70 0.40 0.16 0.00 0.00 0.00 0.00 02:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:10:01 AM eth0 0.73 0.55 0.18 0.10 0.00 0.00 0.00 0.00 02:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:11:01 AM eth0 5.86 0.55 0.74 0.10 0.00 0.00 0.00 0.00 02:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:12:01 AM eth0 2.90 0.78 0.65 0.31 0.00 0.00 0.00 0.00 02:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:13:01 AM eth0 1.25 0.80 0.45 0.29 0.00 0.00 0.00 0.00 02:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:14:01 AM eth0 13.90 6.53 2.28 0.91 0.00 0.00 0.00 0.00 02:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:15:01 AM eth0 6.60 4.42 0.92 0.42 0.00 0.00 0.00 0.00 02:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:16:01 AM eth0 3.28 2.43 0.40 0.23 0.00 0.00 0.00 0.00 02:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:17:01 AM eth0 5.38 4.82 0.73 0.43 0.00 0.00 0.00 0.00 02:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:18:01 AM eth0 2.32 1.58 0.36 0.16 0.00 0.00 0.00 0.00 02:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:19:01 AM eth0 7.33 5.93 1.24 0.80 0.00 0.00 0.00 0.00 02:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:20:01 AM eth0 12.50 9.17 2.59 1.77 0.00 0.00 0.00 0.00 02:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:21:01 AM eth0 13.53 9.13 2.73 1.76 0.00 0.00 0.00 0.00 02:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:22:01 AM eth0 13.76 9.00 2.76 1.75 0.00 0.00 0.00 0.00 02:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:23:01 AM eth0 12.68 8.88 2.62 1.74 0.00 0.00 0.00 0.00 02:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:24:01 AM eth0 13.40 9.40 2.81 1.84 0.00 0.00 0.00 0.00 02:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:25:01 AM eth0 13.11 8.97 2.61 1.75 0.00 0.00 0.00 0.00 02:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:26:01 AM eth0 23.18 14.45 4.82 2.87 0.00 0.00 0.00 0.00 02:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:27:01 AM eth0 1.83 0.97 0.98 0.65 0.00 0.00 0.00 0.00 02:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:28:01 AM eth0 0.93 0.60 0.21 0.10 0.00 0.00 0.00 0.00 02:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:29:01 AM eth0 7.38 0.82 1.19 0.16 0.00 0.00 0.00 0.00 02:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:30:01 AM eth0 1.85 0.80 0.28 0.13 0.00 0.00 0.00 0.00 02:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:31:01 AM eth0 1.65 0.75 0.48 0.29 0.00 0.00 0.00 0.00 02:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:32:01 AM eth0 11.85 9.82 1.94 1.13 0.00 0.00 0.00 0.00 02:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:33:01 AM eth0 5.82 4.60 0.97 0.56 0.00 0.00 0.00 0.00 02:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:34:01 AM eth0 4.33 3.12 1.01 0.57 0.00 0.00 0.00 0.00 02:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:35:01 AM eth0 5.00 4.65 0.69 0.32 0.00 0.00 0.00 0.00 02:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:36:01 AM eth0 7.42 6.30 1.42 0.78 0.00 0.00 0.00 0.00 02:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:37:01 AM eth0 7.87 5.30 1.49 1.02 0.00 0.00 0.00 0.00 02:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:38:01 AM eth0 13.31 9.15 2.65 1.76 0.00 0.00 0.00 0.00 02:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:39:01 AM eth0 13.78 9.26 2.79 1.85 0.00 0.00 0.00 0.00 02:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:40:01 AM eth0 12.58 8.88 2.49 1.73 0.00 0.00 0.00 0.00 02:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:41:01 AM eth0 13.23 9.10 2.64 1.76 0.00 0.00 0.00 0.00 02:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:42:01 AM eth0 13.36 9.30 2.66 1.79 0.00 0.00 0.00 0.00 02:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:43:01 AM eth0 23.91 16.74 4.92 3.12 0.00 0.00 0.00 0.00 02:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:44:01 AM eth0 1.18 0.35 0.29 0.11 0.00 0.00 0.00 0.00 02:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:45:01 AM eth0 1.02 0.48 0.36 0.25 0.00 0.00 0.00 0.00 02:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:46:01 AM eth0 0.30 0.25 0.08 0.05 0.00 0.00 0.00 0.00 02:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:47:01 AM eth0 1.05 0.25 0.17 0.05 0.00 0.00 0.00 0.00 02:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:48:01 AM eth0 0.57 0.35 0.33 0.23 0.00 0.00 0.00 0.00 02:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:49:01 AM eth0 6.03 4.02 1.22 0.89 0.00 0.00 0.00 0.00 02:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:50:01 AM eth0 3.93 3.45 1.00 0.44 0.00 0.00 0.00 0.00 02:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:51:01 AM eth0 12.39 10.41 2.14 1.35 0.00 0.00 0.00 0.00 02:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:52:01 AM eth0 13.05 9.13 2.63 1.76 0.00 0.00 0.00 0.00 02:53:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:53:02 AM eth0 13.65 9.28 2.70 1.77 0.00 0.00 0.00 0.00 02:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:54:01 AM eth0 13.25 9.39 2.79 1.85 0.00 0.00 0.00 0.00 02:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:55:01 AM eth0 13.48 9.20 2.67 1.76 0.00 0.00 0.00 0.00 02:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:56:01 AM eth0 12.91 9.10 2.61 1.76 0.00 0.00 0.00 0.00 02:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:57:01 AM eth0 14.06 9.73 2.84 1.91 0.00 0.00 0.00 0.00 02:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:58:01 AM eth0 14.83 10.55 3.17 1.93 0.00 0.00 0.00 0.00 02:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:59:01 AM eth0 0.75 0.32 0.22 0.11 0.00 0.00 0.00 0.00 03:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:00:01 AM eth0 0.27 0.22 0.08 0.04 0.00 0.00 0.00 0.00 03:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:01:01 AM eth0 0.45 0.20 0.09 0.04 0.00 0.00 0.00 0.00 03:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:02:01 AM eth0 0.30 0.20 0.08 0.04 0.00 0.00 0.00 0.00 03:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:03:01 AM eth0 0.45 0.25 0.09 0.05 0.00 0.00 0.00 0.00 03:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:04:01 AM eth0 10.51 9.08 1.97 1.15 0.00 0.00 0.00 0.00 03:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:05:01 AM eth0 11.03 9.73 1.88 1.13 0.00 0.00 0.00 0.00 03:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:06:01 AM eth0 12.11 8.60 2.45 1.67 0.00 0.00 0.00 0.00 03:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:07:01 AM eth0 13.31 9.18 2.68 1.76 0.00 0.00 0.00 0.00 03:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:08:01 AM eth0 13.46 9.30 2.68 1.78 0.00 0.00 0.00 0.00 03:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:09:01 AM eth0 12.86 9.05 2.73 1.81 0.00 0.00 0.00 0.00 03:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:10:01 AM eth0 12.83 9.18 2.62 1.80 0.00 0.00 0.00 0.00 03:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:11:01 AM eth0 12.66 8.80 2.58 1.70 0.00 0.00 0.00 0.00 03:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:12:01 AM eth0 19.23 13.81 4.07 2.57 0.00 0.00 0.00 0.00 03:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:13:01 AM eth0 0.35 0.20 0.08 0.04 0.00 0.00 0.00 0.00 03:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:14:01 AM eth0 0.57 0.38 0.22 0.11 0.00 0.00 0.00 0.00 03:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:15:01 AM eth0 0.37 0.17 0.07 0.04 0.00 0.00 0.00 0.00 03:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:16:01 AM eth0 0.23 0.20 0.08 0.04 0.00 0.00 0.00 0.00 03:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:17:01 AM eth0 0.55 0.30 0.11 0.05 0.00 0.00 0.00 0.00 03:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:18:01 AM eth0 9.20 7.63 1.74 0.97 0.00 0.00 0.00 0.00 03:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:19:01 AM eth0 11.11 9.41 2.14 1.29 0.00 0.00 0.00 0.00 03:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:20:01 AM eth0 7.83 5.86 1.57 1.11 0.00 0.00 0.00 0.00 03:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:21:01 AM eth0 13.78 9.21 2.76 1.77 0.00 0.00 0.00 0.00 03:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:22:01 AM eth0 13.76 9.87 2.72 1.82 0.00 0.00 0.00 0.00 03:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:23:01 AM eth0 13.66 9.18 2.68 1.76 0.00 0.00 0.00 0.00 03:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:24:01 AM eth0 13.60 9.65 3.05 2.08 0.00 0.00 0.00 0.00 03:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:25:01 AM eth0 13.05 8.98 2.62 1.75 0.00 0.00 0.00 0.00 03:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:26:01 AM eth0 23.66 16.90 5.00 3.15 0.00 0.00 0.00 0.00 03:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:27:01 AM eth0 0.42 0.20 0.09 0.04 0.00 0.00 0.00 0.00 03:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:28:01 AM eth0 0.63 0.20 0.18 0.04 0.00 0.00 0.00 0.00 03:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:29:01 AM eth0 0.58 0.30 0.22 0.11 0.00 0.00 0.00 0.00 03:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:30:01 AM eth0 0.22 0.20 0.08 0.04 0.00 0.00 0.00 0.00 03:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:31:01 AM eth0 0.93 0.40 0.36 0.23 0.00 0.00 0.00 0.00 03:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:32:01 AM eth0 4.58 3.37 0.92 0.66 0.00 0.00 0.00 0.00 03:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:33:01 AM eth0 6.05 4.43 1.33 0.91 0.00 0.00 0.00 0.00 03:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:34:01 AM eth0 6.62 5.68 1.44 0.85 0.00 0.00 0.00 0.00 03:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:35:01 AM eth0 4.80 3.83 0.92 0.60 0.00 0.00 0.00 0.00 03:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:36:01 AM eth0 4.58 3.50 0.92 0.63 0.00 0.00 0.00 0.00 03:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:37:01 AM eth0 6.65 5.30 1.31 0.83 0.00 0.00 0.00 0.00 03:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:38:01 AM eth0 5.22 4.07 1.00 0.63 0.00 0.00 0.00 0.00 03:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:39:01 AM eth0 5.30 4.05 1.12 0.74 0.00 0.00 0.00 0.00 03:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:40:01 AM eth0 105.08 69.98 184.96 230.31 0.00 0.00 0.00 0.00 03:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:41:01 AM eth0 15.08 14.95 12.49 7.05 0.00 0.00 0.00 0.00 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 Average: eth0 7.59 5.38 2.26 1.94 0.00 0.00 0.00 0.00 ---> sar -P ALL: Linux 4.18.0-553.5.1.el8.x86_64 (prd-centos8-robot-2c-8g-883.novalocal) 12/08/2024 _x86_64_ (2 CPU) 12:00:01 AM CPU %user %nice %system %iowait %steal %idle 12:01:01 AM all 0.33 0.03 0.20 0.06 0.03 99.35 12:01:01 AM 0 0.53 0.02 0.10 0.10 0.05 99.20 12:01:01 AM 1 0.12 0.05 0.30 0.02 0.02 99.50 12:02:01 AM all 4.77 0.00 2.40 0.00 0.06 92.77 12:02:01 AM 0 0.42 0.00 0.22 0.00 0.05 99.31 12:02:01 AM 1 9.38 0.00 4.70 0.00 0.07 85.85 12:03:01 AM all 6.03 0.00 1.65 0.00 0.07 92.24 12:03:01 AM 0 1.30 0.00 0.22 0.00 0.07 98.42 12:03:01 AM 1 11.27 0.00 3.24 0.00 0.07 85.42 12:04:01 AM all 6.57 0.00 4.03 0.00 0.07 89.33 12:04:01 AM 0 3.54 0.00 1.29 0.00 0.09 95.08 12:04:01 AM 1 9.73 0.00 6.88 0.00 0.05 83.33 12:05:01 AM all 4.77 0.00 2.72 0.00 0.06 92.46 12:05:01 AM 0 7.88 0.00 5.41 0.00 0.07 86.64 12:05:01 AM 1 1.76 0.00 0.12 0.00 0.05 98.08 12:06:01 AM all 0.28 0.00 0.08 0.00 0.04 99.60 12:06:01 AM 0 0.35 0.00 0.07 0.00 0.03 99.55 12:06:01 AM 1 0.22 0.00 0.08 0.00 0.05 99.65 12:07:01 AM all 1.87 0.00 0.14 0.00 0.05 97.94 12:07:01 AM 0 3.08 0.00 0.22 0.00 0.07 96.63 12:07:01 AM 1 0.68 0.00 0.07 0.00 0.03 99.22 12:08:01 AM all 3.24 0.00 2.34 0.01 0.06 94.35 12:08:01 AM 0 1.36 0.00 0.18 0.00 0.07 98.39 12:08:01 AM 1 5.13 0.00 4.52 0.02 0.05 90.28 12:09:01 AM all 0.35 0.00 0.08 0.00 0.04 99.53 12:09:01 AM 0 0.63 0.00 0.08 0.00 0.05 99.23 12:09:01 AM 1 0.07 0.00 0.07 0.00 0.03 99.83 12:10:01 AM all 3.64 0.00 0.26 0.00 0.06 96.04 12:10:01 AM 0 0.28 0.00 0.15 0.00 0.05 99.51 12:10:01 AM 1 7.11 0.00 0.38 0.00 0.07 92.43 12:11:01 AM all 5.73 0.00 2.45 0.00 0.08 91.74 12:11:01 AM 0 1.87 0.00 0.22 0.00 0.07 97.84 12:11:01 AM 1 9.74 0.00 4.77 0.00 0.09 85.40 12:11:01 AM CPU %user %nice %system %iowait %steal %idle 12:12:01 AM all 4.16 0.00 0.28 0.00 0.07 95.48 12:12:01 AM 0 2.49 0.00 0.20 0.00 0.05 97.26 12:12:01 AM 1 5.84 0.00 0.37 0.00 0.08 93.71 12:13:01 AM all 4.13 0.00 0.31 0.00 0.07 95.50 12:13:01 AM 0 3.16 0.00 0.27 0.00 0.07 96.51 12:13:01 AM 1 5.09 0.00 0.35 0.00 0.07 94.49 12:14:01 AM all 4.18 0.00 0.31 0.00 0.10 95.41 12:14:01 AM 0 4.05 0.00 0.28 0.00 0.12 95.55 12:14:01 AM 1 4.31 0.00 0.33 0.00 0.08 95.27 12:15:01 AM all 4.33 0.00 0.30 0.00 0.08 95.29 12:15:01 AM 0 3.48 0.00 0.27 0.00 0.08 96.17 12:15:01 AM 1 5.18 0.00 0.34 0.00 0.07 94.42 12:16:01 AM all 4.24 0.01 0.33 0.01 0.08 95.32 12:16:01 AM 0 2.51 0.00 0.27 0.02 0.05 97.15 12:16:01 AM 1 5.98 0.02 0.40 0.00 0.12 93.49 12:17:01 AM all 6.40 0.00 0.37 0.13 0.08 93.03 12:17:01 AM 0 4.05 0.00 0.27 0.17 0.07 95.45 12:17:01 AM 1 8.76 0.00 0.47 0.08 0.08 90.60 12:18:01 AM all 0.58 0.00 0.08 0.00 0.04 99.29 12:18:01 AM 0 0.24 0.00 0.10 0.00 0.05 99.61 12:18:01 AM 1 0.93 0.00 0.07 0.00 0.03 98.97 12:19:01 AM all 0.33 0.00 0.07 0.00 0.03 99.57 12:19:01 AM 0 0.13 0.00 0.10 0.00 0.03 99.73 12:19:01 AM 1 0.53 0.00 0.03 0.00 0.03 99.40 12:20:01 AM all 0.49 0.00 0.09 0.00 0.04 99.37 12:20:01 AM 0 0.42 0.00 0.10 0.00 0.03 99.45 12:20:01 AM 1 0.57 0.00 0.08 0.00 0.05 99.30 12:21:01 AM all 0.30 0.00 0.06 0.00 0.04 99.60 12:21:01 AM 0 0.05 0.00 0.03 0.00 0.02 99.90 12:21:01 AM 1 0.55 0.00 0.08 0.00 0.07 99.30 12:22:01 AM all 0.49 0.00 0.07 0.01 0.05 99.38 12:22:01 AM 0 0.40 0.00 0.10 0.00 0.05 99.45 12:22:01 AM 1 0.58 0.00 0.03 0.02 0.05 99.32 12:22:01 AM CPU %user %nice %system %iowait %steal %idle 12:23:01 AM all 0.33 0.00 0.05 0.00 0.03 99.59 12:23:01 AM 0 0.07 0.00 0.05 0.00 0.03 99.85 12:23:01 AM 1 0.58 0.00 0.05 0.00 0.03 99.33 12:24:01 AM all 0.35 0.00 0.07 0.00 0.03 99.55 12:24:01 AM 0 0.55 0.00 0.07 0.00 0.03 99.35 12:24:01 AM 1 0.15 0.00 0.07 0.00 0.03 99.75 12:25:01 AM all 6.80 0.00 4.92 0.00 0.09 88.19 12:25:01 AM 0 12.87 0.00 9.97 0.00 0.09 77.07 12:25:01 AM 1 1.09 0.00 0.18 0.00 0.08 98.65 12:26:01 AM all 6.78 0.00 2.97 0.00 0.08 90.18 12:26:01 AM 0 13.25 0.00 5.93 0.00 0.07 80.75 12:26:01 AM 1 0.67 0.00 0.17 0.00 0.08 99.08 12:27:01 AM all 2.91 0.00 2.76 0.00 0.06 94.28 12:27:01 AM 0 5.36 0.00 5.42 0.00 0.05 89.17 12:27:01 AM 1 0.48 0.00 0.12 0.00 0.07 99.33 12:28:01 AM all 0.33 0.00 0.06 0.00 0.03 99.57 12:28:01 AM 0 0.52 0.00 0.05 0.00 0.03 99.40 12:28:01 AM 1 0.15 0.00 0.07 0.00 0.03 99.75 12:29:01 AM all 3.75 0.00 2.93 0.00 0.07 93.25 12:29:01 AM 0 7.18 0.00 5.78 0.00 0.07 86.97 12:29:01 AM 1 0.40 0.00 0.13 0.00 0.07 99.40 12:30:01 AM all 1.17 0.00 0.14 0.00 0.05 98.64 12:30:01 AM 0 1.53 0.00 0.15 0.00 0.05 98.27 12:30:01 AM 1 0.80 0.00 0.13 0.00 0.05 99.01 12:31:01 AM all 0.38 0.00 0.08 0.00 0.06 99.49 12:31:01 AM 0 0.60 0.00 0.10 0.00 0.07 99.23 12:31:01 AM 1 0.15 0.00 0.05 0.00 0.05 99.75 12:32:01 AM all 5.04 0.00 2.48 0.00 0.05 92.43 12:32:01 AM 0 0.63 0.00 0.12 0.00 0.05 99.20 12:32:01 AM 1 9.64 0.00 4.96 0.00 0.05 85.35 12:33:01 AM all 0.33 0.00 0.08 0.00 0.03 99.55 12:33:01 AM 0 0.58 0.00 0.10 0.00 0.03 99.28 12:33:01 AM 1 0.08 0.00 0.07 0.00 0.03 99.82 12:33:01 AM CPU %user %nice %system %iowait %steal %idle 12:34:01 AM all 0.59 0.00 0.08 0.00 0.04 99.30 12:34:01 AM 0 0.62 0.00 0.05 0.00 0.03 99.30 12:34:01 AM 1 0.55 0.00 0.10 0.00 0.05 99.30 12:35:01 AM all 6.37 0.00 2.60 0.00 0.10 90.93 12:35:01 AM 0 4.13 0.00 2.78 0.00 0.05 93.04 12:35:01 AM 1 8.70 0.00 2.41 0.00 0.14 88.74 12:36:02 AM all 2.39 0.00 2.08 0.00 0.06 95.47 12:36:02 AM 0 0.37 0.00 0.08 0.00 0.05 99.50 12:36:02 AM 1 4.43 0.00 4.10 0.00 0.07 91.40 12:37:01 AM all 0.32 0.00 0.07 0.00 0.03 99.58 12:37:01 AM 0 0.56 0.00 0.07 0.00 0.02 99.36 12:37:01 AM 1 0.08 0.00 0.07 0.00 0.05 99.80 12:38:01 AM all 3.58 0.00 1.88 0.00 0.07 94.47 12:38:01 AM 0 0.28 0.00 0.10 0.00 0.07 99.55 12:38:01 AM 1 7.04 0.00 3.76 0.00 0.07 89.13 12:39:01 AM all 7.08 0.00 2.51 0.00 0.06 90.35 12:39:01 AM 0 1.87 0.00 0.22 0.00 0.07 97.84 12:39:01 AM 1 12.70 0.00 4.99 0.00 0.05 82.25 12:40:01 AM all 4.70 0.00 0.30 0.00 0.08 94.92 12:40:01 AM 0 2.96 0.00 0.23 0.00 0.07 96.74 12:40:01 AM 1 6.44 0.00 0.37 0.00 0.10 93.10 12:41:01 AM all 4.17 0.00 0.33 0.01 0.07 95.43 12:41:01 AM 0 1.84 0.00 0.23 0.02 0.05 97.86 12:41:01 AM 1 6.50 0.00 0.42 0.00 0.08 93.00 12:42:01 AM all 4.17 0.00 0.30 0.01 0.08 95.45 12:42:01 AM 0 2.11 0.00 0.18 0.00 0.08 97.63 12:42:01 AM 1 6.23 0.00 0.42 0.02 0.07 93.26 12:43:01 AM all 4.34 0.00 0.33 0.01 0.06 95.26 12:43:01 AM 0 2.56 0.00 0.25 0.02 0.05 97.12 12:43:01 AM 1 6.12 0.00 0.40 0.00 0.07 93.41 12:44:01 AM all 4.46 0.00 0.33 0.00 0.07 95.15 12:44:01 AM 0 5.14 0.00 0.35 0.00 0.07 94.44 12:44:01 AM 1 3.78 0.00 0.30 0.00 0.07 95.85 12:44:01 AM CPU %user %nice %system %iowait %steal %idle 12:45:01 AM all 4.30 0.00 0.31 0.00 0.08 95.31 12:45:01 AM 0 3.77 0.00 0.28 0.00 0.07 95.88 12:45:01 AM 1 4.84 0.00 0.33 0.00 0.10 94.73 12:46:01 AM all 5.01 0.00 0.28 0.00 0.08 94.63 12:46:01 AM 0 4.56 0.00 0.25 0.00 0.08 95.10 12:46:01 AM 1 5.45 0.00 0.32 0.00 0.07 94.16 12:47:01 AM all 0.39 0.00 0.08 0.00 0.03 99.50 12:47:01 AM 0 0.64 0.00 0.07 0.00 0.03 99.26 12:47:01 AM 1 0.15 0.00 0.08 0.00 0.03 99.73 12:48:01 AM all 0.25 0.00 0.08 0.00 0.03 99.64 12:48:01 AM 0 0.20 0.00 0.05 0.00 0.02 99.73 12:48:01 AM 1 0.30 0.00 0.10 0.00 0.05 99.55 12:49:01 AM all 0.44 0.00 0.08 0.00 0.05 99.43 12:49:01 AM 0 0.17 0.00 0.05 0.00 0.05 99.73 12:49:01 AM 1 0.72 0.00 0.10 0.00 0.05 99.13 12:50:01 AM all 0.24 0.00 0.08 0.00 0.03 99.64 12:50:01 AM 0 0.28 0.00 0.10 0.00 0.05 99.57 12:50:01 AM 1 0.20 0.00 0.07 0.00 0.02 99.72 12:51:01 AM all 0.49 0.00 0.05 0.01 0.06 99.39 12:51:01 AM 0 0.22 0.00 0.03 0.00 0.07 99.68 12:51:01 AM 1 0.77 0.00 0.07 0.02 0.05 99.10 12:52:01 AM all 0.18 0.00 0.09 0.00 0.07 99.66 12:52:01 AM 0 0.20 0.00 0.12 0.00 0.05 99.63 12:52:01 AM 1 0.17 0.00 0.07 0.00 0.08 99.68 12:53:01 AM all 2.84 0.00 1.07 0.00 0.05 96.04 12:53:01 AM 0 1.98 0.00 0.20 0.00 0.05 97.77 12:53:01 AM 1 3.70 0.00 1.94 0.00 0.05 94.31 12:54:01 AM all 6.22 0.00 4.77 0.00 0.10 88.91 12:54:01 AM 0 1.91 0.00 3.06 0.00 0.10 94.93 12:54:01 AM 1 10.87 0.00 6.61 0.00 0.09 82.43 12:55:01 AM all 2.43 0.00 1.63 0.00 0.05 95.89 12:55:01 AM 0 3.96 0.00 3.03 0.00 0.05 92.96 12:55:01 AM 1 0.91 0.00 0.24 0.00 0.05 98.81 12:55:01 AM CPU %user %nice %system %iowait %steal %idle 12:56:01 AM all 0.37 0.00 0.06 0.00 0.05 99.52 12:56:01 AM 0 0.12 0.00 0.08 0.00 0.07 99.73 12:56:01 AM 1 0.62 0.00 0.03 0.00 0.03 99.32 12:57:01 AM all 3.99 0.00 2.67 0.00 0.06 93.28 12:57:01 AM 0 7.48 0.00 5.13 0.00 0.07 87.31 12:57:01 AM 1 0.62 0.00 0.28 0.00 0.05 99.05 12:58:01 AM all 1.21 0.00 0.09 0.00 0.04 98.65 12:58:01 AM 0 1.80 0.00 0.12 0.00 0.03 98.05 12:58:01 AM 1 0.63 0.00 0.07 0.00 0.05 99.25 12:59:01 AM all 0.40 0.00 0.08 0.00 0.03 99.48 12:59:01 AM 0 0.17 0.00 0.10 0.00 0.03 99.70 12:59:01 AM 1 0.63 0.00 0.07 0.00 0.03 99.27 01:00:01 AM all 5.62 0.00 2.46 0.00 0.07 91.86 01:00:01 AM 0 4.79 0.00 0.43 0.00 0.05 94.73 01:00:01 AM 1 6.45 0.00 4.48 0.00 0.09 88.99 01:01:01 AM all 6.33 0.00 4.16 0.00 0.07 89.44 01:01:01 AM 0 5.07 0.00 4.25 0.00 0.07 90.61 01:01:01 AM 1 7.60 0.00 4.07 0.00 0.07 88.26 01:02:01 AM all 6.39 0.00 2.90 0.00 0.07 90.64 01:02:01 AM 0 11.15 0.00 5.67 0.00 0.07 83.11 01:02:01 AM 1 1.86 0.00 0.27 0.00 0.07 97.80 01:03:01 AM all 3.94 0.00 2.43 0.00 0.07 93.57 01:03:01 AM 0 5.40 0.00 4.70 0.00 0.09 89.82 01:03:01 AM 1 2.49 0.00 0.19 0.00 0.05 97.27 01:04:01 AM all 0.35 0.00 0.07 0.00 0.04 99.54 01:04:01 AM 0 0.57 0.00 0.07 0.00 0.03 99.33 01:04:01 AM 1 0.13 0.00 0.07 0.00 0.05 99.75 01:05:01 AM all 2.72 0.00 0.73 0.00 0.05 96.50 01:05:01 AM 0 0.62 0.00 0.15 0.00 0.05 99.18 01:05:01 AM 1 4.88 0.00 1.32 0.00 0.05 93.75 01:06:01 AM all 2.15 0.00 0.91 0.00 0.04 96.89 01:06:01 AM 0 0.60 0.00 0.10 0.00 0.05 99.25 01:06:01 AM 1 3.77 0.00 1.76 0.00 0.03 94.43 01:06:01 AM CPU %user %nice %system %iowait %steal %idle 01:07:01 AM all 0.35 0.00 0.07 0.02 0.04 99.52 01:07:01 AM 0 0.57 0.00 0.07 0.00 0.03 99.33 01:07:01 AM 1 0.13 0.00 0.07 0.03 0.05 99.72 01:08:01 AM all 4.44 0.00 0.99 0.00 0.09 94.47 01:08:01 AM 0 4.13 0.00 1.61 0.00 0.05 94.20 01:08:01 AM 1 4.75 0.00 0.38 0.00 0.14 94.74 01:09:01 AM all 5.37 0.00 1.76 0.00 0.08 92.79 01:09:01 AM 0 6.75 0.00 3.26 0.00 0.07 89.92 01:09:01 AM 1 4.03 0.00 0.30 0.00 0.08 95.59 01:10:01 AM all 4.26 0.00 0.34 0.00 0.08 95.32 01:10:01 AM 0 4.34 0.00 0.35 0.00 0.07 95.24 01:10:01 AM 1 4.18 0.00 0.33 0.00 0.08 95.41 01:11:01 AM all 4.14 0.00 0.33 0.00 0.07 95.46 01:11:01 AM 0 2.36 0.00 0.23 0.00 0.07 97.34 01:11:01 AM 1 5.92 0.00 0.42 0.00 0.07 93.59 01:12:01 AM all 4.37 0.00 0.32 0.00 0.08 95.23 01:12:01 AM 0 3.81 0.00 0.25 0.00 0.07 95.87 01:12:01 AM 1 4.93 0.00 0.38 0.00 0.08 94.60 01:13:01 AM all 4.20 0.00 0.30 0.00 0.07 95.43 01:13:01 AM 0 5.30 0.00 0.35 0.00 0.07 94.28 01:13:01 AM 1 3.11 0.00 0.25 0.00 0.07 96.57 01:14:01 AM all 4.22 0.00 0.28 0.00 0.08 95.41 01:14:01 AM 0 3.24 0.00 0.23 0.00 0.08 96.44 01:14:01 AM 1 5.20 0.00 0.33 0.00 0.08 94.38 01:15:01 AM all 6.18 0.00 0.32 0.00 0.09 93.41 01:15:01 AM 0 3.23 0.00 0.25 0.00 0.10 96.42 01:15:01 AM 1 9.14 0.00 0.39 0.00 0.08 90.39 01:16:01 AM all 0.59 0.00 0.08 0.00 0.09 99.23 01:16:01 AM 0 0.32 0.00 0.08 0.00 0.08 99.52 01:16:01 AM 1 0.87 0.00 0.08 0.00 0.10 98.95 01:17:01 AM all 0.24 0.00 0.08 0.00 0.07 99.62 01:17:01 AM 0 0.23 0.00 0.08 0.00 0.03 99.65 01:17:01 AM 1 0.25 0.00 0.07 0.00 0.10 99.58 01:17:01 AM CPU %user %nice %system %iowait %steal %idle 01:18:01 AM all 0.44 0.00 0.07 0.00 0.06 99.43 01:18:01 AM 0 0.47 0.00 0.05 0.00 0.05 99.43 01:18:01 AM 1 0.42 0.00 0.08 0.00 0.07 99.43 01:19:01 AM all 0.34 0.00 0.08 0.00 0.04 99.54 01:19:01 AM 0 0.57 0.00 0.05 0.00 0.03 99.35 01:19:01 AM 1 0.12 0.00 0.10 0.00 0.05 99.73 01:20:01 AM all 0.47 0.00 0.07 0.00 0.05 99.42 01:20:01 AM 0 0.52 0.00 0.07 0.00 0.05 99.37 01:20:01 AM 1 0.42 0.00 0.07 0.00 0.05 99.47 01:21:01 AM all 0.34 0.00 0.07 0.00 0.03 99.56 01:21:01 AM 0 0.57 0.00 0.07 0.00 0.03 99.33 01:21:01 AM 1 0.12 0.00 0.07 0.00 0.03 99.78 01:22:01 AM all 0.33 0.00 0.07 0.02 0.03 99.56 01:22:01 AM 0 0.58 0.00 0.08 0.00 0.02 99.32 01:22:01 AM 1 0.08 0.00 0.05 0.03 0.03 99.80 01:23:01 AM all 6.85 0.00 4.82 0.00 0.07 88.26 01:23:01 AM 0 12.79 0.00 9.85 0.00 0.07 77.29 01:23:01 AM 1 1.32 0.00 0.15 0.00 0.07 98.46 01:24:01 AM all 6.49 0.00 2.82 0.00 0.08 90.61 01:24:01 AM 0 6.29 0.00 5.17 0.00 0.09 88.45 01:24:01 AM 1 6.69 0.00 0.44 0.00 0.07 92.81 01:25:01 AM all 2.75 0.00 2.53 0.00 0.04 94.68 01:25:01 AM 0 5.26 0.00 4.81 0.00 0.03 89.90 01:25:01 AM 1 0.27 0.00 0.28 0.00 0.05 99.40 01:26:01 AM all 0.26 0.00 0.08 0.00 0.03 99.64 01:26:01 AM 0 0.37 0.00 0.07 0.00 0.02 99.55 01:26:01 AM 1 0.15 0.00 0.08 0.00 0.03 99.73 01:27:01 AM all 4.02 0.00 2.62 0.00 0.07 93.29 01:27:01 AM 0 0.32 0.00 0.12 0.00 0.07 99.50 01:27:01 AM 1 7.83 0.00 5.20 0.00 0.07 86.90 01:28:01 AM all 1.18 0.00 0.10 0.00 0.03 98.68 01:28:01 AM 0 0.38 0.00 0.05 0.00 0.02 99.55 01:28:01 AM 1 1.99 0.00 0.15 0.00 0.05 97.81 01:28:01 AM CPU %user %nice %system %iowait %steal %idle 01:29:01 AM all 0.36 0.00 0.07 0.00 0.03 99.54 01:29:01 AM 0 0.13 0.00 0.07 0.00 0.03 99.77 01:29:01 AM 1 0.58 0.00 0.07 0.00 0.03 99.32 01:30:01 AM all 4.84 0.00 2.46 0.00 0.07 92.63 01:30:01 AM 0 8.22 0.00 4.88 0.00 0.07 86.84 01:30:01 AM 1 1.58 0.00 0.13 0.00 0.07 98.22 01:31:01 AM all 0.39 0.00 0.08 0.00 0.03 99.49 01:31:01 AM 0 0.15 0.00 0.08 0.00 0.03 99.73 01:31:01 AM 1 0.63 0.00 0.08 0.00 0.03 99.25 01:32:01 AM all 0.64 0.16 0.18 0.00 0.04 98.98 01:32:01 AM 0 0.69 0.15 0.18 0.00 0.05 98.93 01:32:01 AM 1 0.60 0.17 0.17 0.00 0.03 99.03 01:33:01 AM all 6.57 0.00 3.48 0.00 0.07 89.88 01:33:01 AM 0 10.84 0.00 5.99 0.00 0.07 83.10 01:33:01 AM 1 2.45 0.00 1.07 0.00 0.07 96.42 01:34:01 AM all 2.45 0.00 2.14 0.00 0.05 95.36 01:34:01 AM 0 0.38 0.00 0.12 0.00 0.05 99.45 01:34:01 AM 1 4.54 0.00 4.18 0.00 0.05 91.23 01:35:01 AM all 0.38 0.00 0.07 0.00 0.04 99.52 01:35:01 AM 0 0.62 0.00 0.05 0.00 0.03 99.30 01:35:01 AM 1 0.13 0.00 0.08 0.00 0.05 99.73 01:36:01 AM all 3.80 0.00 1.88 0.00 0.06 94.26 01:36:01 AM 0 0.68 0.00 0.13 0.00 0.05 99.13 01:36:01 AM 1 7.11 0.00 3.73 0.00 0.07 89.09 01:37:01 AM all 7.57 0.00 2.59 0.00 0.08 89.77 01:37:01 AM 0 6.11 0.00 4.65 0.00 0.07 89.17 01:37:01 AM 1 9.03 0.00 0.51 0.00 0.09 90.37 01:38:01 AM all 4.32 0.00 0.30 0.00 0.08 95.31 01:38:01 AM 0 5.36 0.00 0.37 0.00 0.08 94.19 01:38:01 AM 1 3.28 0.00 0.23 0.00 0.07 96.42 01:39:01 AM all 4.20 0.00 0.32 0.00 0.08 95.40 01:39:01 AM 0 4.85 0.00 0.32 0.00 0.07 94.77 01:39:01 AM 1 3.56 0.00 0.32 0.00 0.08 96.04 01:39:01 AM CPU %user %nice %system %iowait %steal %idle 01:40:01 AM all 4.11 0.00 0.29 0.00 0.08 95.52 01:40:01 AM 0 6.71 0.00 0.40 0.00 0.10 92.78 01:40:01 AM 1 1.51 0.00 0.18 0.00 0.07 98.24 01:41:01 AM all 4.26 0.00 0.32 0.01 0.07 95.34 01:41:01 AM 0 5.77 0.00 0.37 0.00 0.07 93.79 01:41:01 AM 1 2.76 0.00 0.27 0.02 0.07 96.89 01:42:01 AM all 4.26 0.00 0.31 0.01 0.06 95.36 01:42:01 AM 0 3.55 0.00 0.27 0.02 0.05 96.12 01:42:01 AM 1 4.97 0.00 0.35 0.00 0.07 94.61 01:43:01 AM all 4.25 0.00 0.30 0.00 0.06 95.39 01:43:01 AM 0 5.47 0.00 0.33 0.00 0.07 94.13 01:43:01 AM 1 3.04 0.00 0.27 0.00 0.05 96.64 01:44:02 AM all 5.15 0.00 0.28 0.00 0.07 94.50 01:44:02 AM 0 2.86 0.00 0.22 0.00 0.05 96.87 01:44:02 AM 1 7.45 0.00 0.35 0.00 0.08 92.12 01:45:01 AM all 0.47 0.00 0.08 0.00 0.03 99.42 01:45:01 AM 0 0.37 0.00 0.07 0.00 0.03 99.52 01:45:01 AM 1 0.56 0.00 0.08 0.00 0.03 99.32 01:46:01 AM all 0.33 0.00 0.07 0.00 0.04 99.57 01:46:01 AM 0 0.08 0.00 0.07 0.00 0.03 99.82 01:46:01 AM 1 0.57 0.00 0.07 0.00 0.05 99.32 01:47:01 AM all 0.48 0.00 0.06 0.00 0.04 99.42 01:47:01 AM 0 0.40 0.00 0.08 0.00 0.05 99.47 01:47:01 AM 1 0.55 0.00 0.03 0.00 0.03 99.38 01:48:01 AM all 0.29 0.00 0.07 0.00 0.03 99.62 01:48:01 AM 0 0.10 0.00 0.08 0.00 0.03 99.78 01:48:01 AM 1 0.48 0.00 0.05 0.00 0.02 99.45 01:49:01 AM all 0.48 0.00 0.07 0.00 0.04 99.41 01:49:01 AM 0 0.69 0.00 0.07 0.00 0.03 99.21 01:49:01 AM 1 0.28 0.00 0.07 0.00 0.05 99.60 01:50:01 AM all 0.33 0.00 0.05 0.00 0.03 99.58 01:50:01 AM 0 0.12 0.00 0.07 0.00 0.05 99.77 01:50:01 AM 1 0.55 0.00 0.03 0.00 0.02 99.40 01:50:01 AM CPU %user %nice %system %iowait %steal %idle 01:51:01 AM all 2.74 0.00 0.68 0.00 0.05 96.53 01:51:01 AM 0 3.90 0.00 1.25 0.00 0.03 94.81 01:51:01 AM 1 1.60 0.00 0.12 0.00 0.07 98.21 01:52:01 AM all 6.10 0.00 4.72 0.00 0.10 89.08 01:52:01 AM 0 2.22 0.00 4.48 0.00 0.08 93.22 01:52:01 AM 1 10.39 0.00 4.99 0.00 0.11 84.50 01:53:01 AM all 2.22 0.00 1.23 0.00 0.04 96.51 01:53:01 AM 0 0.63 0.00 0.07 0.00 0.03 99.27 01:53:01 AM 1 3.88 0.00 2.44 0.00 0.05 93.63 01:54:01 AM all 0.37 0.00 0.08 0.00 0.04 99.52 01:54:01 AM 0 0.53 0.00 0.03 0.00 0.02 99.42 01:54:01 AM 1 0.20 0.00 0.12 0.00 0.07 99.62 01:55:01 AM all 3.65 0.00 2.39 0.00 0.07 93.88 01:55:01 AM 0 0.63 0.00 0.10 0.00 0.05 99.22 01:55:01 AM 1 6.81 0.00 4.79 0.00 0.09 88.32 01:56:01 AM all 6.52 0.00 2.79 0.00 0.08 90.61 01:56:01 AM 0 4.45 0.00 0.28 0.00 0.07 95.21 01:56:01 AM 1 8.62 0.00 5.33 0.00 0.09 85.96 01:57:01 AM all 6.55 0.00 4.84 0.00 0.07 88.55 01:57:01 AM 0 12.73 0.00 9.70 0.00 0.07 77.50 01:57:01 AM 1 0.65 0.00 0.20 0.00 0.07 99.08 01:58:01 AM all 5.43 0.00 2.50 0.00 0.06 92.01 01:58:01 AM 0 10.57 0.00 4.99 0.00 0.05 84.39 01:58:01 AM 1 0.58 0.00 0.15 0.00 0.07 99.20 01:59:01 AM all 0.36 0.00 0.05 0.00 0.04 99.55 01:59:01 AM 0 0.13 0.00 0.05 0.00 0.03 99.78 01:59:01 AM 1 0.58 0.00 0.05 0.00 0.05 99.32 02:00:01 AM all 1.50 0.00 0.13 0.00 0.05 98.32 02:00:01 AM 0 2.10 0.00 0.17 0.00 0.05 97.68 02:00:01 AM 1 0.90 0.00 0.10 0.00 0.05 98.95 02:01:01 AM all 6.31 0.00 2.58 0.03 0.08 91.01 02:01:01 AM 0 3.60 0.00 0.34 0.05 0.07 95.94 02:01:01 AM 1 9.10 0.00 4.88 0.00 0.09 85.93 02:01:01 AM CPU %user %nice %system %iowait %steal %idle 02:02:01 AM all 3.88 0.00 0.32 0.03 0.06 95.72 02:02:01 AM 0 4.28 0.00 0.37 0.02 0.07 95.27 02:02:01 AM 1 3.48 0.00 0.27 0.03 0.05 96.17 02:03:01 AM all 4.30 0.00 0.30 0.00 0.07 95.33 02:03:01 AM 0 6.28 0.00 0.39 0.00 0.08 93.25 02:03:01 AM 1 2.32 0.00 0.22 0.00 0.05 97.41 02:04:01 AM all 4.30 0.00 0.29 0.00 0.07 95.34 02:04:01 AM 0 4.08 0.00 0.32 0.00 0.07 95.53 02:04:01 AM 1 4.52 0.00 0.27 0.00 0.07 95.15 02:05:01 AM all 4.19 0.00 0.33 0.00 0.07 95.42 02:05:01 AM 0 2.66 0.00 0.28 0.00 0.07 96.99 02:05:01 AM 1 5.72 0.00 0.37 0.00 0.07 93.84 02:06:01 AM all 4.25 0.00 0.30 0.00 0.07 95.38 02:06:01 AM 0 3.46 0.00 0.27 0.00 0.05 96.22 02:06:01 AM 1 5.05 0.00 0.34 0.00 0.08 94.53 02:07:01 AM all 5.97 0.00 0.38 0.00 0.06 93.60 02:07:01 AM 0 6.88 0.00 0.40 0.00 0.05 92.67 02:07:01 AM 1 5.06 0.00 0.35 0.00 0.07 94.52 02:08:01 AM all 2.41 0.00 0.17 0.00 0.05 97.37 02:08:01 AM 0 3.01 0.00 0.15 0.00 0.05 96.79 02:08:01 AM 1 1.82 0.00 0.18 0.00 0.05 97.94 02:09:01 AM all 0.85 0.00 0.11 0.00 0.06 98.98 02:09:01 AM 0 0.75 0.00 0.10 0.00 0.05 99.10 02:09:01 AM 1 0.95 0.00 0.12 0.00 0.07 98.86 02:10:01 AM all 0.93 0.00 0.09 0.00 0.07 98.91 02:10:01 AM 0 1.25 0.00 0.12 0.00 0.08 98.54 02:10:01 AM 1 0.60 0.00 0.07 0.00 0.05 99.28 02:11:01 AM all 0.98 0.00 0.13 0.00 0.05 98.84 02:11:01 AM 0 1.10 0.00 0.17 0.00 0.05 98.68 02:11:01 AM 1 0.85 0.00 0.10 0.00 0.05 99.00 02:12:01 AM all 0.86 0.00 0.12 0.01 0.05 98.96 02:12:01 AM 0 0.94 0.00 0.13 0.02 0.07 98.85 02:12:01 AM 1 0.78 0.00 0.10 0.00 0.03 99.08 02:12:01 AM CPU %user %nice %system %iowait %steal %idle 02:13:01 AM all 0.94 0.00 0.12 0.00 0.06 98.88 02:13:01 AM 0 1.14 0.00 0.13 0.00 0.07 98.66 02:13:01 AM 1 0.75 0.00 0.10 0.00 0.05 99.10 02:14:01 AM all 5.89 0.00 4.67 0.00 0.13 89.31 02:14:01 AM 0 10.34 0.00 9.26 0.00 0.14 80.26 02:14:01 AM 1 1.58 0.00 0.24 0.00 0.12 98.07 02:15:01 AM all 6.47 0.00 2.42 0.00 0.16 90.94 02:15:01 AM 0 4.66 0.00 4.06 0.00 0.14 91.14 02:15:01 AM 1 8.32 0.00 0.76 0.00 0.18 90.74 02:16:01 AM all 6.41 0.00 4.50 0.00 0.09 88.99 02:16:01 AM 0 8.37 0.00 7.89 0.00 0.10 83.64 02:16:01 AM 1 4.42 0.00 1.04 0.00 0.09 94.45 02:17:01 AM all 6.28 0.00 2.67 0.00 0.08 90.97 02:17:01 AM 0 3.76 0.00 0.75 0.00 0.05 95.44 02:17:01 AM 1 8.93 0.00 4.69 0.00 0.11 86.28 02:18:01 AM all 6.63 0.00 4.20 0.00 0.06 89.11 02:18:01 AM 0 2.37 0.00 0.19 0.00 0.05 97.40 02:18:01 AM 1 11.07 0.00 8.38 0.00 0.07 80.48 02:19:01 AM all 6.98 0.00 3.15 0.00 0.10 89.78 02:19:01 AM 0 10.60 0.00 5.21 0.00 0.11 84.09 02:19:01 AM 1 3.51 0.00 1.17 0.00 0.09 95.23 02:20:01 AM all 5.16 0.00 0.36 0.00 0.05 94.43 02:20:01 AM 0 5.26 0.00 0.39 0.00 0.05 94.29 02:20:01 AM 1 5.05 0.00 0.33 0.00 0.05 94.56 02:21:01 AM all 4.27 0.00 0.33 0.00 0.04 95.36 02:21:01 AM 0 3.41 0.00 0.27 0.00 0.03 96.29 02:21:01 AM 1 5.13 0.00 0.38 0.00 0.05 94.43 02:22:01 AM all 4.20 0.00 0.33 0.00 0.05 95.42 02:22:01 AM 0 3.75 0.00 0.30 0.00 0.03 95.91 02:22:01 AM 1 4.65 0.00 0.35 0.00 0.07 94.93 02:23:01 AM all 4.28 0.00 0.32 0.00 0.07 95.34 02:23:01 AM 0 2.96 0.00 0.27 0.00 0.07 96.70 02:23:01 AM 1 5.59 0.00 0.37 0.00 0.07 93.98 02:23:01 AM CPU %user %nice %system %iowait %steal %idle 02:24:01 AM all 4.29 0.00 0.30 0.00 0.06 95.35 02:24:01 AM 0 3.26 0.00 0.22 0.00 0.05 96.47 02:24:01 AM 1 5.32 0.00 0.38 0.00 0.07 94.23 02:25:01 AM all 4.33 0.00 0.31 0.00 0.10 95.26 02:25:01 AM 0 3.16 0.00 0.23 0.00 0.08 96.52 02:25:01 AM 1 5.50 0.00 0.38 0.00 0.12 94.00 02:26:01 AM all 5.61 0.00 0.32 0.00 0.06 94.02 02:26:01 AM 0 4.07 0.00 0.27 0.00 0.05 95.61 02:26:01 AM 1 7.14 0.00 0.37 0.00 0.07 92.43 02:27:01 AM all 0.91 0.00 0.12 0.00 0.08 98.90 02:27:01 AM 0 0.42 0.00 0.12 0.00 0.10 99.36 02:27:01 AM 1 1.40 0.00 0.12 0.00 0.05 98.43 02:28:01 AM all 0.93 0.00 0.12 0.00 0.06 98.90 02:28:01 AM 0 0.52 0.00 0.07 0.00 0.05 99.37 02:28:01 AM 1 1.34 0.00 0.17 0.00 0.07 98.43 02:29:01 AM all 0.93 0.00 0.14 0.00 0.07 98.86 02:29:01 AM 0 0.55 0.00 0.12 0.00 0.05 99.28 02:29:01 AM 1 1.30 0.00 0.17 0.00 0.08 98.44 02:30:01 AM all 0.96 0.00 0.13 0.09 0.04 98.77 02:30:01 AM 0 1.15 0.00 0.17 0.18 0.05 98.45 02:30:01 AM 1 0.77 0.00 0.10 0.00 0.03 99.10 02:31:01 AM all 0.93 0.00 0.14 0.00 0.06 98.87 02:31:01 AM 0 0.59 0.00 0.13 0.00 0.05 99.23 02:31:01 AM 1 1.27 0.00 0.15 0.00 0.07 98.51 02:32:01 AM all 3.65 0.00 1.52 0.00 0.06 94.77 02:32:01 AM 0 0.95 0.00 0.12 0.00 0.05 98.88 02:32:01 AM 1 6.41 0.00 2.96 0.00 0.07 90.56 02:33:01 AM all 6.52 0.00 4.50 0.00 0.08 88.90 02:33:01 AM 0 0.70 0.00 0.45 0.00 0.05 98.80 02:33:01 AM 1 12.84 0.00 8.90 0.00 0.11 78.15 02:34:01 AM all 6.40 0.00 3.84 0.00 0.08 89.68 02:34:01 AM 0 4.93 0.00 2.46 0.00 0.07 92.55 02:34:01 AM 1 7.88 0.00 5.23 0.00 0.09 86.81 02:34:01 AM CPU %user %nice %system %iowait %steal %idle 02:35:01 AM all 0.75 0.00 0.14 0.00 0.04 99.06 02:35:01 AM 0 0.64 0.00 0.13 0.00 0.03 99.20 02:35:01 AM 1 0.87 0.00 0.15 0.00 0.05 98.93 02:36:01 AM all 7.29 0.00 2.74 0.00 0.07 89.90 02:36:01 AM 0 4.49 0.00 0.34 0.00 0.09 95.08 02:36:01 AM 1 10.12 0.00 5.15 0.00 0.05 84.68 02:37:01 AM all 5.95 0.00 2.52 0.00 0.06 91.47 02:37:01 AM 0 8.06 0.00 4.87 0.00 0.07 87.00 02:37:01 AM 1 3.93 0.00 0.28 0.00 0.05 95.74 02:38:01 AM all 4.19 0.00 0.35 0.00 0.08 95.38 02:38:01 AM 0 2.41 0.00 0.27 0.00 0.07 97.25 02:38:01 AM 1 5.97 0.00 0.44 0.00 0.08 93.51 02:39:01 AM all 4.34 0.00 0.34 0.00 0.07 95.25 02:39:01 AM 0 1.89 0.00 0.20 0.00 0.07 97.84 02:39:01 AM 1 6.79 0.00 0.49 0.00 0.07 92.66 02:40:01 AM all 4.03 0.00 0.29 0.00 0.04 95.64 02:40:01 AM 0 2.11 0.00 0.22 0.00 0.03 97.64 02:40:01 AM 1 5.94 0.00 0.37 0.00 0.05 93.64 02:41:01 AM all 4.32 0.00 0.30 0.00 0.06 95.32 02:41:01 AM 0 2.48 0.00 0.22 0.00 0.07 97.24 02:41:01 AM 1 6.16 0.00 0.39 0.00 0.05 93.40 02:42:01 AM all 4.33 0.00 0.33 0.02 0.04 95.28 02:42:01 AM 0 2.27 0.00 0.23 0.03 0.03 97.43 02:42:01 AM 1 6.38 0.00 0.44 0.00 0.05 93.13 02:43:01 AM all 6.83 0.00 0.39 0.00 0.06 92.73 02:43:01 AM 0 3.59 0.00 0.30 0.00 0.07 96.05 02:43:01 AM 1 10.08 0.00 0.47 0.00 0.05 89.40 02:44:01 AM all 0.66 0.00 0.09 0.00 0.06 99.19 02:44:01 AM 0 0.50 0.00 0.13 0.00 0.07 99.30 02:44:01 AM 1 0.82 0.00 0.05 0.00 0.05 99.08 02:45:01 AM all 0.65 0.00 0.12 0.00 0.05 99.18 02:45:01 AM 0 0.65 0.00 0.13 0.00 0.05 99.16 02:45:01 AM 1 0.65 0.00 0.10 0.00 0.05 99.20 02:45:01 AM CPU %user %nice %system %iowait %steal %idle 02:46:01 AM all 0.78 0.00 0.11 0.00 0.06 99.06 02:46:01 AM 0 0.77 0.00 0.12 0.00 0.05 99.06 02:46:01 AM 1 0.79 0.00 0.10 0.00 0.07 99.05 02:47:01 AM all 0.61 0.00 0.11 0.01 0.04 99.23 02:47:01 AM 0 0.45 0.00 0.13 0.02 0.05 99.35 02:47:01 AM 1 0.77 0.00 0.08 0.00 0.03 99.12 02:48:01 AM all 0.63 0.00 0.09 0.00 0.04 99.24 02:48:01 AM 0 0.67 0.00 0.13 0.00 0.05 99.15 02:48:01 AM 1 0.58 0.00 0.05 0.00 0.03 99.33 02:49:01 AM all 2.22 0.00 0.20 0.00 0.04 97.54 02:49:01 AM 0 1.05 0.00 0.20 0.00 0.05 98.70 02:49:01 AM 1 3.40 0.00 0.20 0.00 0.03 96.37 02:50:01 AM all 6.49 0.00 5.72 0.00 0.12 87.67 02:50:01 AM 0 8.91 0.00 9.32 0.00 0.18 81.60 02:50:01 AM 1 4.12 0.00 2.21 0.00 0.07 93.60 02:51:01 AM all 7.22 0.00 2.81 0.00 0.07 89.90 02:51:01 AM 0 12.85 0.00 5.60 0.00 0.09 81.46 02:51:01 AM 1 2.01 0.00 0.22 0.00 0.05 97.72 02:52:01 AM all 4.32 0.00 0.33 0.01 0.06 95.28 02:52:01 AM 0 2.56 0.00 0.23 0.00 0.05 97.16 02:52:01 AM 1 6.09 0.00 0.42 0.02 0.07 93.41 02:53:02 AM all 4.26 0.00 0.31 0.00 0.08 95.36 02:53:02 AM 0 3.33 0.00 0.32 0.00 0.07 96.29 02:53:02 AM 1 5.19 0.00 0.30 0.00 0.08 94.43 02:54:01 AM all 4.28 0.00 0.37 0.00 0.05 95.30 02:54:01 AM 0 3.58 0.00 0.34 0.00 0.05 96.03 02:54:01 AM 1 4.99 0.00 0.39 0.00 0.05 94.57 02:55:01 AM all 4.62 0.00 0.33 0.00 0.06 95.00 02:55:01 AM 0 3.78 0.00 0.32 0.00 0.05 95.85 02:55:01 AM 1 5.45 0.00 0.33 0.00 0.07 94.15 02:56:01 AM all 4.25 0.00 0.34 0.00 0.07 95.34 02:56:01 AM 0 2.54 0.00 0.23 0.00 0.07 97.16 02:56:01 AM 1 5.96 0.00 0.45 0.00 0.07 93.52 02:56:01 AM CPU %user %nice %system %iowait %steal %idle 02:57:01 AM all 4.60 0.00 0.35 0.00 0.06 94.99 02:57:01 AM 0 3.45 0.00 0.30 0.00 0.05 96.20 02:57:01 AM 1 5.76 0.00 0.40 0.00 0.07 93.77 02:58:01 AM all 4.20 0.00 0.23 0.00 0.09 95.47 02:58:01 AM 0 5.05 0.00 0.25 0.00 0.07 94.63 02:58:01 AM 1 3.36 0.00 0.22 0.00 0.12 96.31 02:59:01 AM all 0.63 0.00 0.11 0.00 0.05 99.21 02:59:01 AM 0 0.59 0.00 0.13 0.00 0.05 99.23 02:59:01 AM 1 0.67 0.00 0.08 0.00 0.05 99.20 03:00:01 AM all 0.63 0.00 0.13 0.00 0.03 99.21 03:00:01 AM 0 0.70 0.00 0.10 0.00 0.03 99.16 03:00:01 AM 1 0.57 0.00 0.15 0.00 0.03 99.25 03:01:01 AM all 0.66 0.00 0.12 0.02 0.04 99.16 03:01:01 AM 0 0.74 0.00 0.10 0.00 0.03 99.13 03:01:01 AM 1 0.58 0.00 0.13 0.03 0.05 99.20 03:02:01 AM all 0.65 0.00 0.13 0.00 0.05 99.17 03:02:01 AM 0 0.68 0.00 0.12 0.00 0.05 99.15 03:02:01 AM 1 0.62 0.00 0.13 0.00 0.05 99.20 03:03:01 AM all 0.57 0.00 0.13 0.00 0.04 99.26 03:03:01 AM 0 0.77 0.00 0.12 0.00 0.03 99.08 03:03:01 AM 1 0.37 0.00 0.13 0.00 0.05 99.45 03:04:01 AM all 5.64 0.00 4.32 0.00 0.08 89.96 03:04:01 AM 0 5.63 0.00 8.40 0.00 0.09 85.88 03:04:01 AM 1 5.64 0.00 0.32 0.00 0.07 93.96 03:05:01 AM all 7.42 0.00 2.34 0.00 0.09 90.15 03:05:01 AM 0 13.90 0.00 4.64 0.00 0.15 81.31 03:05:01 AM 1 1.46 0.00 0.23 0.00 0.03 98.27 03:06:01 AM all 5.80 0.00 0.82 0.00 0.08 93.29 03:06:01 AM 0 5.22 0.00 1.24 0.00 0.08 93.45 03:06:01 AM 1 6.38 0.00 0.41 0.00 0.08 93.13 03:07:01 AM all 4.50 0.00 0.37 0.04 0.05 95.04 03:07:01 AM 0 2.81 0.00 0.22 0.08 0.05 96.83 03:07:01 AM 1 6.18 0.00 0.52 0.00 0.05 93.25 03:07:01 AM CPU %user %nice %system %iowait %steal %idle 03:08:01 AM all 4.37 0.00 0.34 0.00 0.07 95.22 03:08:01 AM 0 3.03 0.00 0.27 0.00 0.07 96.64 03:08:01 AM 1 5.71 0.00 0.42 0.00 0.07 93.80 03:09:01 AM all 4.16 0.00 0.36 0.00 0.05 95.43 03:09:01 AM 0 1.41 0.00 0.25 0.00 0.05 98.29 03:09:01 AM 1 6.91 0.00 0.47 0.00 0.05 92.57 03:10:01 AM all 4.44 0.00 0.33 0.00 0.06 95.17 03:10:01 AM 0 2.71 0.00 0.25 0.00 0.05 96.99 03:10:01 AM 1 6.17 0.00 0.40 0.00 0.07 93.36 03:11:01 AM all 4.19 0.00 0.36 0.00 0.05 95.40 03:11:01 AM 0 1.87 0.00 0.23 0.00 0.03 97.86 03:11:01 AM 1 6.51 0.00 0.49 0.00 0.07 92.93 03:12:01 AM all 5.40 0.00 0.31 0.00 0.06 94.23 03:12:01 AM 0 4.18 0.00 0.30 0.00 0.07 95.45 03:12:01 AM 1 6.63 0.00 0.32 0.00 0.05 93.00 03:13:01 AM all 0.63 0.00 0.10 0.00 0.05 99.22 03:13:01 AM 0 0.55 0.00 0.12 0.00 0.05 99.28 03:13:01 AM 1 0.70 0.00 0.08 0.00 0.05 99.17 03:14:01 AM all 0.65 0.00 0.11 0.00 0.05 99.19 03:14:01 AM 0 0.64 0.00 0.12 0.00 0.05 99.20 03:14:01 AM 1 0.67 0.00 0.10 0.00 0.05 99.18 03:15:01 AM all 0.59 0.00 0.10 0.00 0.06 99.25 03:15:01 AM 0 0.79 0.00 0.08 0.00 0.05 99.08 03:15:01 AM 1 0.40 0.00 0.12 0.00 0.07 99.42 03:16:01 AM all 0.60 0.00 0.11 0.00 0.05 99.24 03:16:01 AM 0 0.47 0.00 0.10 0.00 0.05 99.38 03:16:01 AM 1 0.73 0.00 0.12 0.00 0.05 99.10 03:17:01 AM all 0.85 0.00 0.14 0.03 0.09 98.88 03:17:01 AM 0 0.54 0.00 0.15 0.00 0.10 99.21 03:17:01 AM 1 1.17 0.00 0.13 0.07 0.08 98.55 03:18:01 AM all 4.14 0.00 2.81 0.00 0.07 92.98 03:18:01 AM 0 2.84 0.00 3.69 0.00 0.07 93.40 03:18:01 AM 1 5.46 0.00 1.93 0.00 0.07 92.55 03:18:01 AM CPU %user %nice %system %iowait %steal %idle 03:19:01 AM all 8.09 0.00 2.26 0.00 0.14 89.51 03:19:01 AM 0 4.79 0.00 2.22 0.00 0.12 92.87 03:19:01 AM 1 11.55 0.00 2.31 0.00 0.16 85.98 03:20:01 AM all 5.89 0.00 2.63 0.00 0.06 91.43 03:20:01 AM 0 8.92 0.00 5.10 0.00 0.09 85.90 03:20:01 AM 1 2.99 0.00 0.27 0.00 0.03 96.71 03:21:01 AM all 4.26 0.00 0.34 0.02 0.03 95.35 03:21:01 AM 0 4.19 0.00 0.32 0.00 0.03 95.46 03:21:01 AM 1 4.33 0.00 0.37 0.03 0.03 95.24 03:22:01 AM all 4.40 0.18 0.43 0.00 0.05 94.94 03:22:01 AM 0 4.65 0.37 0.52 0.00 0.05 94.41 03:22:01 AM 1 4.15 0.00 0.33 0.00 0.05 95.47 03:23:01 AM all 4.28 0.00 0.33 0.01 0.04 95.34 03:23:01 AM 0 4.17 0.00 0.33 0.00 0.03 95.46 03:23:01 AM 1 4.38 0.00 0.33 0.02 0.05 95.21 03:24:01 AM all 4.52 0.00 0.36 0.00 0.05 95.07 03:24:01 AM 0 4.32 0.00 0.33 0.00 0.05 95.30 03:24:01 AM 1 4.73 0.00 0.38 0.00 0.05 94.83 03:25:01 AM all 4.34 0.00 0.32 0.00 0.04 95.30 03:25:01 AM 0 5.08 0.00 0.30 0.00 0.05 94.56 03:25:01 AM 1 3.59 0.00 0.33 0.00 0.03 96.04 03:26:01 AM all 6.85 0.00 0.35 0.00 0.03 92.77 03:26:01 AM 0 2.69 0.00 0.23 0.00 0.03 97.04 03:26:01 AM 1 11.01 0.00 0.47 0.00 0.03 88.49 03:27:01 AM all 0.63 0.00 0.10 0.00 0.03 99.24 03:27:01 AM 0 0.79 0.00 0.08 0.00 0.02 99.11 03:27:01 AM 1 0.47 0.00 0.12 0.00 0.05 99.36 03:28:01 AM all 0.69 0.00 0.09 0.00 0.04 99.17 03:28:01 AM 0 0.63 0.00 0.05 0.00 0.03 99.28 03:28:01 AM 1 0.75 0.00 0.13 0.00 0.05 99.06 03:29:01 AM all 0.55 0.00 0.13 0.00 0.03 99.29 03:29:01 AM 0 0.47 0.00 0.08 0.00 0.02 99.43 03:29:01 AM 1 0.64 0.00 0.17 0.00 0.05 99.15 03:29:01 AM CPU %user %nice %system %iowait %steal %idle 03:30:01 AM all 0.67 0.00 0.13 0.00 0.03 99.18 03:30:01 AM 0 0.72 0.00 0.10 0.00 0.02 99.17 03:30:01 AM 1 0.62 0.00 0.15 0.00 0.03 99.20 03:31:01 AM all 0.55 0.00 0.12 0.00 0.03 99.30 03:31:01 AM 0 0.64 0.00 0.13 0.00 0.03 99.20 03:31:01 AM 1 0.47 0.00 0.10 0.00 0.03 99.40 03:32:01 AM all 2.06 0.00 0.16 0.00 0.04 97.74 03:32:01 AM 0 0.60 0.00 0.12 0.00 0.03 99.25 03:32:01 AM 1 3.52 0.00 0.20 0.00 0.05 96.22 03:33:01 AM all 6.99 0.00 4.96 0.00 0.07 87.98 03:33:01 AM 0 2.20 0.00 0.25 0.00 0.05 97.50 03:33:01 AM 1 11.99 0.00 9.88 0.00 0.09 78.04 03:34:01 AM all 6.64 0.00 4.92 0.00 0.07 88.37 03:34:01 AM 0 13.03 0.00 10.05 0.00 0.09 76.83 03:34:01 AM 1 0.75 0.00 0.18 0.00 0.05 99.01 03:35:01 AM all 7.22 0.00 5.32 0.00 0.08 87.37 03:35:01 AM 0 4.78 0.00 2.40 0.00 0.09 92.74 03:35:01 AM 1 9.76 0.00 8.36 0.00 0.07 81.81 03:36:01 AM all 6.78 0.00 5.81 0.00 0.05 87.36 03:36:01 AM 0 8.40 0.00 7.30 0.00 0.05 84.25 03:36:01 AM 1 5.20 0.00 4.37 0.00 0.05 90.38 03:37:01 AM all 7.68 0.00 5.07 0.00 0.15 87.10 03:37:01 AM 0 1.62 0.00 0.30 0.00 0.15 97.93 03:37:01 AM 1 14.24 0.00 10.22 0.00 0.15 75.40 03:38:01 AM all 6.65 0.00 5.90 0.00 0.06 87.39 03:38:01 AM 0 0.52 0.00 0.18 0.00 0.03 99.26 03:38:01 AM 1 13.21 0.00 12.03 0.00 0.09 74.67 03:39:01 AM all 6.80 0.00 5.17 0.00 0.08 87.96 03:39:01 AM 0 0.82 0.00 0.20 0.00 0.07 98.91 03:39:01 AM 1 13.31 0.00 10.58 0.00 0.09 76.03 03:40:01 AM all 16.69 0.00 1.99 0.15 0.06 81.10 03:40:01 AM 0 5.50 0.00 1.69 0.05 0.05 92.71 03:40:01 AM 1 28.18 0.00 2.30 0.26 0.07 69.19 03:40:01 AM CPU %user %nice %system %iowait %steal %idle 03:41:01 AM all 22.61 0.00 2.36 1.09 0.08 73.86 03:41:01 AM 0 19.23 0.00 2.07 0.98 0.07 77.65 03:41:01 AM 1 25.99 0.00 2.66 1.19 0.08 70.08 Average: all 3.45 0.00 1.09 0.01 0.06 95.39 Average: 0 2.99 0.00 1.11 0.01 0.06 95.83 Average: 1 3.91 0.00 1.07 0.01 0.06 94.95