Triggered by Gerrit: https://git.opendaylight.org/gerrit/c/integration/test/+/110945
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on prd-centos8-builder-2c-2g-126 (centos8-builder-2c-2g) in workspace /w/workspace/integration-test-tox-verify-master
[ssh-agent] Looking for ssh-agent implementation...
[ssh-agent]   Exec ssh-agent (binary ssh-agent on a remote machine)
$ ssh-agent
SSH_AUTH_SOCK=/tmp/ssh-xcMiDUhvaXtH/agent.5440
SSH_AGENT_PID=5441
[ssh-agent] Started.
Running ssh-add (command line suppressed)
Identity added: /w/workspace/integration-test-tox-verify-master@tmp/private_key_12048563931980831668.key (/w/workspace/integration-test-tox-verify-master@tmp/private_key_12048563931980831668.key)
[ssh-agent] Using credentials jenkins (jenkins-ssh)
The recommended git tool is: NONE
using credential jenkins-ssh
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository git://devvexx.opendaylight.org/mirror/integration/test
 > git init /w/workspace/integration-test-tox-verify-master # timeout=10
Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
 > git --version # timeout=10
 > git --version # 'git version 2.43.0'
using GIT_SSH to set credentials jenkins-ssh
[INFO] Currently running in a labeled security context
[INFO] Currently SELinux is 'enforcing' on the host
 > /usr/bin/chcon --type=ssh_home_t /w/workspace/integration-test-tox-verify-master@tmp/jenkins-gitclient-ssh11234811482141940503.key
Verifying host key using known hosts file
You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
 > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
using GIT_SSH to set credentials jenkins-ssh
[INFO] Currently running in a labeled security context
[INFO] Currently SELinux is 'enforcing' on the host
 > /usr/bin/chcon --type=ssh_home_t /w/workspace/integration-test-tox-verify-master@tmp/jenkins-gitclient-ssh12516671849327665261.key
Verifying host key using known hosts file
You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
 > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test refs/changes/45/110945/4 # timeout=10
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from git://devvexx.opendaylight.org/mirror/integration/test
	at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:999)
	at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1241)
	at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1305)
	at hudson.scm.SCM.checkout(SCM.java:540)
	at hudson.model.AbstractProject.checkout(AbstractProject.java:1248)
	at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:649)
	at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:85)
	at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:521)
	at hudson.model.Run.execute(Run.java:1895)
	at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44)
	at hudson.model.ResourceController.execute(ResourceController.java:101)
	at hudson.model.Executor.run(Executor.java:442)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test refs/changes/45/110945/4" returned status code 128:
stdout: 
stderr: fatal: couldn't find remote ref refs/changes/45/110945/4

	at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:2846)
	at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:2185)
	at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:635)
	at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$GitCommandMasterToSlaveCallable.call(RemoteGitImpl.java:170)
	at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$GitCommandMasterToSlaveCallable.call(RemoteGitImpl.java:161)
	at hudson.remoting.UserRequest.perform(UserRequest.java:211)
	at hudson.remoting.UserRequest.perform(UserRequest.java:54)
	at hudson.remoting.Request$2.run(Request.java:377)
	at hudson.remoting.InterceptingExecutorService.lambda$wrap$0(InterceptingExecutorService.java:78)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	at java.base/java.lang.Thread.run(Thread.java:829)
	Suppressed: hudson.remoting.Channel$CallSiteStackTrace: Remote call to prd-centos8-builder-2c-2g-126
		at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1787)
		at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:356)
		at hudson.remoting.Channel.call(Channel.java:1003)
		at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:153)
		at jdk.internal.reflect.GeneratedMethodAccessor822.invoke(Unknown Source)
		at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
		at java.base/java.lang.reflect.Method.invoke(Method.java:566)
		at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:138)
		at com.sun.proxy.$Proxy293.execute(Unknown Source)
		at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:997)
		at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1241)
		at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1305)
		at hudson.scm.SCM.checkout(SCM.java:540)
		at hudson.model.AbstractProject.checkout(AbstractProject.java:1248)
		at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:649)
		at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:85)
		at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:521)
		at hudson.model.Run.execute(Run.java:1895)
		at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44)
		at hudson.model.ResourceController.execute(ResourceController.java:101)
		at hudson.model.Executor.run(Executor.java:442)
ERROR: Error fetching remote repo 'origin'
$ ssh-agent -k
unset SSH_AUTH_SOCK;
unset SSH_AGENT_PID;
echo Agent pid 5441 killed;
[ssh-agent] Stopped.
[PostBuildScript] - [INFO] Executing post build scripts.
[integration-test-tox-verify-master] $ /bin/bash /tmp/jenkins10578984380327836111.sh
---> sysstat.sh
[integration-test-tox-verify-master] $ /bin/bash /tmp/jenkins15811346121107805702.sh
---> package-listing.sh
++ facter osfamily
++ tr '[:upper:]' '[:lower:]'
+ OS_FAMILY=redhat
+ workspace=/w/workspace/integration-test-tox-verify-master
+ START_PACKAGES=/tmp/packages_start.txt
+ END_PACKAGES=/tmp/packages_end.txt
+ DIFF_PACKAGES=/tmp/packages_diff.txt
+ PACKAGES=/tmp/packages_start.txt
+ '[' /w/workspace/integration-test-tox-verify-master ']'
+ PACKAGES=/tmp/packages_end.txt
+ case "${OS_FAMILY}" in
+ rpm -qa
+ sort
+ '[' -f /tmp/packages_start.txt ']'
+ '[' -f /tmp/packages_end.txt ']'
+ diff /tmp/packages_start.txt /tmp/packages_end.txt
+ '[' /w/workspace/integration-test-tox-verify-master ']'
+ mkdir -p /w/workspace/integration-test-tox-verify-master/archives/
+ cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/integration-test-tox-verify-master/archives/
[integration-test-tox-verify-master] $ /bin/bash /tmp/jenkins10257675968937606403.sh
---> capture-instance-metadata.sh
Setup pyenv:
  system
* 3.8.13 (set by /opt/pyenv/version)
* 3.9.13 (set by /opt/pyenv/version)
* 3.10.13 (set by /opt/pyenv/version)
* 3.11.7 (set by /opt/pyenv/version)
lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-9sZp
lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-9sZp/bin to PATH
INFO: Running in OpenStack, capturing instance metadata
[integration-test-tox-verify-master] $ /bin/bash /tmp/jenkins17667283123138366364.sh
provisioning config files...
Could not find credentials [logs] for integration-test-tox-verify-master #9483
copy managed file [jenkins-log-archives-settings] to file:/w/workspace/integration-test-tox-verify-master@tmp/config6056579882341655555tmp
Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index]
Run condition [Regular expression match] enabling perform for step [Provide Configuration files]
provisioning config files...
copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content 
SERVER_ID=logs

[EnvInject] - Variables injected successfully.
[integration-test-tox-verify-master] $ /bin/bash /tmp/jenkins3482235951928948654.sh
---> create-netrc.sh
WARN: Log server credential not found.
[integration-test-tox-verify-master] $ /bin/bash /tmp/jenkins17834707854028409849.sh
---> python-tools-install.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/integration-test-tox-verify-master/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-9sZp from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-9sZp/bin to PATH
Generating Requirements File
Python 3.11.7
pip 24.0 from /tmp/venv-9sZp/lib/python3.11/site-packages/pip (python 3.11)
appdirs==1.4.4
argcomplete==3.2.3
aspy.yaml==1.3.0
attrs==23.2.0
autopage==0.5.2
beautifulsoup4==4.12.3
boto3==1.34.67
botocore==1.34.67
bs4==0.0.2
cachetools==5.3.3
certifi==2024.2.2
cffi==1.16.0
cfgv==3.4.0
chardet==5.2.0
charset-normalizer==3.3.2
click==8.1.7
cliff==4.6.0
cmd2==2.4.3
cryptography==3.3.2
debtcollector==3.0.0
decorator==5.1.1
defusedxml==0.7.1
Deprecated==1.2.14
distlib==0.3.8
dnspython==2.6.1
docker==4.2.2
dogpile.cache==1.3.2
email_validator==2.1.1
filelock==3.13.1
future==1.0.0
gitdb==4.0.11
GitPython==3.1.42
google-auth==2.29.0
httplib2==0.22.0
identify==2.5.35
idna==3.6
importlib-resources==1.5.0
iso8601==2.1.0
Jinja2==3.1.3
jmespath==1.0.1
jsonpatch==1.33
jsonpointer==2.4
jsonschema==4.21.1
jsonschema-specifications==2023.12.1
keystoneauth1==5.6.0
kubernetes==29.0.0
lftools==0.37.10
lxml==5.1.0
MarkupSafe==2.1.5
msgpack==1.0.8
multi_key_dict==2.0.3
munch==4.0.0
netaddr==1.2.1
netifaces==0.11.0
niet==1.4.2
nodeenv==1.8.0
oauth2client==4.1.3
oauthlib==3.2.2
openstacksdk==3.0.0
os-client-config==2.1.0
os-service-types==1.7.0
osc-lib==3.0.1
oslo.config==9.4.0
oslo.context==5.5.0
oslo.i18n==6.3.0
oslo.log==5.5.0
oslo.serialization==5.4.0
oslo.utils==7.1.0
packaging==24.0
pbr==6.0.0
platformdirs==4.2.0
prettytable==3.10.0
pyasn1==0.5.1
pyasn1-modules==0.3.0
pycparser==2.21
pygerrit2==2.0.15
PyGithub==2.2.0
pyinotify==0.9.6
PyJWT==2.8.0
PyNaCl==1.5.0
pyparsing==2.4.7
pyperclip==1.8.2
pyrsistent==0.20.0
python-cinderclient==9.5.0
python-dateutil==2.9.0.post0
python-heatclient==3.5.0
python-jenkins==1.8.2
python-keystoneclient==5.4.0
python-magnumclient==4.4.0
python-novaclient==18.6.0
python-openstackclient==6.6.0
python-swiftclient==4.5.0
PyYAML==6.0.1
referencing==0.34.0
requests==2.31.0
requests-oauthlib==1.4.0
requestsexceptions==1.4.0
rfc3986==2.0.0
rpds-py==0.18.0
rsa==4.9
ruamel.yaml==0.18.6
ruamel.yaml.clib==0.2.8
s3transfer==0.10.1
simplejson==3.19.2
six==1.16.0
smmap==5.0.1
soupsieve==2.5
stevedore==5.2.0
tabulate==0.9.0
toml==0.10.2
tomlkit==0.12.4
tqdm==4.66.2
typing_extensions==4.10.0
tzdata==2024.1
urllib3==1.26.18
virtualenv==20.25.1
wcwidth==0.2.13
websocket-client==1.7.0
wrapt==1.16.0
xdg==6.0.0
xmltodict==0.13.0
yq==3.2.3
[integration-test-tox-verify-master] $ /bin/bash /tmp/jenkins13094043351210868765.sh
---> sudo-logs.sh
Archiving 'sudo' log..
[integration-test-tox-verify-master] $ /bin/bash /tmp/jenkins14565981921852911966.sh
---> job-cost.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/integration-test-tox-verify-master/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-9sZp from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
lf-activate-venv(): INFO: Adding /tmp/venv-9sZp/bin to PATH
INFO: No Stack...
INFO: Retrieving Pricing Info for: v3-standard-2
INFO: Archiving Costs
[integration-test-tox-verify-master] $ /bin/bash -l /tmp/jenkins7088532717010246508.sh
---> logs-deploy.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/integration-test-tox-verify-master/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-9sZp from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-9sZp/bin to PATH
WARNING: Nexus logging server not set
INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/integration-test-tox-verify-master/9483/
INFO: archiving logs to S3
---> uname -a:
Linux prd-centos8-builder-2c-2g-126.novalocal 4.18.0-544.el8.x86_64 #1 SMP Thu Feb 22 21:29:23 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux


---> lscpu:
Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              2
On-line CPU(s) list: 0,1
Thread(s) per core:  1
Core(s) per socket:  1
Socket(s):           2
NUMA node(s):        1
Vendor ID:           AuthenticAMD
CPU family:          23
Model:               49
Model name:          AMD EPYC-Rome Processor
Stepping:            0
CPU MHz:             2800.000
BogoMIPS:            5600.00
Virtualization:      AMD-V
Hypervisor vendor:   KVM
Virtualization type: full
L1d cache:           32K
L1i cache:           32K
L2 cache:            512K
L3 cache:            16384K
NUMA node0 CPU(s):   0,1
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities


---> nproc:
2


---> df -h:
Filesystem      Size  Used Avail Use% Mounted on
devtmpfs        3.8G     0  3.8G   0% /dev
tmpfs           3.8G     0  3.8G   0% /dev/shm
tmpfs           3.8G   17M  3.8G   1% /run
tmpfs           3.8G     0  3.8G   0% /sys/fs/cgroup
/dev/vda1        40G  8.4G   32G  21% /
tmpfs           770M     0  770M   0% /run/user/1001


---> free -m:
              total        used        free      shared  buff/cache   available
Mem:           7697         616        4868          19        2212        6787
Swap:          1023           0        1023


---> ip addr:
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1458 qdisc mq state UP group default qlen 1000
    link/ether fa:16:3e:85:8d:a2 brd ff:ff:ff:ff:ff:ff
    altname enp0s3
    altname ens3
    inet 10.30.171.62/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0
       valid_lft 86245sec preferred_lft 86245sec
    inet6 fe80::f816:3eff:fe85:8da2/64 scope link 
       valid_lft forever preferred_lft forever
3: docker0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1458 qdisc noqueue state DOWN group default 
    link/ether 02:42:1f:a1:1c:74 brd ff:ff:ff:ff:ff:ff
    inet 10.250.0.254/24 brd 10.250.0.255 scope global docker0
       valid_lft forever preferred_lft forever


---> sar -b -r -n DEV:
Linux 4.18.0-544.el8.x86_64 (centos-stream-8-builder-ae393510-0a03-4d70-9a0d-820400f2e72e.nov) 	03/21/2024 	_x86_64_	(2 CPU)

10:28:52     LINUX RESTART	(2 CPU)

10:30:01 AM       tps      rtps      wtps   bread/s   bwrtn/s
10:31:01 AM     99.73      7.70     92.04   1352.22   8893.09
Average:        99.73      7.70     92.04   1352.22   8893.09

10:30:01 AM kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
10:31:01 AM   5057992   6942440   2824436     35.83      2688   2068200   1019732     11.42    374480   2129720     86900
Average:      5057992   6942440   2824436     35.83      2688   2068200   1019732     11.42    374480   2129720     86900

10:30:01 AM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
10:31:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
10:31:01 AM      eth0     53.20     35.54    738.73     15.37      0.00      0.00      0.00      0.00
10:31:01 AM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
Average:           lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
Average:         eth0     53.20     35.54    738.73     15.37      0.00      0.00      0.00      0.00
Average:      docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00


---> sar -P ALL:
Linux 4.18.0-544.el8.x86_64 (centos-stream-8-builder-ae393510-0a03-4d70-9a0d-820400f2e72e.nov) 	03/21/2024 	_x86_64_	(2 CPU)

10:28:52     LINUX RESTART	(2 CPU)

10:30:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
10:31:01 AM     all     36.10      0.00      5.13      5.30      0.11     53.36
10:31:01 AM       0     44.53      0.00      5.74      6.04      0.12     43.58
10:31:01 AM       1     27.70      0.00      4.53      4.56      0.10     63.12
Average:        all     36.10      0.00      5.13      5.30      0.11     53.36
Average:          0     44.53      0.00      5.74      6.04      0.12     43.58
Average:          1     27.70      0.00      4.53      4.56      0.10     63.12