Carbon SR2 test report

Test Case Summary

RelEng stability summary.

• tba: Recent failures to be analyzed yet: 0.

• test: Recent failures caused by wrong assumptions in test: 0.

• akka: Recent failures related to pure UnreachableMember: 4.

• tell: Recent failures not clearly caused by UnreachableMember: 4.

• few: Tests passing unless low frequency failure happens: 7 (6 without duplication). (Low frequency means infra issues or UnreachableMemeber, related to Akka where Controller code has not real control.)

• pass: Tests passing consistently: 38 (36 without duplication).

• Total: 53 (50 without duplication).

• Total minus akka: 49 (46 without duplication).

• Total minus akka, passing always or mostly: 45 (42 without duplication).

• Acceptance rate: 45/49=91.83% (42/46=91.30% without duplication).

Table

S017 instead of 2017 means Sandbox run (includes changes not merged to stable/carbon yet).

Last fail is date of last failure not caused by infra (or by a typo in test or by netconf/bgp failing to initialize properly).

“S 17” or “2 17” in Last run means the documented run was superseded by a newer one, but not analyzed yet.

“few” status from SR1 is not inherited (such tests are marked as “pass”). “long ago” means the last real test failue happened somewhere around SR1 release (or before that, or never).

If status is a link, it points to the latest relevant robot failure, or a history to see the stability. In case of failure, Bugs field gives the reason of that failure.

Releng stability results (post SR1, pre SR2)

Test case	Last fail	Last run	Bugs	Status
bgp-1n-300k-a	long ago	2017-09-18		PASS
bgp-1n-300k-t	long ago	2017-09-18		PASS
bgp-3n-300k-ll-t	2017-09-16	2017-09-18	8318	AKKA
bgp-3n-300k-lr-t	2017-09-16	2017-09-18	8318	AKKA
ddb-cls-ms-ll-t	2017-08-24	2017-09-18		PASS
ddb-cls-ms-lr-t	long ago	2017-09-18		PASS
ddb-cls-ps-ll-t	long ago	2017-09-18		PASS
ddb-cls-ps-lr-t	long ago	2017-09-18		PASS
ddb-elm-ms-lr-t	long ago	2017-09-18		PASS
ddb-elm-ms-rr-t	long ago	2017-09-18		PASS
ddb-elm-ms-rl-t	long ago	2017-09-18		PASS
ddb-elm-ps-lr-t	long ago	2017-09-18		PASS
ddb-elm-ps-rr-t	long ago	2017-09-18		PASS
ddb-elm-ps-rl-t	long ago	2017-09-18		PASS
ddb-li-ms-st-t	2017-08-18	2017-09-18		PASS
ddb-li-ms-dt-t	2017-08-21	2017-09-18		PASS
ddb-li-ps-st-t	2017-09-01	2017-09-18		PASS
ddb-li-ps-dt-t	2017-09-18	2017-09-18	8845	TELL
ddb-ci-ms-ll-ct-t	long ago	2017-09-18		PASS
ddb-ci-ms-ll-st-t	long ago	2017-09-18		PASS
ddb-ci-ms-lr-ct-t	long ago	2017-09-18		PASS
ddb-ci-ms-lr-st-t	long ago	2017-09-18		PASS
ddb-ci-ps-ll-it-t	long ago	2017-09-18		PASS
ddb-ci-ps-ll-nt-t	long ago	2017-09-18		PASS
ddb-ci-ps-lr-it-t	long ago	2017-09-18		PASS
ddb-ci-ps-lr-nt-t	long ago	2017-09-18		PASS
ddb-ls-ms-lr-t	long ago	2017-09-18		PASS
ddb-ls-ms-rr-t	long ago	2017-09-18		PASS
ddb-ls-ms-rl-t	long ago	2017-09-18		PASS
ddb-ls-ps-lr-t	2017-09-18	2017-09-18	8733	TELL
ddb-ls-ps-rr-t	2017-09-18	2017-09-18	8733	TELL
ddb-ls-ps-rl-t	2017-09-18	2017-09-18	8733	FEW
drb-rpp-ms-a	long ago	2017-09-18		PASS
drb-rph-ms-a	long ago	2017-09-18		PASS
drb-app-ms-a	long ago	2017-09-18		PASS
drb-aph-ms-a	long ago	2017-09-18		PASS
dnb-1n-60k-a	long ago	2017-09-18		PASS
ss-ms-ms-a	long ago	2017-09-18		PASS
ss-ph-ms-a	2017-09-01	2017-09-18	8420	FEW
ss-cl-ms-a	long ago	2017-09-18		PASS
ss-ms-ms-t	long ago	2017-09-18		PASS
ss-ph-ms-t	2017-09-17	2017-09-18	9177	FEW
ss-cl-ms-t	long ago	2017-09-18		PASS
netconf-ba-ms-a	long ago	2017-09-18		PASS
netconf-ok-ms-a	long ago	2017-09-18		PASS
netconf-rr-ms-a	2017-09-06	2017-09-18	9006	TELL
bgp-3n-300k-t-long	2017-09-16	2017-09-16	8318	AKKA
ddb-elm-mc-t-long	2017-08-06	2017-09-16		FEW
drb-rpp-ms-a-long	long ago	2017-09-16		FEW
drb-rph-ms-a-long	2017-08-12	2017-09-16		PASS
dnb-1n-60k-a-long	long ago	2017-09-16		FEW
ss-ph-ms-a-long	2017-09-16	2017-09-16	8420	AKKA
ss-cl-ms-a-long	2017-08-06	2017-09-16		PASS