Permanent draft, inaccessible: Sandbox test report¶
Test Case Summary¶
RelEng stability summary.
tba: Recent failures to be analyzed yet: 0.
test: Recent failures caused by wrong assumptions in test: 0.
akka: Recent failures related to pure UnreachableMember: 4.
tell: Recent failures not clearly caused by UnreachableMember: 6.
few: Tests passing unless low frequency failure happens: 2 (1 without duplication). (Low frequency means UnreachableMemeber or similar, related to Akka where Controller code has not real control.)
pass: Tests passing consistently: 41 (39 without duplication).
Total: 53 (50 without duplication).
Total minus akka: 49 (46 without duplication).
Total minus akka passing always or mostly: 43 (40 without duplication).
Acceptance rate: 43/49=87.75% (40/46=86.95% without duplication).
Table¶
S017 instead of 2017 means Sandbox run (includes changes not merged to stable/carbon yet).
Last fail is date of last failure not caused by infra (or by a typo in test or by netconf/bgp failing to initialize properly).
“S 17” or “2 17” in Last run means the documented run was superseded by a newer one, but not analyzed yet.
“no sr3” means this test was not run on Sandbox, SR2 result is reported instead. “few” status from SR2 is not inherited (such tests are marked as “pass”). “long ago” means the last real test failue happened somewhere before SR2 release (or never).
TODO: Copy formatting from sr2 page.
Scenario name |
Type |
Last fail |
Last run |
Bugs |
Robot link |
|---|---|---|---|---|---|
bgp-1n-1m-a |
pass |
no sr3 |
no sr3 |
no sr3 |
|
bgp-1n-300k-t |
pass |
no sr3 |
no sr3 |
no sr3 |
|
bgp-3n-300k-ll-t |
akka |
no sr3 |
no sr3 |
no sr3 |
|
bgp-3n-300k-lr-t |
akka |
no sr3 |
no sr3 |
no sr3 |
|
ddb-cls-ms-ll-t |
pass |
long ago |
S017-08-24 |
no fail this week |
|
ddb-cls-ms-lr-t |
pass |
long ago |
S017-08-24 |
no fail this week |
|
ddb-cls-ps-ll-t |
pass |
long ago |
S017-08-24 |
no fail this week |
|
ddb-cls-ps-lr-t |
pass |
long ago |
S017-08-24 |
no fail this week |
|
ddb-elm-ms-lr-t |
pass |
long ago |
S017-08-24 |
no fail this week |
|
ddb-elm-ms-rr-t |
pass |
long ago |
S017-08-24 |
no fail this week |
|
ddb-elm-ms-rl-t |
pass |
long ago |
S017-08-24 |
no fail this week |
|
ddb-elm-ps-lr-t |
pass |
long ago |
S017-08-24 |
no fail this week |
|
ddb-elm-ps-rr-t |
pass |
long ago |
S017-08-24 |
no fail this week |
|
ddb-elm-ps-rl-t |
pass |
long ago |
S017-08-24 |
no fail this week |
|
ddb-li-ms-st-t |
pass |
long ago |
S017-08-24 |
no fail this week |
|
ddb-li-ms-dt-t |
pass |
long ago |
S017-08-24 |
no fail this week |
|
ddb-li-ps-st-t |
pass |
long ago |
S017-08-24 |
no fail this week |
|
ddb-li-ps-dt-t |
tell |
S017-08-24 |
S017-08-24 |
||
ddb-ci-ms-ll-ct-t |
pass |
long ago |
S017-08-24 |
no fail this week |
|
ddb-ci-ms-ll-st-t |
pass |
long ago |
S017-08-24 |
no fail this week |
|
ddb-ci-ms-lr-ct-t |
pass |
long ago |
S017-08-24 |
no fail this week |
|
ddb-ci-ms-lr-st-t |
pass |
long ago |
S017-08-24 |
no fail this week |
|
ddb-ci-ps-ll-ct-t |
pass |
long ago |
S017-08-24 |
no fail this week |
|
ddb-ci-ps-ll-st-t |
pass |
long ago |
S017-08-24 |
no fail this week |
|
ddb-ci-ps-lr-ct-t |
pass |
long ago |
S017-08-24 |
no fail this week |
|
ddb-ci-ps-lr-st-t |
pass |
long ago |
S017-08-24 |
no fail this week |
|
ddb-ls-ms-lr-t |
pass |
long ago |
S017-08-24 |
no fail this week |
|
ddb-ls-ms-rr-t |
pass |
long ago |
S017-08-24 |
no fail this week |
|
ddb-ls-ms-rl-t |
pass |
long ago |
S017-08-24 |
no fail this week |
|
ddb-ls-ps-lr-t |
tell |
S017-08-24 |
S017-08-24 |
||
ddb-ls-ps-rr-t |
tell |
S017-08-24 |
S017-08-24 |
||
ddb-ls-ps-rl-t |
pass |
long ago |
S017-08-24 |
no fail this week |
|
drb-rpp-ms-a |
pass |
long ago |
S017-08-24 |
no fail this week |
|
drb-rph-ms-a |
pass |
long ago |
S017-08-24 |
no fail this week |
|
drb-app-ms-a |
pass |
long ago |
S017-08-24 |
no fail this week |
|
drb-aph-ms-a |
pass |
long ago |
S017-08-24 |
no fail this week |
|
dnb-1n-60k-a |
pass |
no sr3 |
no sr3 |
no sr3 |
|
ss-ms-ms-a |
pass |
long ago |
S017-08-24 |
no fail this week |
|
ss-ph-ms-a |
few |
S017-08-24 |
S017-08-24 |
||
ss-cl-ms-a |
pass |
long ago |
S017-08-24 |
no fail this week |
|
ss-ms-ms-t |
pass |
long ago |
S017-08-24 |
no fail this week |
|
ss-ph-ms-t |
few |
S017-08-24 |
S017-08-24 |
||
ss-cl-ms-t |
pass |
long ago |
S017-08-24 |
no fail this week |
|
netconf-ba-ms-a |
pass |
no sr3 |
no sr3 |
no fail this week |
|
netconf-ok-ms-a |
tell |
no sr3 |
no sr3 |
no fail this week |
|
netconf-rr-ms-a |
tell |
no sr3 |
no sr3 |
no fail this week |
|
bgp-3n-300k-t-long |
akka |
no sr3 |
no sr3 |
no sr3 |
|
ddb-elm-mc-t-long |
pass |
no sr3 |
no sr3 |
no sr3 |
|
drb-rpp-ms-a-long |
pass |
no sr3 |
no sr3 |
no sr3 |
|
drb-rph-ms-a-long |
pass |
no sr3 |
no sr3 |
no sr3 |
|
dnb-1n-60k-a-long |
pass |
no sr3 |
no sr3 |
no sr3 |
|
ss-ph-ms-a-long |
akka |
no sr3 |
no sr3 |
no sr3 |
|
ss-cl-ms-a-long |
tell |
S017-08-23 |
S017-08-23 |
For descriptions of test cases, see description page. Note that the link contains current description, the details might have been implemented differently at SR1 release.