Test Statistics

Total Statistics
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
All Tests
39236428000:18:31
Statistics by Tag
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
critical
14913019000:09:44
101000:00:21
101000:00:21
local_run
110000:00:00
Statistics by Suite
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
39236428000:19:50
440000:00:07
16160000:00:05
220000:00:28
38380000:01:18
36306000:02:25
440000:00:36
28280000:00:46
36360000:01:12
22157000:02:31
550000:00:13
12120000:00:39
990000:00:19
78780000:02:55
642000:00:46
422000:00:51
29290000:01:20
10100000:00:21
14140000:00:32
1183000:00:17
871000:00:21
20137000:01:48

Test Execution Log

00:19:50.483 SUITE bgpcep-userfeatures.txt
00:00:06.867 SUITE 050 Bmp Basic
00:00:05.197 SUITE Pcepuser
00:00:28.217 SUITE Bgp Functional Md5
00:01:17.842 SUITE Basic
00:02:24.519 SUITE Bgp Ipv6 Basic
00:00:07.200 SETUP Start_Suite  
00:00:00.059 TEARDOWN Stop_Suite  
00:00:00.348 TEST Reconfigure_ODL_To_Accept_Connections
00:00:18.777 TEST Start_Exabgp
00:00:00.080 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing  
00:00:00.000 KEYWORD ${cmd} = BuiltIn . Set Variable   ${EXABGP_CFG} > ${EXABGP_LOG}
00:00:18.696 KEYWORD ExaBgpLib . Start_ExaBgp_And_Verify_Connected   ${cmd} ${CONFIG_SESSION} ${EXABGP_ID}
00:00:18.692 FOR ${idx} IN RANGE ${connection_retries}  
00:00:00.000 KEYWORD BuiltIn . Fail   Unable to connect ExaBgp to ODL
04:08:48.502 FAIL Unable to connect ExaBgp to ODL
00:00:09.305 TEST Verify_Ipv6_Topology_Filled
00:00:00.087 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing  
00:00:09.217 KEYWORD Verify_Rib_Status_Filled  
00:00:09.217 KEYWORD BuiltIn . Wait Until Keyword Succeeds   5x 2s TemplatedRequests.Get_As_Json_Templated ${BGP_VAR_FOLDER}/ipv6_topology_filled session=${CONFIG_SESSION} verify=True
00:00:00.230 KEYWORD TemplatedRequests . Get_As_Json_Templated   ${BGP_VAR_FOLDER}/ipv6_topology_filled session=${CONFIG_SESSION} verify=True
00:00:00.141 KEYWORD ${response_text} = TemplatedRequests . Get_Templated   folder=${folder} mapping=${mapping} accept=${ACCEPT_EMPTY} session=${session} normalize_json=True http_timeout=${http_timeout} log_response=${log_response}
00:00:00.080 IF ${verify}  
00:00:00.080 KEYWORD TemplatedRequests . Verify_Response_As_Json_Templated   response=${response_text} folder=${folder} base_name=data mapping=${mapping} iterations=${iterations} iter_start=${iter_start} iter_j_offset=${iter_j_offset}
00:00:00.079 KEYWORD TemplatedRequests . Verify_Response_Templated   response=${response} folder=${folder} base_name=${base_name} extension=json mapping=${mapping} normalize_json=True endline=${\n} iterations=${iterations} iter_start=${iter_start} iter_j_offset=${iter_j_offset}
00:00:00.063 KEYWORD ${expected_text} = TemplatedRequests . Resolve_Text_From_Template_Folder   folder=${folder} base_name=${base_name} extension=${extension} mapping=${mapping} endline=${endline} iterations=${iterations} iter_start=${iter_start} iter_j_offset=${iter_j_offset}
00:00:00.002 KEYWORD BuiltIn . Run Keyword And Return If   """${expected_text}""" == """${EMPTY}""" BuiltIn.Should_Be_Equal ${EMPTY} ${response}
00:00:00.002 IF ${normalize_json}  
00:00:00.002 KEYWORD TemplatedRequests . Normalize_Jsons_And_Compare   expected_raw=${expected_text} actual_raw=${response}
00:00:00.000 KEYWORD ${expected_normalized} = norm_json . Normalize Json Text   ${expected_raw}
00:00:00.000 KEYWORD ${actual_normalized} = norm_json . Normalize Json Text   ${actual_raw}
00:00:00.000 KEYWORD BuiltIn . Should Be Equal   ${expected_normalized} ${actual_normalized}
04:08:57.807 INFO { "network-topology:topology": [ { "node": [ { "l3-unicast-igp-topology:igp-node-attributes": { "prefix": [ { "prefix": "2a04:6d80::1/128" } ] }, "node-id": "2607:f0d0:1002:11::2" } ], "odl-bgp-topology-config:rib-id": "example-bgp-rib", "server-provided": true, "topology-id": "example-ipv6-topology", "topology-types": { "odl-bgp-topology-types:bgp-ipv6-reachability-topology": {} } } ] } != { "network-topology:topology": [ { "odl-bgp-topology-config:rib-id": "example-bgp-rib", "server-provided": true, "topology-id": "example-ipv6-topology", "topology-types": { "odl-bgp-topology-types:bgp-ipv6-reachability-topology": {} } } ] }
04:08:57.807 FAIL Multiline strings are different: --- first +++ second @@ -1,18 +1,6 @@ { "network-topology:topology": [ { - "node": [ - { - "l3-unicast-igp-topology:igp-node-attributes": { - "prefix": [ - { - "prefix": "2a04:6d80::1/128" - } - ] - }, - "node-id": "2607:f0d0:1002:11::2" - } - ], "odl-bgp-topology-config:rib-id": "example-bgp-rib", "server-provided": true, "topology-id": "example-ipv6-topology",
00:00:00.000 ELSE  
00:00:00.000 RETURN   ${response_text}
04:08:57.808 FAIL Keyword 'TemplatedRequests.Get_As_Json_Templated' failed after retrying 5 times. The last error was: Multiline strings are different: --- first +++ second @@ -1,18 +1,6 @@ { "network-topology:topology": [ { - "node": [ - { - "l3-unicast-igp-topology:igp-node-attributes": { - "prefix": [ - { - "prefix": "2a04:6d80::1/128" - } - ] - }, - "node-id": "2607:f0d0:1002:11::2" - } - ], "odl-bgp-topology-config:rib-id": "example-bgp-rib", "server-provided": true, "topology-id": "example-ipv6-topology",
00:00:00.223 TEST Delete_Bgp_Peer_Configuration
00:00:00.302 TEST Verify_Ipv6_Topology_Empty
00:00:00.308 TEST Reconfigure_ODL_To_Accept_Connections_2
00:00:09.286 TEST Verify_Ipv6_Topology_Filled_2
00:00:00.087 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing  
00:00:09.198 KEYWORD Verify_Rib_Status_Filled  
00:00:00.282 TEST Delete_Bgp_Peer_Configuration_2
00:00:00.300 TEST Verify_Ipv6_Topology_Empty_2
00:00:00.322 TEST Reconfigure_ODL_To_Accept_Connections_3
00:00:09.250 TEST Verify_Ipv6_Topology_Filled_3
00:00:00.236 TEST Delete_Bgp_Peer_Configuration_3
00:00:00.312 TEST Verify_Ipv6_Topology_Empty_3
00:00:00.279 TEST Stop_All_Exabgps
00:00:00.304 TEST Configure_App_Peer
00:00:00.309 TEST Reconfigure_ODL_To_Accept_Connections_4
00:00:03.146 TEST Start_Exabgp_2
00:00:00.319 TEST Inject_Ipv6_Route_1
00:00:00.292 TEST Check_Ipv6_Prefix_In_Bgp_Rib_1
00:00:00.932 TEST Delete_Injected_Ipv6_Routes_1
00:00:00.245 TEST Delete_Bgp_Peer_Configuration_4
00:00:00.337 TEST Verify_Ipv6_Topology_Empty_4
00:00:00.309 TEST Reconfigure_ODL_To_Accept_Connections_5
00:00:00.294 TEST Inject_Ipv6_Route_2
00:00:00.268 TEST Check_Ipv6_Prefix_In_Bgp_Rib_2
00:00:00.693 TEST Delete_Injected_Ipv6_Routes_2
00:00:00.273 TEST Delete_App_Peer
00:00:00.235 TEST Delete_Bgp_Peer_Configuration_5
00:00:00.320 TEST Verify_Ipv6_Topology_Empty_5
00:00:00.261 TEST Stop_All_Exabgps_2
00:00:00.308 TEST Reconfigure_ODL_To_Accept_Connections_6
00:00:18.708 TEST Start_Exabgp_3
00:00:40.940 TEST Stop_All_Exabgps_3
00:00:18.681 TEST Start_Exabgp_4
00:00:00.229 TEST Delete_Bgp_Peer_Configuration_6
00:00:00.230 TEST Stop_All_Exabgps_4
00:00:36.088 SUITE Bgp Llgr Basic
00:00:45.639 SUITE Bgp App Peer Basic
00:01:11.883 SUITE Ibgp Peers Basic
00:02:30.914 SUITE Ebgp Peers Basic
00:00:13.498 SUITE 010 Bgp Flowspec
00:00:38.921 SUITE Ibgp Peer Lsp
00:00:19.317 SUITE 010 Bgp Functional L3Vpn
00:02:55.093 SUITE 030 Bgp Functional Evpn
00:00:46.268 SUITE 040 Bgp Functional Route Ref
00:00:50.859 SUITE 020 Bgp Functional Multipath
00:01:19.623 SUITE 060 Bgp Functional Mvpn
00:00:20.924 SUITE 070 Bgp Functional L3Vpn Mcast
00:00:32.337 SUITE 080 Bgp Functional Rt Constrain
00:00:17.337 SUITE 090 Bgp Functional Rt Constrain Validation
00:00:21.387 SUITE Bgp Policies Default
00:01:47.699 SUITE Tcpmd5User