Test Statistics

Total Statistics
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
All Tests
101000:00:00
Statistics by Tag
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
critical
101000:00:00
Statistics by Suite
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
controller-notifications-longevity.txt
101000:00:04

Test Execution Log

00:00:04.398 SUITE controller-notifications-longevity.txt
Full Name: controller-notifications-longevity.txt
Documentation:

DOMNotificationBroker longevity testing: No-loss rate

Copyright (c) 2017 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

Provides routing of YANG notifications from publishers to subscribers. The purpose of this test is to determine the broker can forward messages without loss. We do this on a single-node setup by incrementally adding publishers and subscribers.
Source: /w/workspace/controller-csit-1node-notifications-longevity-only-titanium/test/csit/suites/controller/dom_notification_broker/noloss_rate_longevity_1node.robot
Start / End / Elapsed: 20241229 22:59:53.792 / 20241229 22:59:58.190 / 00:00:04.398
Status: 1 test total, 0 passed, 1 failed, 0 skipped
00:00:03.649 SETUP SetupUtils . Setup_Utils_For_Setup_And_Teardown   http_timeout=125
Documentation:

Prepare both FailFast and Karaf logging, log that the caller suite has started. This keyword is to be used in suite setup, and without it the other keywords may not work properly.
Start / End / Elapsed: 20241229 22:59:54.301 / 20241229 22:59:57.950 / 00:00:03.649
00:00:00.000 TEARDOWN SSHLibrary . Close All Connections  
Documentation:

Closes all open connections.
Start / End / Elapsed: 20241229 22:59:58.190 / 20241229 22:59:58.190 / 00:00:00.000
00:00:00.240 TEST Notifications_longevity
Full Name: controller-notifications-longevity.txt.Notifications_longevity
Tags: critical
Start / End / Elapsed: 20241229 22:59:57.950 / 20241229 22:59:58.190 / 00:00:00.240
Status: FAIL
Message: ... click for list of related bugs or create a new one if needed (with the "controller_notifications_longevity_txt_notifications_longevity" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_notifications_longevity_txt_notifications_longevity&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.171.97', port=8181): Max retries exceeded with url: /rests/operations/odl-mdsal-lowlevel-control:subscribe-ynl (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f8f60f63150>: Failed to establish a new connection: [Errno 111] Connection refused'))
00:00:00.039 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing  
Documentation:

Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden.
Start / End / Elapsed: 20241229 22:59:57.950 / 20241229 22:59:57.989 / 00:00:00.039
00:00:00.187 KEYWORD DnbCommons . Dom_Notification_Broker_Test_Templ   ${NOTIFICATION_RATE} ${LONGEVITY_TEST_DURATION_IN_SECS}
Documentation:

Test case template. Input parameter ${total_notification_rate} determines, how many publisher/subscriber pais take part in the test case. For every 5000 one pair is created. The test case itself firstly subscribe listeners, then run publishers and at the end unsubscribe listeners and check achieved rates.
Start / End / Elapsed: 20241229 22:59:57.993 / 20241229 22:59:58.180 / 00:00:00.187
00:00:00.000 KEYWORD BuiltIn . Log   Overall requested rate: ${total_notification_rate}, test duration: ${test_duration_in_seconds} seconds.
Documentation:

Logs the given message with the given level.
Start / End / Elapsed: 20241229 22:59:57.994 / 20241229 22:59:57.994 / 00:00:00.000
00:00:00.010 KEYWORD WaitUtils . WU_Setup  
Documentation:

Call dependency setup. Perhaps needed.
Start / End / Elapsed: 20241229 22:59:57.994 / 20241229 22:59:58.004 / 00:00:00.010
00:00:00.002 KEYWORD ${count} = BuiltIn . Set Variable   ${0}
Documentation:

Returns the given values which can then be assigned to a variables.
Start / End / Elapsed: 20241229 22:59:58.004 / 20241229 22:59:58.006 / 00:00:00.002
00:00:00.167 FOR ${suffix} IN RANGE ${DNB_PUBLISHER_SUBSCRIBER_PAIR_RATE} ${total_notification_rate}+1 ${DNB_PUBLISHER_SUBSCRIBER_PAIR_RATE}  
Start / End / Elapsed: 20241229 22:59:58.006 / 20241229 22:59:58.173 / 00:00:00.167
00:00:00.167 ITERATION ${suffix} = 5000  
Start / End / Elapsed: 20241229 22:59:58.006 / 20241229 22:59:58.173 / 00:00:00.167
00:00:00.000 KEYWORD ${count} = BuiltIn . Evaluate   ${count}+1
Documentation:

Evaluates the given expression in Python and returns the result.
Start / End / Elapsed: 20241229 22:59:58.006 / 20241229 22:59:58.006 / 00:00:00.000
00:00:00.163 KEYWORD MdsalLowlevel . Subscribe_Ynl   ${DNB_TESTED_MEMBER_INDEX} ${DNB_PUBLISHER_LISTENER_PREFIX}${count}
Documentation:

Subscribe listener for the notifications with identifier ${gid}.
Start / End / Elapsed: 20241229 22:59:58.010 / 20241229 22:59:58.173 / 00:00:00.163
00:00:00.001 KEYWORD ${session} = ClusterManagement . Resolve_Http_Session_For_Member   member_index=${member_index}
Documentation:

Return RequestsLibrary session alias pointing to node of given index.
Start / End / Elapsed: 20241229 22:59:58.010 / 20241229 22:59:58.011 / 00:00:00.001
00:00:00.000 KEYWORD &{mapping} = BuiltIn . Create Dictionary   ID=${gid}
Documentation:

Creates and returns a dictionary based on the given items.
Start / End / Elapsed: 20241229 22:59:58.011 / 20241229 22:59:58.011 / 00:00:00.000
00:00:00.161 KEYWORD TemplatedRequests . Post_As_Xml_Templated   ${SUBSCRIBE_YNL_DIR} mapping=${mapping} session=${session}
Documentation:

Add arguments sensible for XML data, return Post_Templated response text. Optionally, verification against response.xml (no iteration) is called.
Start / End / Elapsed: 20241229 22:59:58.012 / 20241229 22:59:58.173 / 00:00:00.161
00:00:00.155 KEYWORD ${response_text} = TemplatedRequests . Post_Templated   folder=${folder} base_name=data extension=xml accept=${ACCEPT_XML} content_type=${HEADERS_XML} mapping=${mapping} session=${session} normalize_json=False endline=${\n} iterations=${iterations} iter_start=${iter_start} additional_allowed_status_codes=${additional_allowed_status_codes} explicit_status_codes=${explicit_status_codes} http_timeout=${http_timeout} iter_j_offset=${iter_j_offset}
Documentation:

Resolve URI and data from folder, call Post_To_Uri, return response text.
Start / End / Elapsed: 20241229 22:59:58.017 / 20241229 22:59:58.172 / 00:00:00.155
00:00:00.060 KEYWORD ${uri} = TemplatedRequests . Resolve_Text_From_Template_Folder   folder=${folder} base_name=location extension=uri mapping=${mapping} percent_encode=True
Documentation:

Read a template from folder, strip endline, make changes according to mapping, return the result. If ${iterations} value is present, put text together from "prolog", "item" and "epilog" parts, where additional template variable ${i} goes from 1, by one times. Template variable ${j} is calculated as ${i} incremented by offset 0 ( j = i + iter_j_offset ) used to create non uniform data in order to be able to validate UPDATE operations. POST (as opposed to PUT) needs slightly different data, ${name_prefix} may be used to distinguish. (Actually, it is GET who formats data differently when URI is a top-level container.)
Start / End / Elapsed: 20241229 22:59:58.027 / 20241229 22:59:58.087 / 00:00:00.060
00:00:00.057 KEYWORD ${data} = TemplatedRequests . Resolve_Text_From_Template_Folder   folder=${folder} name_prefix=post_ base_name=${base_name} extension=${extension} mapping=${mapping} endline=${endline} iterations=${iterations} iter_start=${iter_start} iter_j_offset=${iter_j_offset}
Documentation:

Read a template from folder, strip endline, make changes according to mapping, return the result. If ${iterations} value is present, put text together from "prolog", "item" and "epilog" parts, where additional template variable ${i} goes from 1, by one times. Template variable ${j} is calculated as ${i} incremented by offset 0 ( j = i + iter_j_offset ) used to create non uniform data in order to be able to validate UPDATE operations. POST (as opposed to PUT) needs slightly different data, ${name_prefix} may be used to distinguish. (Actually, it is GET who formats data differently when URI is a top-level container.)
Start / End / Elapsed: 20241229 22:59:58.096 / 20241229 22:59:58.153 / 00:00:00.057
00:00:00.004 KEYWORD ${jmes_expression} = TemplatedRequests . Resolve_Jmes_Path   ${folder}
Documentation:

Reads JMES path from file /w/workspace/controller-csit-1node-notifications-longevity-only-titanium/test/csit/libraries/../variables/mdsal/lowlevelrpc/subscribe_ynl/jmespath.expr if the file exists and returns the JMES path. Empty string is returned otherwise.
Start / End / Elapsed: 20241229 22:59:58.154 / 20241229 22:59:58.158 / 00:00:00.004
00:00:00.014 KEYWORD ${response_text} = TemplatedRequests . Post_To_Uri   uri=${uri} data=${data} content_type=${content_type} accept=${accept} session=${session} jmes_path=${jmes_expression} normalize_json=${normalize_json} additional_allowed_status_codes=${additional_allowed_status_codes} explicit_status_codes=${explicit_status_codes} http_timeout=${http_timeout}
Documentation:

POST data to given URI, check status code and return response text. ${content_type} and ${accept} are mandatory Python objects with headers to use. If ${normalize_json}, normalize text before returning.
Start / End / Elapsed: 20241229 22:59:58.158 / 20241229 22:59:58.172 / 00:00:00.014
00:00:00.000 KEYWORD BuiltIn . Log   ${uri}
Documentation:

Logs the given message with the given level.
Start / End / Elapsed: 20241229 22:59:58.159 / 20241229 22:59:58.159 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Log   ${data}
Documentation:

Logs the given message with the given level.
Start / End / Elapsed: 20241229 22:59:58.159 / 20241229 22:59:58.159 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Log   ${content_type}
Documentation:

Logs the given message with the given level.
Start / End / Elapsed: 20241229 22:59:58.159 / 20241229 22:59:58.159 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Log   ${accept}
Documentation:

Logs the given message with the given level.
Start / End / Elapsed: 20241229 22:59:58.159 / 20241229 22:59:58.159 / 00:00:00.000
00:00:00.002 KEYWORD ${headers} = TemplatedRequests . Join_Two_Headers   first=${content_type} second=${accept}
Documentation:

Take two dicts, join them, return result. Second argument values take precedence.
Start / End / Elapsed: 20241229 22:59:58.160 / 20241229 22:59:58.162 / 00:00:00.002
00:00:00.009 IF """${http_timeout}""" == """${EMPTY}"""  
Start / End / Elapsed: 20241229 22:59:58.162 / 20241229 22:59:58.171 / 00:00:00.009
00:00:00.007 KEYWORD ${response} = RequestsLibrary . POST On Session   ${session} ${uri} data=${data} headers=${headers}
Documentation:

Sends a POST request on a previously created HTTP Session.
Start / End / Elapsed: 20241229 22:59:58.164 / 20241229 22:59:58.171 / 00:00:00.007
22:59:58.167 FAIL ConnectionError: HTTPConnectionPool(host='10.30.171.97', port=8181): Max retries exceeded with url: /rests/operations/odl-mdsal-lowlevel-control:subscribe-ynl (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f8f60f63150>: Failed to establish a new connection: [Errno 111] Connection refused'))
00:00:00.000 ELSE  
Start / End / Elapsed: 20241229 22:59:58.171 / 20241229 22:59:58.171 / 00:00:00.000
00:00:00.000 KEYWORD TemplatedRequests . Check_Status_Code   ${response} additional_allowed_status_codes=${additional_allowed_status_codes} explicit_status_codes=${explicit_status_codes}
Documentation:

Log response text, check status_code is one of allowed ones. In cases where this keyword is called in a WUKS it could end up logging tons of data and it may be desired to skip the logging by passing log_response=False, but by default it remains True.
Start / End / Elapsed: 20241229 22:59:58.171 / 20241229 22:59:58.171 / 00:00:00.000
00:00:00.000 IF not ${normalize_json}  
Start / End / Elapsed: 20241229 22:59:58.172 / 20241229 22:59:58.172 / 00:00:00.000
00:00:00.000 KEYWORD ${text_normalized} = norm_json . Normalize Json Text   ${response.text} jmes_path=${jmes_path}
Documentation:

Attempt to return sorted indented JSON string.
Start / End / Elapsed: 20241229 22:59:58.172 / 20241229 22:59:58.172 / 00:00:00.000
00:00:00.000 RETURN   ${text_normalized}
Start / End / Elapsed: 20241229 22:59:58.172 / 20241229 22:59:58.172 / 00:00:00.000
00:00:00.000 RETURN   ${response_text}
Start / End / Elapsed: 20241229 22:59:58.172 / 20241229 22:59:58.172 / 00:00:00.000
00:00:00.000 IF ${verify}  
Start / End / Elapsed: 20241229 22:59:58.172 / 20241229 22:59:58.172 / 00:00:00.000
00:00:00.000 RETURN   ${response_text}
Start / End / Elapsed: 20241229 22:59:58.173 / 20241229 22:59:58.173 / 00:00:00.000
00:00:00.000 KEYWORD ${count} = BuiltIn . Convert To Integer   ${count}
Documentation:

Converts the given item to an integer number.
Start / End / Elapsed: 20241229 22:59:58.173 / 20241229 22:59:58.173 / 00:00:00.000
00:00:00.000 FOR ${index} IN RANGE 1 ${count}+1  
Start / End / Elapsed: 20241229 22:59:58.173 / 20241229 22:59:58.173 / 00:00:00.000
00:00:00.000 KEYWORD ${getter} = ScalarClosures . Closure_From_Keyword_And_Arguments   Get_Notifications_Active_Status ${DNB_TESTED_MEMBER_INDEX} ${count}
Documentation:

Turn keyword with given arguments into a scalar closure.
Start / End / Elapsed: 20241229 22:59:58.174 / 20241229 22:59:58.174 / 00:00:00.000
00:00:00.000 KEYWORD ${validator} = ScalarClosures . Closure_From_Keyword_And_Arguments   Check_Notifications_Active_Status data_holder
Documentation:

Turn keyword with given arguments into a scalar closure.
Start / End / Elapsed: 20241229 22:59:58.174 / 20241229 22:59:58.174 / 00:00:00.000
00:00:00.000 KEYWORD ${validation_timeout_in_seconds} = BuiltIn . Evaluate   ${test_duration_in_seconds}+${DNB_CHECK_TOLERANCE_IN_SECONDS}
Documentation:

Evaluates the given expression in Python and returns the result.
Start / End / Elapsed: 20241229 22:59:58.174 / 20241229 22:59:58.174 / 00:00:00.000
00:00:00.000 KEYWORD WaitUtils . Wait_For_Getter_Failure_Or_Stateless_Validator_Pass   timeout=${validation_timeout_in_seconds}s period=${DNB_CHECK_PERIOD_IN_SECONDS}s getter=${getter} stateless_validator=${validator}
Documentation:

Repeatedly run getter and plug its output to validator. If both pass, return validator message. If getter fails, fail. If validator fails, repeat in WUKS fashion (fail when timeout is exceeded). FIXME: Cover this keyword in WaitUtilTest.robot
Start / End / Elapsed: 20241229 22:59:58.174 / 20241229 22:59:58.174 / 00:00:00.000
00:00:00.000 KEYWORD ${sum_local_number} = BuiltIn . Set Variable   ${0}
Documentation:

Returns the given values which can then be assigned to a variables.
Start / End / Elapsed: 20241229 22:59:58.174 / 20241229 22:59:58.174 / 00:00:00.000
00:00:00.000 KEYWORD ${low_limit_pair_rate} = BuiltIn . Evaluate   0.9*${DNB_PUBLISHER_SUBSCRIBER_PAIR_RATE}
Documentation:

Evaluates the given expression in Python and returns the result.
Start / End / Elapsed: 20241229 22:59:58.175 / 20241229 22:59:58.175 / 00:00:00.000
00:00:00.000 KEYWORD ${high_limit_pair_rate} = BuiltIn . Evaluate   1.1*${DNB_PUBLISHER_SUBSCRIBER_PAIR_RATE}
Documentation:

Evaluates the given expression in Python and returns the result.
Start / End / Elapsed: 20241229 22:59:58.175 / 20241229 22:59:58.175 / 00:00:00.000
00:00:00.005 FOR ${index} IN RANGE 1 ${count}+1  
Start / End / Elapsed: 20241229 22:59:58.175 / 20241229 22:59:58.180 / 00:00:00.005
00:00:00.000 KEYWORD ${final_rate} = BuiltIn . Evaluate   ${sum_local_number}/${test_duration_in_seconds}
Documentation:

Evaluates the given expression in Python and returns the result.
Start / End / Elapsed: 20241229 22:59:58.180 / 20241229 22:59:58.180 / 00:00:00.000
00:00:00.000 KEYWORD ${low_limit_final_rate} = BuiltIn . Evaluate   0.9*${total_notification_rate}
Documentation:

Evaluates the given expression in Python and returns the result.
Start / End / Elapsed: 20241229 22:59:58.180 / 20241229 22:59:58.180 / 00:00:00.000
00:00:00.000 KEYWORD ${high_limit_final_rate} = BuiltIn . Evaluate   1.1*${total_notification_rate}
Documentation:

Evaluates the given expression in Python and returns the result.
Start / End / Elapsed: 20241229 22:59:58.180 / 20241229 22:59:58.180 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Should Be True   ${final_rate} > ${low_limit_final_rate}
Documentation:

Fails if the given condition is not true.
Start / End / Elapsed: 20241229 22:59:58.180 / 20241229 22:59:58.180 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Should Be True   ${final_rate} < ${high_limit_final_rate}
Documentation:

Fails if the given condition is not true.
Start / End / Elapsed: 20241229 22:59:58.180 / 20241229 22:59:58.180 / 00:00:00.000
00:00:00.009 TEARDOWN SetupUtils . Teardown_Test_Show_Bugs_If_Test_Failed  
Documentation:

Test case teardown. Show linked bugs in case of failure.
Start / End / Elapsed: 20241229 22:59:58.181 / 20241229 22:59:58.190 / 00:00:00.009