Test Statistics

Total Statistics
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
All Tests
101000:00:00
Statistics by Tag
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
critical
101000:00:00
Statistics by Suite
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
controller-notifications-longevity.txt
101000:00:04

Test Execution Log

00:00:04.398 SUITE controller-notifications-longevity.txt
Full Name: controller-notifications-longevity.txt
Documentation:

DOMNotificationBroker longevity testing: No-loss rate

Copyright (c) 2017 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

Provides routing of YANG notifications from publishers to subscribers. The purpose of this test is to determine the broker can forward messages without loss. We do this on a single-node setup by incrementally adding publishers and subscribers.
Source: /w/workspace/controller-csit-1node-notifications-longevity-only-titanium/test/csit/suites/controller/dom_notification_broker/noloss_rate_longevity_1node.robot
Start / End / Elapsed: 20241229 22:59:53.792 / 20241229 22:59:58.190 / 00:00:04.398
Status: 1 test total, 0 passed, 1 failed, 0 skipped
00:00:03.649 SETUP SetupUtils . Setup_Utils_For_Setup_And_Teardown   http_timeout=125
Documentation:

Prepare both FailFast and Karaf logging, log that the caller suite has started. This keyword is to be used in suite setup, and without it the other keywords may not work properly.
Start / End / Elapsed: 20241229 22:59:54.301 / 20241229 22:59:57.950 / 00:00:03.649
00:00:00.000 TEARDOWN SSHLibrary . Close All Connections  
Documentation:

Closes all open connections.
Start / End / Elapsed: 20241229 22:59:58.190 / 20241229 22:59:58.190 / 00:00:00.000
00:00:00.240 TEST Notifications_longevity
Full Name: controller-notifications-longevity.txt.Notifications_longevity
Tags: critical
Start / End / Elapsed: 20241229 22:59:57.950 / 20241229 22:59:58.190 / 00:00:00.240
Status: FAIL
Message: ... click for list of related bugs or create a new one if needed (with the "controller_notifications_longevity_txt_notifications_longevity" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_notifications_longevity_txt_notifications_longevity&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.171.97', port=8181): Max retries exceeded with url: /rests/operations/odl-mdsal-lowlevel-control:subscribe-ynl (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f8f60f63150>: Failed to establish a new connection: [Errno 111] Connection refused'))
00:00:00.039 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing  
Documentation:

Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden.
Start / End / Elapsed: 20241229 22:59:57.950 / 20241229 22:59:57.989 / 00:00:00.039
00:00:00.187 KEYWORD DnbCommons . Dom_Notification_Broker_Test_Templ   ${NOTIFICATION_RATE} ${LONGEVITY_TEST_DURATION_IN_SECS}
Documentation:

Test case template. Input parameter ${total_notification_rate} determines, how many publisher/subscriber pais take part in the test case. For every 5000 one pair is created. The test case itself firstly subscribe listeners, then run publishers and at the end unsubscribe listeners and check achieved rates.
Start / End / Elapsed: 20241229 22:59:57.993 / 20241229 22:59:58.180 / 00:00:00.187
00:00:00.000 KEYWORD BuiltIn . Log   Overall requested rate: ${total_notification_rate}, test duration: ${test_duration_in_seconds} seconds.
Documentation:

Logs the given message with the given level.
Start / End / Elapsed: 20241229 22:59:57.994 / 20241229 22:59:57.994 / 00:00:00.000
00:00:00.010 KEYWORD WaitUtils . WU_Setup  
Documentation:

Call dependency setup. Perhaps needed.
Start / End / Elapsed: 20241229 22:59:57.994 / 20241229 22:59:58.004 / 00:00:00.010
00:00:00.002 KEYWORD ${count} = BuiltIn . Set Variable   ${0}
Documentation:

Returns the given values which can then be assigned to a variables.
Start / End / Elapsed: 20241229 22:59:58.004 / 20241229 22:59:58.006 / 00:00:00.002
00:00:00.167 FOR ${suffix} IN RANGE ${DNB_PUBLISHER_SUBSCRIBER_PAIR_RATE} ${total_notification_rate}+1 ${DNB_PUBLISHER_SUBSCRIBER_PAIR_RATE}  
Start / End / Elapsed: 20241229 22:59:58.006 / 20241229 22:59:58.173 / 00:00:00.167
00:00:00.167 ITERATION ${suffix} = 5000  
Start / End / Elapsed: 20241229 22:59:58.006 / 20241229 22:59:58.173 / 00:00:00.167
00:00:00.000 KEYWORD ${count} = BuiltIn . Convert To Integer   ${count}
Documentation:

Converts the given item to an integer number.
Start / End / Elapsed: 20241229 22:59:58.173 / 20241229 22:59:58.173 / 00:00:00.000
00:00:00.000 FOR ${index} IN RANGE 1 ${count}+1  
Start / End / Elapsed: 20241229 22:59:58.173 / 20241229 22:59:58.173 / 00:00:00.000
00:00:00.000 KEYWORD ${getter} = ScalarClosures . Closure_From_Keyword_And_Arguments   Get_Notifications_Active_Status ${DNB_TESTED_MEMBER_INDEX} ${count}
Documentation:

Turn keyword with given arguments into a scalar closure.
Start / End / Elapsed: 20241229 22:59:58.174 / 20241229 22:59:58.174 / 00:00:00.000
00:00:00.000 KEYWORD ${validator} = ScalarClosures . Closure_From_Keyword_And_Arguments   Check_Notifications_Active_Status data_holder
Documentation:

Turn keyword with given arguments into a scalar closure.
Start / End / Elapsed: 20241229 22:59:58.174 / 20241229 22:59:58.174 / 00:00:00.000
00:00:00.000 KEYWORD ${validation_timeout_in_seconds} = BuiltIn . Evaluate   ${test_duration_in_seconds}+${DNB_CHECK_TOLERANCE_IN_SECONDS}
Documentation:

Evaluates the given expression in Python and returns the result.
Start / End / Elapsed: 20241229 22:59:58.174 / 20241229 22:59:58.174 / 00:00:00.000
00:00:00.000 KEYWORD WaitUtils . Wait_For_Getter_Failure_Or_Stateless_Validator_Pass   timeout=${validation_timeout_in_seconds}s period=${DNB_CHECK_PERIOD_IN_SECONDS}s getter=${getter} stateless_validator=${validator}
Documentation:

Repeatedly run getter and plug its output to validator. If both pass, return validator message. If getter fails, fail. If validator fails, repeat in WUKS fashion (fail when timeout is exceeded). FIXME: Cover this keyword in WaitUtilTest.robot
Start / End / Elapsed: 20241229 22:59:58.174 / 20241229 22:59:58.174 / 00:00:00.000
00:00:00.000 KEYWORD ${sum_local_number} = BuiltIn . Set Variable   ${0}
Documentation:

Returns the given values which can then be assigned to a variables.
Start / End / Elapsed: 20241229 22:59:58.174 / 20241229 22:59:58.174 / 00:00:00.000
00:00:00.000 KEYWORD ${low_limit_pair_rate} = BuiltIn . Evaluate   0.9*${DNB_PUBLISHER_SUBSCRIBER_PAIR_RATE}
Documentation:

Evaluates the given expression in Python and returns the result.
Start / End / Elapsed: 20241229 22:59:58.175 / 20241229 22:59:58.175 / 00:00:00.000
00:00:00.000 KEYWORD ${high_limit_pair_rate} = BuiltIn . Evaluate   1.1*${DNB_PUBLISHER_SUBSCRIBER_PAIR_RATE}
Documentation:

Evaluates the given expression in Python and returns the result.
Start / End / Elapsed: 20241229 22:59:58.175 / 20241229 22:59:58.175 / 00:00:00.000
00:00:00.005 FOR ${index} IN RANGE 1 ${count}+1  
Start / End / Elapsed: 20241229 22:59:58.175 / 20241229 22:59:58.180 / 00:00:00.005
00:00:00.000 KEYWORD ${final_rate} = BuiltIn . Evaluate   ${sum_local_number}/${test_duration_in_seconds}
Documentation:

Evaluates the given expression in Python and returns the result.
Start / End / Elapsed: 20241229 22:59:58.180 / 20241229 22:59:58.180 / 00:00:00.000
00:00:00.000 KEYWORD ${low_limit_final_rate} = BuiltIn . Evaluate   0.9*${total_notification_rate}
Documentation:

Evaluates the given expression in Python and returns the result.
Start / End / Elapsed: 20241229 22:59:58.180 / 20241229 22:59:58.180 / 00:00:00.000
00:00:00.000 KEYWORD ${high_limit_final_rate} = BuiltIn . Evaluate   1.1*${total_notification_rate}
Documentation:

Evaluates the given expression in Python and returns the result.
Start / End / Elapsed: 20241229 22:59:58.180 / 20241229 22:59:58.180 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Should Be True   ${final_rate} > ${low_limit_final_rate}
Documentation:

Fails if the given condition is not true.
Start / End / Elapsed: 20241229 22:59:58.180 / 20241229 22:59:58.180 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Should Be True   ${final_rate} < ${high_limit_final_rate}
Documentation:

Fails if the given condition is not true.
Start / End / Elapsed: 20241229 22:59:58.180 / 20241229 22:59:58.180 / 00:00:00.000
00:00:00.009 TEARDOWN SetupUtils . Teardown_Test_Show_Bugs_If_Test_Failed  
Documentation:

Test case teardown. Show linked bugs in case of failure.
Start / End / Elapsed: 20241229 22:59:58.181 / 20241229 22:59:58.190 / 00:00:00.009