Test Statistics

Total Statistics
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
All Tests
15510000:07:19
Statistics by Tag
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
critical
624000:02:10
Statistics by Suite
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
controller-rest-clust-cars-perf-ask.txt
15510000:07:42
controller-rest-clust-cars-perf-ask . txt . 010 Crud Mdsal Perf
936000:05:23
controller-rest-clust-cars-perf-ask . txt . Puts During Isolation
624000:02:19

Test Execution Log

00:07:41.756 SUITE controller-rest-clust-cars-perf-ask.txt
Full Name: controller-rest-clust-cars-perf-ask.txt
Start / End / Elapsed: 20250308 23:48:26.215 / 20250308 23:56:07.971 / 00:07:41.756
Status: 15 tests total, 5 passed, 10 failed, 0 skipped
00:05:22.556 SUITE 010 Crud Mdsal Perf
Full Name: controller-rest-clust-cars-perf-ask.txt.010 Crud Mdsal Perf
Documentation:

Test for measuring execution time of MD-SAL DataStore operations in cluster.

Copyright (c) 2015 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

This test suite requires odl-restconf and odl-clustering-test-app modules. The script cluster_rest_script.py is used for generating requests for operations on people, car and car-people DataStore test models. (see the https://wiki.opendaylight.org/view/MD-SAL_Clustering_Test_Plan)

Reported bugs: https://bugs.opendaylight.org/show_bug.cgi?id=4220
Source: /w/workspace/controller-csit-3node-rest-clust-cars-perf-ask-only-calcium/test/csit/suites/controller/ThreeNodes_Datastore/010_crud_mdsal_perf.robot
Start / End / Elapsed: 20250308 23:48:26.238 / 20250308 23:53:48.794 / 00:05:22.556
Status: 9 tests total, 3 passed, 6 failed, 0 skipped
00:00:12.311 SETUP Start Suite  
Documentation:

Suite setup keyword
Start / End / Elapsed: 20250308 23:48:26.694 / 20250308 23:48:39.005 / 00:00:12.311
00:00:00.002 TEARDOWN Stop Suite  
Documentation:

Suite teardown keyword
Start / End / Elapsed: 20250308 23:53:48.793 / 20250308 23:53:48.795 / 00:00:00.002
00:00:00.573 TEST Add Cars
Full Name: controller-rest-clust-cars-perf-ask.txt.010 Crud Mdsal Perf.Add Cars
Documentation:

Request to add 10000 cars (timeout in 5m).
Start / End / Elapsed: 20250308 23:48:39.005 / 20250308 23:48:39.578 / 00:00:00.573
Status: PASS
00:00:02.491 TEST Verify Cars
Full Name: controller-rest-clust-cars-perf-ask.txt.010 Crud Mdsal Perf.Verify Cars
Documentation:

Store logs and verify result
Start / End / Elapsed: 20250308 23:48:39.578 / 20250308 23:48:42.069 / 00:00:02.491
Status: FAIL
Message: HTTPError: 409 Client Error: Conflict for url: http://10.30.170.31:8181/rests/data/car:cars?content=config
00:00:00.410 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing  
Documentation:

Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden.
Start / End / Elapsed: 20250308 23:48:39.579 / 20250308 23:48:39.989 / 00:00:00.410
00:00:02.004 KEYWORD Stop_Tool  
Documentation:

Stop the tool if still running.
Start / End / Elapsed: 20250308 23:48:39.989 / 20250308 23:48:41.993 / 00:00:02.004
00:00:00.016 KEYWORD Store_File_To_Workspace   cluster_rest_script.log cluster_rest_script_add_cars.log
Documentation:

Store the ${source_file_name} to the workspace as ${target_file_name}.
Start / End / Elapsed: 20250308 23:48:42.005 / 20250308 23:48:42.021 / 00:00:00.016
00:00:00.047 KEYWORD ${rsp} = RequestsLibrary . GET On Session   session url=${carurl_config} headers=${ACCEPT_XML}
Documentation:

Sends a GET request on a previously created HTTP Session.
Start / End / Elapsed: 20250308 23:48:42.021 / 20250308 23:48:42.068 / 00:00:00.047
23:48:42.063 INFO GET Request : url=http://10.30.170.31:8181/rests/data/car:cars?content=config path_url=/rests/data/car:cars?content=config headers={'User-Agent': 'python-requests/2.32.3', 'Accept-Encoding': 'gzip, deflate', 'Accept': 'application/xml', 'Connection': 'keep-alive', 'Authorization': 'Basic YWRtaW46YWRtaW4='} body=None
23:48:42.065 INFO GET Response : url=http://10.30.170.31:8181/rests/data/car:cars?content=config status=409, reason=Conflict headers={'Set-Cookie': 'JSESSIONID=node013ec90l79dphq1e6ajrchb3je91.node0; Path=/rests; HttpOnly, rememberMe=deleteMe; Path=/rests; Max-Age=0; Expires=Fri, 07-Mar-2025 23:48:42 GMT; SameSite=lax', 'Expires': 'Thu, 01 Jan 1970 00:00:00 GMT', 'Content-Type': 'application/yang-data+xml', 'Content-Length': '312'} body=<?xml version="1.0" ?> <errors xmlns="urn:ietf:params:xml:ns:yang:ietf-restconf"> <error> <error-type>protocol</error-type> <error-message>Request could not be completed because the relevant data model content does not exist</error-message> <error-tag>data-missing</error-tag> </error> </errors>
23:48:42.066 FAIL HTTPError: 409 Client Error: Conflict for url: http://10.30.170.31:8181/rests/data/car:cars?content=config
00:00:00.000 KEYWORD ${count} = XML . Get Element Count   ${rsp.content} xpath=car-entry
Documentation:

Returns and logs how many elements the given xpath matches.
Start / End / Elapsed: 20250308 23:48:42.068 / 20250308 23:48:42.068 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Should Be Equal As Numbers   ${count} ${ITEM_COUNT}
Documentation:

Fails if objects are unequal after converting them to real numbers.
Start / End / Elapsed: 20250308 23:48:42.069 / 20250308 23:48:42.069 / 00:00:00.000
00:00:00.492 TEST Add People
Full Name: controller-rest-clust-cars-perf-ask.txt.010 Crud Mdsal Perf.Add People
Documentation:

Request to add 10000 people (timeout in 5m).
Start / End / Elapsed: 20250308 23:48:42.069 / 20250308 23:48:42.561 / 00:00:00.492
Status: PASS
00:00:02.360 TEST Verify People
Full Name: controller-rest-clust-cars-perf-ask.txt.010 Crud Mdsal Perf.Verify People
Documentation:

Store logs and verify result
Start / End / Elapsed: 20250308 23:48:42.562 / 20250308 23:48:44.922 / 00:00:02.360
Status: FAIL
Message: HTTPError: 409 Client Error: Conflict for url: http://10.30.170.31:8181/rests/data/people:people?content=config
00:00:00.299 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing  
Documentation:

Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden.
Start / End / Elapsed: 20250308 23:48:42.562 / 20250308 23:48:42.861 / 00:00:00.299
00:00:02.005 KEYWORD Stop_Tool  
Documentation:

Stop the tool if still running.
Start / End / Elapsed: 20250308 23:48:42.861 / 20250308 23:48:44.866 / 00:00:02.005
00:00:00.016 KEYWORD Store_File_To_Workspace   cluster_rest_script.log cluster_rest_script_add_people.log
Documentation:

Store the ${source_file_name} to the workspace as ${target_file_name}.
Start / End / Elapsed: 20250308 23:48:44.877 / 20250308 23:48:44.893 / 00:00:00.016
00:00:00.027 KEYWORD ${rsp} = RequestsLibrary . GET On Session   session url=${peopleurl_config} headers=${ACCEPT_XML}
Documentation:

Sends a GET request on a previously created HTTP Session.
Start / End / Elapsed: 20250308 23:48:44.894 / 20250308 23:48:44.921 / 00:00:00.027
23:48:44.919 INFO GET Request : url=http://10.30.170.31:8181/rests/data/people:people?content=config path_url=/rests/data/people:people?content=config headers={'User-Agent': 'python-requests/2.32.3', 'Accept-Encoding': 'gzip, deflate', 'Accept': 'application/xml', 'Connection': 'keep-alive', 'Cookie': 'JSESSIONID=node013ec90l79dphq1e6ajrchb3je91.node0', 'Authorization': 'Basic YWRtaW46YWRtaW4='} body=None
23:48:44.919 INFO GET Response : url=http://10.30.170.31:8181/rests/data/people:people?content=config status=409, reason=Conflict headers={'Content-Type': 'application/yang-data+xml', 'Content-Length': '312'} body=<?xml version="1.0" ?> <errors xmlns="urn:ietf:params:xml:ns:yang:ietf-restconf"> <error> <error-type>protocol</error-type> <error-message>Request could not be completed because the relevant data model content does not exist</error-message> <error-tag>data-missing</error-tag> </error> </errors>
23:48:44.920 FAIL HTTPError: 409 Client Error: Conflict for url: http://10.30.170.31:8181/rests/data/people:people?content=config
00:00:00.000 KEYWORD ${count} = XML . Get Element Count   ${rsp.content} xpath=person
Documentation:

Returns and logs how many elements the given xpath matches.
Start / End / Elapsed: 20250308 23:48:44.921 / 20250308 23:48:44.921 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Should Be Equal As Numbers   ${count} ${ITEM_COUNT}
Documentation:

Fails if objects are unequal after converting them to real numbers.
Start / End / Elapsed: 20250308 23:48:44.921 / 20250308 23:48:44.921 / 00:00:00.000
00:00:00.385 TEST Purchase Cars
Full Name: controller-rest-clust-cars-perf-ask.txt.010 Crud Mdsal Perf.Purchase Cars
Documentation:

Request to purchase 10000 cars (timeout in 5m).
Start / End / Elapsed: 20250308 23:48:44.922 / 20250308 23:48:45.307 / 00:00:00.385
Status: PASS
00:05:02.525 TEST Verify Purchases
Full Name: controller-rest-clust-cars-perf-ask.txt.010 Crud Mdsal Perf.Verify Purchases
Documentation:

Store logs and verify result
Start / End / Elapsed: 20250308 23:48:45.308 / 20250308 23:53:47.833 / 00:05:02.525
Status: FAIL
Message: Keyword 'Purchase Is Completed' failed after retrying for 5 minutes. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.170.31:8181/rests/data/car-people:car-people?content=config
00:00:00.287 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing  
Documentation:

Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden.
Start / End / Elapsed: 20250308 23:48:45.308 / 20250308 23:48:45.595 / 00:00:00.287
00:00:02.005 KEYWORD Stop_Tool  
Documentation:

Stop the tool if still running.
Start / End / Elapsed: 20250308 23:48:45.596 / 20250308 23:48:47.601 / 00:00:02.005
00:00:00.012 KEYWORD ${target_file} = Utils . Get Log File Name   cluster_rest_script.log
Documentation:

Get the name of the suite sanitized to be usable as a part of filename. These names are used to constructs names of the log files produced by the testing tools so two suites using a tool wont overwrite the log files if they happen to run in one job.
Start / End / Elapsed: 20250308 23:48:47.601 / 20250308 23:48:47.613 / 00:00:00.012
00:00:00.017 KEYWORD Store_File_To_Workspace   cluster_rest_script.log ${target_file}
Documentation:

Store the ${source_file_name} to the workspace as ${target_file_name}.
Start / End / Elapsed: 20250308 23:48:47.620 / 20250308 23:48:47.637 / 00:00:00.017
00:05:00.195 KEYWORD BuiltIn . Wait Until Keyword Succeeds   ${PROCEDURE_TIMEOUT} 1 Purchase Is Completed ${ITEM_COUNT}
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20250308 23:48:47.637 / 20250308 23:53:47.832 / 00:05:00.195
Message: 296 failing items removed using the --remove-keywords option.
00:00:00.011 KEYWORD Purchase Is Completed   ${ITEM_COUNT}
Documentation:

Check purchase of 10000 is completed.
Start / End / Elapsed: 20250308 23:53:47.821 / 20250308 23:53:47.832 / 00:00:00.011
00:00:00.010 KEYWORD ${rsp} = RequestsLibrary . GET On Session   session url=${carpeopleurl_config} headers=${ACCEPT_XML}
Documentation:

Sends a GET request on a previously created HTTP Session.
Start / End / Elapsed: 20250308 23:53:47.822 / 20250308 23:53:47.832 / 00:00:00.010
23:53:47.830 INFO GET Request : url=http://10.30.170.31:8181/rests/data/car-people:car-people?content=config path_url=/rests/data/car-people:car-people?content=config headers={'User-Agent': 'python-requests/2.32.3', 'Accept-Encoding': 'gzip, deflate', 'Accept': 'application/xml', 'Connection': 'keep-alive', 'Cookie': 'JSESSIONID=node013ec90l79dphq1e6ajrchb3je91.node0', 'Authorization': 'Basic YWRtaW46YWRtaW4='} body=None
23:53:47.831 INFO GET Response : url=http://10.30.170.31:8181/rests/data/car-people:car-people?content=config status=409, reason=Conflict headers={'Content-Type': 'application/yang-data+xml', 'Content-Length': '312'} body=<?xml version="1.0" ?> <errors xmlns="urn:ietf:params:xml:ns:yang:ietf-restconf"> <error> <error-type>protocol</error-type> <error-message>Request could not be completed because the relevant data model content does not exist</error-message> <error-tag>data-missing</error-tag> </error> </errors>
23:53:47.831 FAIL HTTPError: 409 Client Error: Conflict for url: http://10.30.170.31:8181/rests/data/car-people:car-people?content=config
00:00:00.000 KEYWORD ${count} = XML . Get Element Count   ${rsp.content} xpath=car-person
Documentation:

Returns and logs how many elements the given xpath matches.
Start / End / Elapsed: 20250308 23:53:47.832 / 20250308 23:53:47.832 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Should Be Equal As Numbers   ${count} ${item_count}
Documentation:

Fails if objects are unequal after converting them to real numbers.
Start / End / Elapsed: 20250308 23:53:47.832 / 20250308 23:53:47.832 / 00:00:00.000
23:53:47.832 FAIL Keyword 'Purchase Is Completed' failed after retrying for 5 minutes. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.170.31:8181/rests/data/car-people:car-people?content=config
00:00:00.338 TEST Delete Cars
Full Name: controller-rest-clust-cars-perf-ask.txt.010 Crud Mdsal Perf.Delete Cars
Documentation:

Remove cars from the datastore
Start / End / Elapsed: 20250308 23:53:47.833 / 20250308 23:53:48.171 / 00:00:00.338
Status: FAIL
Message: Url: http://10.30.170.31:8181/rests/data/car:cars Expected status: 409 != 200
00:00:00.320 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing  
Documentation:

Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden.
Start / End / Elapsed: 20250308 23:53:47.834 / 20250308 23:53:48.154 / 00:00:00.320
00:00:00.016 KEYWORD ${rsp} = RequestsLibrary . DELETE On Session   session url=${carurl} expected_status=200
Documentation:

Sends a DELETE request on a previously created HTTP Session.
Start / End / Elapsed: 20250308 23:53:48.154 / 20250308 23:53:48.170 / 00:00:00.016
23:53:48.167 INFO DELETE Request : url=http://10.30.170.31:8181/rests/data/car:cars path_url=/rests/data/car:cars headers={'User-Agent': 'python-requests/2.32.3', 'Accept-Encoding': 'gzip, deflate', 'Accept': '*/*', 'Connection': 'keep-alive', 'Cookie': 'JSESSIONID=node013ec90l79dphq1e6ajrchb3je91.node0', 'Content-Length': '0', 'Authorization': 'Basic YWRtaW46YWRtaW4='} body=None
23:53:48.169 INFO DELETE Response : url=http://10.30.170.31:8181/rests/data/car:cars status=409, reason=Conflict headers={'Content-Type': 'application/yang-data+json', 'Content-Length': '211'} body={ "errors": { "error": [ { "error-tag": "data-missing", "error-message": "Data does not exist", "error-path": "/car:cars", "error-type": "protocol" } ] } }
23:53:48.169 FAIL Url: http://10.30.170.31:8181/rests/data/car:cars Expected status: 409 != 200
00:00:00.000 KEYWORD ${rsp} = RequestsLibrary . GET On Session   session url=${carurl_config} expected_status=anything
Documentation:

Sends a GET request on a previously created HTTP Session.
Start / End / Elapsed: 20250308 23:53:48.170 / 20250308 23:53:48.170 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Should Contain   ${DELETED_STATUS_CODES} ${rsp.status_code}
Documentation:

Fails if container does not contain item one or more times.
Start / End / Elapsed: 20250308 23:53:48.171 / 20250308 23:53:48.171 / 00:00:00.000
00:00:00.303 TEST Delete People
Full Name: controller-rest-clust-cars-perf-ask.txt.010 Crud Mdsal Perf.Delete People
Documentation:

Remove people from the datastore
Start / End / Elapsed: 20250308 23:53:48.172 / 20250308 23:53:48.475 / 00:00:00.303
Status: FAIL
Message: Url: http://10.30.170.31:8181/rests/data/people:people Expected status: 409 != 200
00:00:00.294 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing  
Documentation:

Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden.
Start / End / Elapsed: 20250308 23:53:48.173 / 20250308 23:53:48.467 / 00:00:00.294
00:00:00.007 KEYWORD ${rsp} = RequestsLibrary . DELETE On Session   session url=${peopleurl} expected_status=200
Documentation:

Sends a DELETE request on a previously created HTTP Session.
Start / End / Elapsed: 20250308 23:53:48.467 / 20250308 23:53:48.474 / 00:00:00.007
23:53:48.473 INFO DELETE Request : url=http://10.30.170.31:8181/rests/data/people:people path_url=/rests/data/people:people headers={'User-Agent': 'python-requests/2.32.3', 'Accept-Encoding': 'gzip, deflate', 'Accept': '*/*', 'Connection': 'keep-alive', 'Cookie': 'JSESSIONID=node013ec90l79dphq1e6ajrchb3je91.node0', 'Content-Length': '0', 'Authorization': 'Basic YWRtaW46YWRtaW4='} body=None
23:53:48.474 INFO DELETE Response : url=http://10.30.170.31:8181/rests/data/people:people status=409, reason=Conflict headers={'Content-Type': 'application/yang-data+json', 'Content-Length': '216'} body={ "errors": { "error": [ { "error-tag": "data-missing", "error-message": "Data does not exist", "error-path": "/people:people", "error-type": "protocol" } ] } }
23:53:48.474 FAIL Url: http://10.30.170.31:8181/rests/data/people:people Expected status: 409 != 200
00:00:00.000 KEYWORD ${rsp} = RequestsLibrary . GET On Session   session url=${peopleurl_config} expected_status=anything
Documentation:

Sends a GET request on a previously created HTTP Session.
Start / End / Elapsed: 20250308 23:53:48.474 / 20250308 23:53:48.474 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Should Contain   ${DELETED_STATUS_CODES} ${rsp.status_code}
Documentation:

Fails if container does not contain item one or more times.
Start / End / Elapsed: 20250308 23:53:48.474 / 20250308 23:53:48.474 / 00:00:00.000
00:00:00.317 TEST Delete CarPeople
Full Name: controller-rest-clust-cars-perf-ask.txt.010 Crud Mdsal Perf.Delete CarPeople
Documentation:

Remove car-people entries from the datastore
Start / End / Elapsed: 20250308 23:53:48.475 / 20250308 23:53:48.792 / 00:00:00.317
Status: FAIL
Message: Url: http://10.30.170.31:8181/rests/data/car-people:car-people Expected status: 409 != 200
00:02:19.174 SUITE Puts During Isolation
Full Name: controller-rest-clust-cars-perf-ask.txt.Puts During Isolation
Documentation:

Test when a car shard leader is isolated while configuring cars.

Copyright (c) 2017 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

This test suite requires odl-restconf and odl-clustering-test-app modules. The script cluster_rest_script.py is used for generating requests for PUTing car items while the car shard leader is isolated.
Source: /w/workspace/controller-csit-3node-rest-clust-cars-perf-ask-only-calcium/test/csit/suites/controller/ThreeNodes_Datastore/puts_during_isolation.robot
Start / End / Elapsed: 20250308 23:53:48.795 / 20250308 23:56:07.969 / 00:02:19.174
Status: 6 tests total, 2 passed, 4 failed, 0 skipped