Test Statistics

Total Statistics
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
All Tests
15510000:07:29
Statistics by Tag
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
critical
624000:02:19
Statistics by Suite
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
controller-rest-clust-cars-perf-ask.txt
15510000:07:52
controller-rest-clust-cars-perf-ask . txt . 010 Crud Mdsal Perf
936000:05:23
controller-rest-clust-cars-perf-ask . txt . Puts During Isolation
624000:02:29

Test Execution Log

00:07:52.133 SUITE controller-rest-clust-cars-perf-ask.txt
Full Name: controller-rest-clust-cars-perf-ask.txt
Start / End / Elapsed: 20250323 23:09:00.944 / 20250323 23:16:53.077 / 00:07:52.133
Status: 15 tests total, 5 passed, 10 failed, 0 skipped
00:05:23.283 SUITE 010 Crud Mdsal Perf
Full Name: controller-rest-clust-cars-perf-ask.txt.010 Crud Mdsal Perf
Documentation:

Test for measuring execution time of MD-SAL DataStore operations in cluster.

Copyright (c) 2015 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

This test suite requires odl-restconf and odl-clustering-test-app modules. The script cluster_rest_script.py is used for generating requests for operations on people, car and car-people DataStore test models. (see the https://wiki.opendaylight.org/view/MD-SAL_Clustering_Test_Plan)

Reported bugs: https://bugs.opendaylight.org/show_bug.cgi?id=4220
Source: /w/workspace/controller-csit-3node-rest-clust-cars-perf-ask-only-titanium/test/csit/suites/controller/ThreeNodes_Datastore/010_crud_mdsal_perf.robot
Start / End / Elapsed: 20250323 23:09:00.969 / 20250323 23:14:24.252 / 00:05:23.283
Status: 9 tests total, 3 passed, 6 failed, 0 skipped
00:00:12.544 SETUP Start Suite  
Documentation:

Suite setup keyword
Start / End / Elapsed: 20250323 23:09:01.503 / 20250323 23:09:14.047 / 00:00:12.544
00:00:00.002 TEARDOWN Stop Suite  
Documentation:

Suite teardown keyword
Start / End / Elapsed: 20250323 23:14:24.250 / 20250323 23:14:24.252 / 00:00:00.002
00:00:00.439 TEST Add Cars
Full Name: controller-rest-clust-cars-perf-ask.txt.010 Crud Mdsal Perf.Add Cars
Documentation:

Request to add 10000 cars (timeout in 5m).
Start / End / Elapsed: 20250323 23:09:14.047 / 20250323 23:09:14.486 / 00:00:00.439
Status: PASS
00:00:02.411 TEST Verify Cars
Full Name: controller-rest-clust-cars-perf-ask.txt.010 Crud Mdsal Perf.Verify Cars
Documentation:

Store logs and verify result
Start / End / Elapsed: 20250323 23:09:14.486 / 20250323 23:09:16.897 / 00:00:02.411
Status: FAIL
Message: HTTPError: 409 Client Error: Conflict for url: http://10.30.170.145:8181/rests/data/car:cars?content=config
00:00:00.344 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing  
Documentation:

Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden.
Start / End / Elapsed: 20250323 23:09:14.487 / 20250323 23:09:14.831 / 00:00:00.344
00:00:02.004 KEYWORD Stop_Tool  
Documentation:

Stop the tool if still running.
Start / End / Elapsed: 20250323 23:09:14.831 / 20250323 23:09:16.835 / 00:00:02.004
00:00:00.017 KEYWORD Store_File_To_Workspace   cluster_rest_script.log cluster_rest_script_add_cars.log
Documentation:

Store the ${source_file_name} to the workspace as ${target_file_name}.
Start / End / Elapsed: 20250323 23:09:16.848 / 20250323 23:09:16.865 / 00:00:00.017
00:00:00.032 KEYWORD ${rsp} = RequestsLibrary . GET On Session   session url=${carurl_config} headers=${ACCEPT_XML}
Documentation:

Sends a GET request on a previously created HTTP Session.
Start / End / Elapsed: 20250323 23:09:16.865 / 20250323 23:09:16.897 / 00:00:00.032
23:09:16.892 INFO GET Request : url=http://10.30.170.145:8181/rests/data/car:cars?content=config path_url=/rests/data/car:cars?content=config headers={'User-Agent': 'python-requests/2.32.3', 'Accept-Encoding': 'gzip, deflate', 'Accept': 'application/xml', 'Connection': 'keep-alive', 'Authorization': 'Basic YWRtaW46YWRtaW4='} body=None
23:09:16.894 INFO GET Response : url=http://10.30.170.145:8181/rests/data/car:cars?content=config status=409, reason=Conflict headers={'Set-Cookie': 'JSESSIONID=node0kd5annrnlsib5cqke879ew6q1.node0; Path=/rests; HttpOnly, rememberMe=deleteMe; Path=/rests; Max-Age=0; Expires=Sat, 22-Mar-2025 23:09:16 GMT; SameSite=lax', 'Expires': 'Thu, 01 Jan 1970 00:00:00 GMT', 'Content-Type': 'application/xml', 'Content-Length': '288'} body=<?xml version="1.0" ?><errors xmlns="urn:ietf:params:xml:ns:yang:ietf-restconf"><error><error-type>protocol</error-type><error-message>Request could not be completed because the relevant data model content does not exist</error-message><error-tag>data-missing</error-tag></error></errors>
23:09:16.894 FAIL HTTPError: 409 Client Error: Conflict for url: http://10.30.170.145:8181/rests/data/car:cars?content=config
00:00:00.000 KEYWORD ${count} = XML . Get Element Count   ${rsp.content} xpath=car-entry
Documentation:

Returns and logs how many elements the given xpath matches.
Start / End / Elapsed: 20250323 23:09:16.897 / 20250323 23:09:16.897 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Should Be Equal As Numbers   ${count} ${ITEM_COUNT}
Documentation:

Fails if objects are unequal after converting them to real numbers.
Start / End / Elapsed: 20250323 23:09:16.897 / 20250323 23:09:16.897 / 00:00:00.000
00:00:00.434 TEST Add People
Full Name: controller-rest-clust-cars-perf-ask.txt.010 Crud Mdsal Perf.Add People
Documentation:

Request to add 10000 people (timeout in 5m).
Start / End / Elapsed: 20250323 23:09:16.898 / 20250323 23:09:17.332 / 00:00:00.434
Status: PASS
00:00:02.352 TEST Verify People
Full Name: controller-rest-clust-cars-perf-ask.txt.010 Crud Mdsal Perf.Verify People
Documentation:

Store logs and verify result
Start / End / Elapsed: 20250323 23:09:17.332 / 20250323 23:09:19.684 / 00:00:02.352
Status: FAIL
Message: HTTPError: 409 Client Error: Conflict for url: http://10.30.170.145:8181/rests/data/people:people?content=config
00:00:00.292 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing  
Documentation:

Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden.
Start / End / Elapsed: 20250323 23:09:17.332 / 20250323 23:09:17.624 / 00:00:00.292
00:00:02.005 KEYWORD Stop_Tool  
Documentation:

Stop the tool if still running.
Start / End / Elapsed: 20250323 23:09:17.625 / 20250323 23:09:19.630 / 00:00:02.005
00:00:00.017 KEYWORD Store_File_To_Workspace   cluster_rest_script.log cluster_rest_script_add_people.log
Documentation:

Store the ${source_file_name} to the workspace as ${target_file_name}.
Start / End / Elapsed: 20250323 23:09:19.642 / 20250323 23:09:19.659 / 00:00:00.017
00:00:00.023 KEYWORD ${rsp} = RequestsLibrary . GET On Session   session url=${peopleurl_config} headers=${ACCEPT_XML}
Documentation:

Sends a GET request on a previously created HTTP Session.
Start / End / Elapsed: 20250323 23:09:19.660 / 20250323 23:09:19.683 / 00:00:00.023
23:09:19.682 INFO GET Request : url=http://10.30.170.145:8181/rests/data/people:people?content=config path_url=/rests/data/people:people?content=config headers={'User-Agent': 'python-requests/2.32.3', 'Accept-Encoding': 'gzip, deflate', 'Accept': 'application/xml', 'Connection': 'keep-alive', 'Cookie': 'JSESSIONID=node0kd5annrnlsib5cqke879ew6q1.node0', 'Authorization': 'Basic YWRtaW46YWRtaW4='} body=None
23:09:19.682 INFO GET Response : url=http://10.30.170.145:8181/rests/data/people:people?content=config status=409, reason=Conflict headers={'Content-Type': 'application/xml', 'Content-Length': '288'} body=<?xml version="1.0" ?><errors xmlns="urn:ietf:params:xml:ns:yang:ietf-restconf"><error><error-type>protocol</error-type><error-message>Request could not be completed because the relevant data model content does not exist</error-message><error-tag>data-missing</error-tag></error></errors>
23:09:19.682 FAIL HTTPError: 409 Client Error: Conflict for url: http://10.30.170.145:8181/rests/data/people:people?content=config
00:00:00.000 KEYWORD ${count} = XML . Get Element Count   ${rsp.content} xpath=person
Documentation:

Returns and logs how many elements the given xpath matches.
Start / End / Elapsed: 20250323 23:09:19.684 / 20250323 23:09:19.684 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Should Be Equal As Numbers   ${count} ${ITEM_COUNT}
Documentation:

Fails if objects are unequal after converting them to real numbers.
Start / End / Elapsed: 20250323 23:09:19.684 / 20250323 23:09:19.684 / 00:00:00.000
00:00:00.386 TEST Purchase Cars
Full Name: controller-rest-clust-cars-perf-ask.txt.010 Crud Mdsal Perf.Purchase Cars
Documentation:

Request to purchase 10000 cars (timeout in 5m).
Start / End / Elapsed: 20250323 23:09:19.685 / 20250323 23:09:20.071 / 00:00:00.386
Status: PASS
00:05:03.220 TEST Verify Purchases
Full Name: controller-rest-clust-cars-perf-ask.txt.010 Crud Mdsal Perf.Verify Purchases
Documentation:

Store logs and verify result
Start / End / Elapsed: 20250323 23:09:20.072 / 20250323 23:14:23.292 / 00:05:03.220
Status: FAIL
Message: Keyword 'Purchase Is Completed' failed after retrying for 5 minutes. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.170.145:8181/rests/data/car-people:car-people?content=config
00:00:00.307 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing  
Documentation:

Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden.
Start / End / Elapsed: 20250323 23:09:20.072 / 20250323 23:09:20.379 / 00:00:00.307
00:00:02.006 KEYWORD Stop_Tool  
Documentation:

Stop the tool if still running.
Start / End / Elapsed: 20250323 23:09:20.379 / 20250323 23:09:22.385 / 00:00:02.006
00:00:00.013 KEYWORD ${target_file} = Utils . Get Log File Name   cluster_rest_script.log
Documentation:

Get the name of the suite sanitized to be usable as a part of filename. These names are used to constructs names of the log files produced by the testing tools so two suites using a tool wont overwrite the log files if they happen to run in one job.
Start / End / Elapsed: 20250323 23:09:22.386 / 20250323 23:09:22.399 / 00:00:00.013
00:00:00.016 KEYWORD Store_File_To_Workspace   cluster_rest_script.log ${target_file}
Documentation:

Store the ${source_file_name} to the workspace as ${target_file_name}.
Start / End / Elapsed: 20250323 23:09:22.409 / 20250323 23:09:22.425 / 00:00:00.016
00:05:00.867 KEYWORD BuiltIn . Wait Until Keyword Succeeds   ${PROCEDURE_TIMEOUT} 1 Purchase Is Completed ${ITEM_COUNT}
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20250323 23:09:22.425 / 20250323 23:14:23.292 / 00:05:00.867
Message: 296 failing items removed using the --remove-keywords option.
00:00:00.011 KEYWORD Purchase Is Completed   ${ITEM_COUNT}
Documentation:

Check purchase of 10000 is completed.
Start / End / Elapsed: 20250323 23:14:23.281 / 20250323 23:14:23.292 / 00:00:00.011
00:00:00.009 KEYWORD ${rsp} = RequestsLibrary . GET On Session   session url=${carpeopleurl_config} headers=${ACCEPT_XML}
Documentation:

Sends a GET request on a previously created HTTP Session.
Start / End / Elapsed: 20250323 23:14:23.282 / 20250323 23:14:23.291 / 00:00:00.009
23:14:23.290 INFO GET Request : url=http://10.30.170.145:8181/rests/data/car-people:car-people?content=config path_url=/rests/data/car-people:car-people?content=config headers={'User-Agent': 'python-requests/2.32.3', 'Accept-Encoding': 'gzip, deflate', 'Accept': 'application/xml', 'Connection': 'keep-alive', 'Cookie': 'JSESSIONID=node0kd5annrnlsib5cqke879ew6q1.node0', 'Authorization': 'Basic YWRtaW46YWRtaW4='} body=None
23:14:23.290 INFO GET Response : url=http://10.30.170.145:8181/rests/data/car-people:car-people?content=config status=409, reason=Conflict headers={'Content-Type': 'application/xml', 'Content-Length': '288'} body=<?xml version="1.0" ?><errors xmlns="urn:ietf:params:xml:ns:yang:ietf-restconf"><error><error-type>protocol</error-type><error-message>Request could not be completed because the relevant data model content does not exist</error-message><error-tag>data-missing</error-tag></error></errors>
23:14:23.290 FAIL HTTPError: 409 Client Error: Conflict for url: http://10.30.170.145:8181/rests/data/car-people:car-people?content=config
00:00:00.000 KEYWORD ${count} = XML . Get Element Count   ${rsp.content} xpath=car-person
Documentation:

Returns and logs how many elements the given xpath matches.
Start / End / Elapsed: 20250323 23:14:23.291 / 20250323 23:14:23.291 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Should Be Equal As Numbers   ${count} ${item_count}
Documentation:

Fails if objects are unequal after converting them to real numbers.
Start / End / Elapsed: 20250323 23:14:23.291 / 20250323 23:14:23.291 / 00:00:00.000
23:14:23.292 FAIL Keyword 'Purchase Is Completed' failed after retrying for 5 minutes. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.170.145:8181/rests/data/car-people:car-people?content=config
00:00:00.380 TEST Delete Cars
Full Name: controller-rest-clust-cars-perf-ask.txt.010 Crud Mdsal Perf.Delete Cars
Documentation:

Remove cars from the datastore
Start / End / Elapsed: 20250323 23:14:23.292 / 20250323 23:14:23.672 / 00:00:00.380
Status: FAIL
Message: Url: http://10.30.170.145:8181/rests/data/car:cars Expected status: 409 != 200
00:00:00.358 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing  
Documentation:

Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden.
Start / End / Elapsed: 20250323 23:14:23.293 / 20250323 23:14:23.651 / 00:00:00.358
00:00:00.020 KEYWORD ${rsp} = RequestsLibrary . DELETE On Session   session url=${carurl} expected_status=200
Documentation:

Sends a DELETE request on a previously created HTTP Session.
Start / End / Elapsed: 20250323 23:14:23.652 / 20250323 23:14:23.672 / 00:00:00.020
23:14:23.667 INFO DELETE Request : url=http://10.30.170.145:8181/rests/data/car:cars path_url=/rests/data/car:cars headers={'User-Agent': 'python-requests/2.32.3', 'Accept-Encoding': 'gzip, deflate', 'Accept': '*/*', 'Connection': 'keep-alive', 'Cookie': 'JSESSIONID=node0kd5annrnlsib5cqke879ew6q1.node0', 'Content-Length': '0', 'Authorization': 'Basic YWRtaW46YWRtaW4='} body=None
23:14:23.670 INFO DELETE Response : url=http://10.30.170.145:8181/rests/data/car:cars status=409, reason=Conflict headers={'Content-Type': 'application/yang-data+xml', 'Content-Length': '340'} body=<?xml version="1.0" ?><errors xmlns="urn:ietf:params:xml:ns:yang:ietf-restconf"><error><error-type>protocol</error-type><error-path xmlns:a="urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car">/a:cars</error-path><error-message>Data does not exist</error-message><error-tag>data-missing</error-tag></error></errors>
23:14:23.670 FAIL Url: http://10.30.170.145:8181/rests/data/car:cars Expected status: 409 != 200
00:00:00.000 KEYWORD ${rsp} = RequestsLibrary . GET On Session   session url=${carurl_config} expected_status=anything
Documentation:

Sends a GET request on a previously created HTTP Session.
Start / End / Elapsed: 20250323 23:14:23.672 / 20250323 23:14:23.672 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Should Contain   ${DELETED_STATUS_CODES} ${rsp.status_code}
Documentation:

Fails if container does not contain item one or more times.
Start / End / Elapsed: 20250323 23:14:23.672 / 20250323 23:14:23.672 / 00:00:00.000
00:00:00.287 TEST Delete People
Full Name: controller-rest-clust-cars-perf-ask.txt.010 Crud Mdsal Perf.Delete People
Documentation:

Remove people from the datastore
Start / End / Elapsed: 20250323 23:14:23.673 / 20250323 23:14:23.960 / 00:00:00.287
Status: FAIL
Message: Url: http://10.30.170.145:8181/rests/data/people:people Expected status: 409 != 200
00:00:00.273 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing  
Documentation:

Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden.
Start / End / Elapsed: 20250323 23:14:23.674 / 20250323 23:14:23.947 / 00:00:00.273
00:00:00.012 KEYWORD ${rsp} = RequestsLibrary . DELETE On Session   session url=${peopleurl} expected_status=200
Documentation:

Sends a DELETE request on a previously created HTTP Session.
Start / End / Elapsed: 20250323 23:14:23.947 / 20250323 23:14:23.959 / 00:00:00.012
23:14:23.955 INFO DELETE Request : url=http://10.30.170.145:8181/rests/data/people:people path_url=/rests/data/people:people headers={'User-Agent': 'python-requests/2.32.3', 'Accept-Encoding': 'gzip, deflate', 'Accept': '*/*', 'Connection': 'keep-alive', 'Cookie': 'JSESSIONID=node0kd5annrnlsib5cqke879ew6q1.node0', 'Content-Length': '0', 'Authorization': 'Basic YWRtaW46YWRtaW4='} body=None
23:14:23.958 INFO DELETE Response : url=http://10.30.170.145:8181/rests/data/people:people status=409, reason=Conflict headers={'Content-Type': 'application/yang-data+xml', 'Content-Length': '345'} body=<?xml version="1.0" ?><errors xmlns="urn:ietf:params:xml:ns:yang:ietf-restconf"><error><error-type>protocol</error-type><error-path xmlns:a="urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people">/a:people</error-path><error-message>Data does not exist</error-message><error-tag>data-missing</error-tag></error></errors>
23:14:23.958 FAIL Url: http://10.30.170.145:8181/rests/data/people:people Expected status: 409 != 200
00:00:00.000 KEYWORD ${rsp} = RequestsLibrary . GET On Session   session url=${peopleurl_config} expected_status=anything
Documentation:

Sends a GET request on a previously created HTTP Session.
Start / End / Elapsed: 20250323 23:14:23.959 / 20250323 23:14:23.959 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Should Contain   ${DELETED_STATUS_CODES} ${rsp.status_code}
Documentation:

Fails if container does not contain item one or more times.
Start / End / Elapsed: 20250323 23:14:23.960 / 20250323 23:14:23.960 / 00:00:00.000
00:00:00.289 TEST Delete CarPeople
Full Name: controller-rest-clust-cars-perf-ask.txt.010 Crud Mdsal Perf.Delete CarPeople
Documentation:

Remove car-people entries from the datastore
Start / End / Elapsed: 20250323 23:14:23.960 / 20250323 23:14:24.249 / 00:00:00.289
Status: FAIL
Message: Url: http://10.30.170.145:8181/rests/data/car-people:car-people Expected status: 409 != 200
00:00:00.279 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing  
Documentation:

Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden.
Start / End / Elapsed: 20250323 23:14:23.961 / 20250323 23:14:24.240 / 00:00:00.279
00:00:00.009 KEYWORD ${rsp} = RequestsLibrary . DELETE On Session   session url=${carpeopleurl} expected_status=200
Documentation:

Sends a DELETE request on a previously created HTTP Session.
Start / End / Elapsed: 20250323 23:14:24.240 / 20250323 23:14:24.249 / 00:00:00.009
23:14:24.247 INFO DELETE Request : url=http://10.30.170.145:8181/rests/data/car-people:car-people path_url=/rests/data/car-people:car-people headers={'User-Agent': 'python-requests/2.32.3', 'Accept-Encoding': 'gzip, deflate', 'Accept': '*/*', 'Connection': 'keep-alive', 'Cookie': 'JSESSIONID=node0kd5annrnlsib5cqke879ew6q1.node0', 'Content-Length': '0', 'Authorization': 'Basic YWRtaW46YWRtaW4='} body=None
23:14:24.248 INFO DELETE Response : url=http://10.30.170.145:8181/rests/data/car-people:car-people status=409, reason=Conflict headers={'Content-Type': 'application/yang-data+xml', 'Content-Length': '353'} body=<?xml version="1.0" ?><errors xmlns="urn:ietf:params:xml:ns:yang:ietf-restconf"><error><error-type>protocol</error-type><error-path xmlns:a="urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people">/a:car-people</error-path><error-message>Data does not exist</error-message><error-tag>data-missing</error-tag></error></errors>
23:14:24.249 FAIL Url: http://10.30.170.145:8181/rests/data/car-people:car-people Expected status: 409 != 200
00:00:00.000 KEYWORD ${rsp} = RequestsLibrary . GET On Session   session url=${carpeopleurl_config} expected_status=anything
Documentation:

Sends a GET request on a previously created HTTP Session.
Start / End / Elapsed: 20250323 23:14:24.249 / 20250323 23:14:24.249 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Should Contain   ${DELETED_STATUS_CODES} ${rsp.status_code}
Documentation:

Fails if container does not contain item one or more times.
Start / End / Elapsed: 20250323 23:14:24.249 / 20250323 23:14:24.249 / 00:00:00.000
00:02:28.822 SUITE Puts During Isolation
Full Name: controller-rest-clust-cars-perf-ask.txt.Puts During Isolation
Documentation:

Test when a car shard leader is isolated while configuring cars.

Copyright (c) 2017 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

This test suite requires odl-restconf and odl-clustering-test-app modules. The script cluster_rest_script.py is used for generating requests for PUTing car items while the car shard leader is isolated.
Source: /w/workspace/controller-csit-3node-rest-clust-cars-perf-ask-only-titanium/test/csit/suites/controller/ThreeNodes_Datastore/puts_during_isolation.robot
Start / End / Elapsed: 20250323 23:14:24.254 / 20250323 23:16:53.076 / 00:02:28.822
Status: 6 tests total, 2 passed, 4 failed, 0 skipped
00:00:09.384 SETUP Start Suite  
Documentation:

Upload the script file and create a virtual env
Start / End / Elapsed: 20250323 23:14:24.335 / 20250323 23:14:33.719 / 00:00:09.384
00:00:00.147 TEARDOWN Stop Suite  
Documentation:

Stop the tool, remove virtual env and close ssh connection towards tools vm.
Start / End / Elapsed: 20250323 23:16:52.929 / 20250323 23:16:53.076 / 00:00:00.147
00:00:45.433 TEST Start_Adding_Cars_To_Follower
Full Name: controller-rest-clust-cars-perf-ask.txt.Puts During Isolation.Start_Adding_Cars_To_Follower
Documentation:

Start the script to configure 10000 cars in the background.
Tags: critical
Start / End / Elapsed: 20250323 23:14:33.719 / 20250323 23:15:19.152 / 00:00:45.433
Status: FAIL
Message: Keyword 'Ensure_Cars_Being_Configured' failed after retrying 10 times. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.170.145:8181/rests/data/car:cars?content=config
00:00:00.274 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing  
Documentation:

Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden.
Start / End / Elapsed: 20250323 23:14:33.719 / 20250323 23:14:33.993 / 00:00:00.274
00:00:00.000 KEYWORD ${idx} = Collections . Get From List   ${car_follower_indices} 0
Documentation:

Returns the value specified with an index from list.
Start / End / Elapsed: 20250323 23:14:33.994 / 20250323 23:14:33.994 / 00:00:00.000
00:00:00.001 KEYWORD ${follower_ip} = ClusterManagement . Resolve_IP_Address_For_Member   member_index=${idx}
Documentation:

Return node IP address of given index.
Start / End / Elapsed: 20250323 23:14:33.994 / 20250323 23:14:33.995 / 00:00:00.001
00:00:00.014 KEYWORD Start_Tool   ${ADDCMD} --host ${follower_ip} ${TOOL_OPTIONS}
Documentation:

Start the tool
Start / End / Elapsed: 20250323 23:14:33.995 / 20250323 23:14:34.009 / 00:00:00.014
00:00:00.001 KEYWORD ${session} = ClusterManagement . Resolve_Http_Session_For_Member   member_index=${car_leader_index}
Documentation:

Return RequestsLibrary session alias pointing to node of given index.
Start / End / Elapsed: 20250323 23:14:34.009 / 20250323 23:14:34.010 / 00:00:00.001
00:00:45.142 KEYWORD BuiltIn . Wait Until Keyword Succeeds   10x 5s Ensure_Cars_Being_Configured ${session}
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20250323 23:14:34.010 / 20250323 23:15:19.152 / 00:00:45.142
Message: 9 failing items removed using the --remove-keywords option.
00:00:00.013 KEYWORD Ensure_Cars_Being_Configured   ${session}
Documentation:

FIXME: Add a documentation.
Start / End / Elapsed: 20250323 23:15:19.139 / 20250323 23:15:19.152 / 00:00:00.013
00:00:00.011 KEYWORD ${count1} = Get_Cars_Count   ${session}
Documentation:

Count car items in config ds.
Start / End / Elapsed: 20250323 23:15:19.139 / 20250323 23:15:19.150 / 00:00:00.011
00:00:00.010 KEYWORD ${resp} = RequestsLibrary . GET On Session   ${session} url=${CARURL_CONFIG}
Documentation:

Sends a GET request on a previously created HTTP Session.
Start / End / Elapsed: 20250323 23:15:19.140 / 20250323 23:15:19.150 / 00:00:00.010
23:15:19.149 INFO GET Request : url=http://10.30.170.145:8181/rests/data/car:cars?content=config path_url=/rests/data/car:cars?content=config headers={'User-Agent': 'python-requests/2.32.3', 'Accept-Encoding': 'gzip, deflate', 'Accept': '*/*', 'Connection': 'keep-alive', 'Cookie': 'JSESSIONID=node0nulduvlo4xps1hoqizd3pto8e2.node0', 'Authorization': 'Basic YWRtaW46YWRtaW4='} body=None
23:15:19.149 INFO GET Response : url=http://10.30.170.145:8181/rests/data/car:cars?content=config status=409, reason=Conflict headers={'Content-Type': 'application/yang-data+json', 'Content-Length': '242'} body={ "errors": { "error": [ { "error-tag": "data-missing", "error-message": "Request could not be completed because the relevant data model content does not exist", "error-type": "protocol" } ] } }
23:15:19.150 FAIL HTTPError: 409 Client Error: Conflict for url: http://10.30.170.145:8181/rests/data/car:cars?content=config
00:00:00.000 KEYWORD ${count} = BuiltIn . Evaluate   len(${resp.json()}[cars][car-entry])
Documentation:

Evaluates the given expression in Python and returns the result.
Start / End / Elapsed: 20250323 23:15:19.151 / 20250323 23:15:19.151 / 00:00:00.000
00:00:00.000 RETURN   ${count}
Start / End / Elapsed: 20250323 23:15:19.151 / 20250323 23:15:19.151 / 00:00:00.000
00:00:00.000 KEYWORD ${count2} = Get_Cars_Count   ${session}
Documentation:

Count car items in config ds.
Start / End / Elapsed: 20250323 23:15:19.151 / 20250323 23:15:19.151 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Should Not Be Equal As Integers   ${count1} ${count2}
Documentation:

Fails if objects are equal after converting them to integers.
Start / End / Elapsed: 20250323 23:15:19.151 / 20250323 23:15:19.151 / 00:00:00.000
23:15:19.152 FAIL Keyword 'Ensure_Cars_Being_Configured' failed after retrying 10 times. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.170.145:8181/rests/data/car:cars?content=config
00:00:01.538 TEST Isolate_Current_Car_Leader
Full Name: controller-rest-clust-cars-perf-ask.txt.Puts During Isolation.Isolate_Current_Car_Leader
Documentation:

Isolating cluster node which is the car shard leader.
Tags: critical
Start / End / Elapsed: 20250323 23:15:19.152 / 20250323 23:15:20.690 / 00:00:01.538
Status: PASS
00:00:21.489 TEST Verify_New_Car_Leader_Elected
Full Name: controller-rest-clust-cars-perf-ask.txt.Puts During Isolation.Verify_New_Car_Leader_Elected
Documentation:

Verify new owner of the car shard is elected.
Tags: critical
Start / End / Elapsed: 20250323 23:15:20.691 / 20250323 23:15:42.180 / 00:00:21.489
Status: PASS
00:00:08.370 TEST Verify_Cars_Configured
Full Name: controller-rest-clust-cars-perf-ask.txt.Puts During Isolation.Verify_Cars_Configured
Documentation:

Verify that all cars are configured.
Tags: critical
Start / End / Elapsed: 20250323 23:15:42.180 / 20250323 23:15:50.550 / 00:00:08.370
Status: FAIL
Message: Keyword 'Verify_Cars_Count' failed after retrying 5 times. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.170.235:8181/rests/data/car:cars?content=config
00:00:00.289 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing  
Documentation:

Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden.
Start / End / Elapsed: 20250323 23:15:42.180 / 20250323 23:15:42.469 / 00:00:00.289
00:00:00.004 KEYWORD BuiltIn . Wait Until Keyword Succeeds   120x 2s SSHLibrary.Read_Until_Prompt
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20250323 23:15:42.470 / 20250323 23:15:42.474 / 00:00:00.004
00:00:00.001 KEYWORD ${session} = ClusterManagement . Resolve_Http_Session_For_Member   member_index=${new_leader_index}
Documentation:

Return RequestsLibrary session alias pointing to node of given index.
Start / End / Elapsed: 20250323 23:15:42.473 / 20250323 23:15:42.474 / 00:00:00.001
00:00:08.076 KEYWORD BuiltIn . Wait Until Keyword Succeeds   5x 2s Verify_Cars_Count ${ITEM_COUNT} ${session}
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20250323 23:15:42.474 / 20250323 23:15:50.550 / 00:00:08.076
Message: 4 failing items removed using the --remove-keywords option.
00:00:00.012 KEYWORD Verify_Cars_Count   ${ITEM_COUNT} ${session}
Documentation:

Count car items in config ds and compare with expected number.
Start / End / Elapsed: 20250323 23:15:50.538 / 20250323 23:15:50.550 / 00:00:00.012
00:00:00.010 KEYWORD ${count} = Get_Cars_Count   ${session}
Documentation:

Count car items in config ds.
Start / End / Elapsed: 20250323 23:15:50.539 / 20250323 23:15:50.549 / 00:00:00.010
00:00:00.009 KEYWORD ${resp} = RequestsLibrary . GET On Session   ${session} url=${CARURL_CONFIG}
Documentation:

Sends a GET request on a previously created HTTP Session.
Start / End / Elapsed: 20250323 23:15:50.539 / 20250323 23:15:50.548 / 00:00:00.009
23:15:50.548 INFO GET Request : url=http://10.30.170.235:8181/rests/data/car:cars?content=config path_url=/rests/data/car:cars?content=config headers={'User-Agent': 'python-requests/2.32.3', 'Accept-Encoding': 'gzip, deflate', 'Accept': '*/*', 'Connection': 'keep-alive', 'Cookie': 'JSESSIONID=node01vq5y6z3mupxd1s3b0y0wh58ig1.node0', 'Authorization': 'Basic YWRtaW46YWRtaW4='} body=None
23:15:50.548 INFO GET Response : url=http://10.30.170.235:8181/rests/data/car:cars?content=config status=409, reason=Conflict headers={'Content-Type': 'application/yang-data+json', 'Content-Length': '242'} body={ "errors": { "error": [ { "error-tag": "data-missing", "error-message": "Request could not be completed because the relevant data model content does not exist", "error-type": "protocol" } ] } }
23:15:50.548 FAIL HTTPError: 409 Client Error: Conflict for url: http://10.30.170.235:8181/rests/data/car:cars?content=config
00:00:00.000 KEYWORD ${count} = BuiltIn . Evaluate   len(${resp.json()}[cars][car-entry])
Documentation:

Evaluates the given expression in Python and returns the result.
Start / End / Elapsed: 20250323 23:15:50.549 / 20250323 23:15:50.549 / 00:00:00.000
00:00:00.000 RETURN   ${count}
Start / End / Elapsed: 20250323 23:15:50.549 / 20250323 23:15:50.549 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Should Be Equal As Numbers   ${count} ${exp_count}
Documentation:

Fails if objects are unequal after converting them to real numbers.
Start / End / Elapsed: 20250323 23:15:50.550 / 20250323 23:15:50.550 / 00:00:00.000
23:15:50.550 FAIL Keyword 'Verify_Cars_Count' failed after retrying 5 times. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.170.235:8181/rests/data/car:cars?content=config
00:01:02.070 TEST Rejoin_Isolated_Member
Full Name: controller-rest-clust-cars-perf-ask.txt.Puts During Isolation.Rejoin_Isolated_Member
Documentation:

Rejoin isolated node
Tags: critical
Start / End / Elapsed: 20250323 23:15:50.551 / 20250323 23:16:52.621 / 00:01:02.070
Status: FAIL
Message: Keyword 'Check_Cluster_Is_In_Sync' failed after retrying for 1 minute. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.145:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore
00:00:00.303 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing  
Documentation:

Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden.
Start / End / Elapsed: 20250323 23:15:50.551 / 20250323 23:15:50.854 / 00:00:00.303
00:01:01.765 KEYWORD ClusterManagement . Rejoin_Member_From_List_Or_All   ${old_car_leader}
Documentation:

If the list is empty, rejoin member from all ODL instances. Otherwise, rejoin member based on present indices.
Start / End / Elapsed: 20250323 23:15:50.855 / 20250323 23:16:52.620 / 00:01:01.765
00:00:00.001 KEYWORD ${index_list} = ClusterManagement . List_Indices_Or_All   given_list=${member_index_list}
Documentation:

Utility to allow ${EMPTY} as default argument value, as the internal list is computed at runtime. This keyword always returns a (shallow) copy of given or default list, so operations with the returned list should not affect other lists. Also note that this keyword does not consider empty list to be ${EMPTY}.
Start / End / Elapsed: 20250323 23:15:50.859 / 20250323 23:15:50.860 / 00:00:00.001
00:00:00.000 KEYWORD ${source} = Collections . Get From Dictionary   ${ClusterManagement__index_to_ip_mapping} ${rejoin_member_index}
Documentation:

Returns a value from the given dictionary based on the given key.
Start / End / Elapsed: 20250323 23:15:50.860 / 20250323 23:15:50.860 / 00:00:00.000
00:00:00.004 KEYWORD ${dport} = BuiltIn . Set Variable If   '${port}' != '${EMPTY}' --dport ${port} ${EMPTY}
Documentation:

Sets variable based on the given condition.
Start / End / Elapsed: 20250323 23:15:50.860 / 20250323 23:15:50.864 / 00:00:00.004
00:00:01.106 FOR ${index} IN @{index_list}  
Start / End / Elapsed: 20250323 23:15:50.864 / 20250323 23:15:51.970 / 00:00:01.106
00:00:00.000 KEYWORD ${command} = BuiltIn . Set Variable   sudo /sbin/iptables -L -n
Documentation:

Returns the given values which can then be assigned to a variables.
Start / End / Elapsed: 20250323 23:15:51.970 / 20250323 23:15:51.970 / 00:00:00.000
00:00:00.374 KEYWORD ${output} = ClusterManagement . Run_Bash_Command_On_Member   command=${command} member_index=${rejoin_member_index}
Documentation:

Obtain IP, call Utils and return output. This keeps previous ssh session active.
Start / End / Elapsed: 20250323 23:15:51.970 / 20250323 23:15:52.344 / 00:00:00.374
00:00:00.000 KEYWORD BuiltIn . Log   ${output}
Documentation:

Logs the given message with the given level.
Start / End / Elapsed: 20250323 23:15:52.344 / 20250323 23:15:52.344 / 00:00:00.000
00:01:00.275 KEYWORD BuiltIn . Wait Until Keyword Succeeds   ${timeout} 10s Check_Cluster_Is_In_Sync
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20250323 23:15:52.345 / 20250323 23:16:52.620 / 00:01:00.275
Message: 6 failing items removed using the --remove-keywords option.
00:00:00.036 KEYWORD ClusterManagement . Check_Cluster_Is_In_Sync  
Documentation:

Fail if no-sync is detected on a member from list (or any).
Start / End / Elapsed: 20250323 23:16:52.584 / 20250323 23:16:52.620 / 00:00:00.036
23:16:52.620 FAIL Keyword 'Check_Cluster_Is_In_Sync' failed after retrying for 1 minute. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.145:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore
00:00:00.307 TEST Delete Cars
Full Name: controller-rest-clust-cars-perf-ask.txt.Puts During Isolation.Delete Cars
Documentation:

Remove cars from the datastore
Tags: critical
Start / End / Elapsed: 20250323 23:16:52.621 / 20250323 23:16:52.928 / 00:00:00.307
Status: FAIL
Message: Url: http://10.30.170.235:8181/rests/data/car:cars Expected status: 409 != 200