Test Statistics

Total Statistics
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
All Tests
11011000:17:24
Statistics by Tag
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
No Tags
Statistics by Suite
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
netconf-callhome.txt
11011000:17:38
netconf-callhome . txt . Callhome
11011000:17:38

Test Execution Log

00:17:37.926 SUITE netconf-callhome.txt
Full Name: netconf-callhome.txt
Source: /w/workspace/netconf-csit-1node-callhome-only-potassium/test/csit/suites/netconf/callhome
Start / End / Elapsed: 20241006 03:34:36.512 / 20241006 03:52:14.438 / 00:17:37.926
Status: 11 tests total, 0 passed, 11 failed, 0 skipped
00:17:37.894 SUITE Callhome
Full Name: netconf-callhome.txt.Callhome
Documentation:

Test suite to verify callhome functionality over SSH transport protocol. Registration in OpenDaylight Controller happens via restconf interface. Netopeer2-server docker container plays a role of the netconf device with call-home feature. Docker-compose file is used to configure netopeer2 docker container(netconf configuration templates, host-key).
Source: /w/workspace/netconf-csit-1node-callhome-only-potassium/test/csit/suites/netconf/callhome/callhome.robot
Start / End / Elapsed: 20241006 03:34:36.542 / 20241006 03:52:14.436 / 00:17:37.894
Status: 11 tests total, 0 passed, 11 failed, 0 skipped
00:00:13.155 SETUP NetconfCallHome . Suite Setup  
Documentation:

Get the suite ready for callhome test cases.
Start / End / Elapsed: 20241006 03:34:36.943 / 20241006 03:34:50.098 / 00:00:13.155
00:00:00.768 TEARDOWN NetconfCallHome . Suite Teardown  
Documentation:

Tearing down the setup.
Start / End / Elapsed: 20241006 03:52:13.667 / 20241006 03:52:14.435 / 00:00:00.768
00:01:42.592 TEST CallHome with Incorrect global Credentials
Full Name: netconf-callhome.txt.Callhome.CallHome with Incorrect global Credentials
Documentation:

Incorrect global credentials should result to mount failure. FAILED_AUTH_FAILURE should be the device status.
Start / End / Elapsed: 20241006 03:34:50.098 / 20241006 03:36:32.690 / 00:01:42.592
Status: FAIL
Message: Keyword 'NetconfCallHome.Check Device Status' failed after retrying for 1 minute 30 seconds. The last error was: '{"odl-netconf-callhome-server:netconf-callhome-server":{"allowed-devices":{"device":[{"unique-id":"netopeer2","ssh-host-key":"AAAAB3NzaC1yc2EAAAADAQABAAABAQDH+BT38G1TshwpylFiUI2O6978k4Y9wsGE2pFNzuy9Dn6t+6WnXegzgKT7d4vLDCP1+Bcb4TfINBl/2GjyHuchVN+VZgJ2uiv3nXk/cQjxOIGPw3EEgQDafIyjQair746dDFEd7rPs4f5Kc16QNBZz1Hy1RvrZMSH4KTGpXvBSbgQhhmDzE21PDjaZrVuCL6w3er+5N6t0KOvLdBJhIA7a2XLYccr0NTGamgafXiVF7/A8FN+ygVhxrKXrIaTgmsswxhlRxDD+RnIFsgLszUP4n/meg8VwnFtg4Z/keer9Gj1D0ZVEvRsPUBmSxbBI8WHRi/UMi+a88SQIbafwbtS7","device-status":"DISCONNECTED"}]}}}' does not contain '"callhome-status:device-status":"FAILED_AUTH_FAILURE"'
00:01:33.785 TEST CallHome with Incorrect per-device Credentials
Full Name: netconf-callhome.txt.Callhome.CallHome with Incorrect per-device Credentials
Documentation:

Incorrect per-device credentials should result to mount failure. FAILED_AUTH_FAILURE should be the device status.
Start / End / Elapsed: 20241006 03:36:32.691 / 20241006 03:38:06.476 / 00:01:33.785
Status: FAIL
Message: Keyword 'NetconfCallHome.Check Device Status' failed after retrying for 1 minute 30 seconds. The last error was: '{"odl-netconf-callhome-server:netconf-callhome-server":{"allowed-devices":{"device":[{"unique-id":"netopeer2","ssh-host-key":"AAAAB3NzaC1yc2EAAAADAQABAAABAQDcP872Hu1PxE5zqEzrvyiboj9vSkou9aqoUwRTnyQJDEKxv8rmsD6+RJj/XgGYvMDbUTi3+FQsKA8eOIzE5tJJ1BbsgS6T5XktrOsWauDNYAygNvrMLS5hM4iBZrwHxmRkZBSIZNsAA95yLdCozQG0yxe+MEuoafiSkYTlNpJv2i/77Y3+Jr6rtjMZFYPLz9OUBaNnVSicVcMrXwy1IhJzDLWMFKKgGnKTP2QAlF36VpWK0T4ozAqaUTkJjxXaefm8p/q5MYHB6827MBk8rwMe720Vsdk9nXFwv2ZeUdEv76qNtQ/YOjbc9RPJyqg2dQEUiCIBfN2+++d1mB+QwE1p","device-status":"DISCONNECTED"}]}}}' does not contain '"callhome-status:device-status":"FAILED_AUTH_FAILURE"'
00:01:33.983 TEST CallHome with Incorrect Node-id
Full Name: netconf-callhome.txt.Callhome.CallHome with Incorrect Node-id
Documentation:

CallHome from device that does not have an entry in per-device credential with result to mount point failure.
Start / End / Elapsed: 20241006 03:38:06.476 / 20241006 03:39:40.459 / 00:01:33.983
Status: FAIL
Message: Keyword 'NetconfCallHome.Check Device Status' failed after retrying for 1 minute 30 seconds. The last error was: '{"odl-netconf-callhome-server:netconf-callhome-server":{"allowed-devices":{"device":[{"unique-id":"netopeer2","ssh-host-key":"AAAAB3NzaC1yc2EAAAADAQABAAABAQDfi9ffKL90PUmDgXyvmGADL+NU9rn2LS1HfnV9pWRJ6HdpBTnqhzD7s4Iybb2oClvB8v3zcUFp8IoO5whzIgO6+YiveTUEmkshPsAwKJ445rnhCtBswo+mkWXVkQnM4R7cn/XYMAPBCW8Pfbkj0y5x0lvt/2Mfl2z763saGabv/HKK90ic8abyJh7z8Mced50ZxzDj62LTY0Z8WgnljUcd4tKTTbki0pzRUw313jw4gMC9nmZAQc/Cob4jJyRhSh5fPUJJDdp+OhXlymcop0fF+6FkxGQR8CF3CfCbce4Qe1syfy7HwOwCQHsOoMs3y/LmHqEa3m8u6oCn6yQyxOEZ","device-status":"DISCONNECTED"},{"unique-id":"incorrect_hostname","ssh-host-key":"","device-status":"DISCONNECTED"}]}}}' does not contain '"callhome-status:device-status":"DISCONNECTED"'
00:01:34.002 TEST CallHome with Rogue Devices
Full Name: netconf-callhome.txt.Callhome.CallHome with Rogue Devices
Documentation:

A Rogue Device will fail to callhome and wont be able to mount because the keys are not added in whitelist. FAILED_NOT_ALLOWED should be the device status.
Start / End / Elapsed: 20241006 03:39:40.459 / 20241006 03:41:14.461 / 00:01:34.002
Status: FAIL
Message: Keyword 'NetconfCallHome.Check Device Status' failed after retrying for 1 minute 30 seconds. The last error was: '{"odl-netconf-callhome-server:netconf-callhome-server":{"allowed-devices":{"device":[{"unique-id":"netopeer2","ssh-host-key":"incorrect-key-value","device-status":"DISCONNECTED"}]}}}' does not contain '"callhome-status:device-status":"FAILED_NOT_ALLOWED"'
00:01:34.201 TEST Successful CallHome with correct global credentials
Full Name: netconf-callhome.txt.Callhome.Successful CallHome with correct global credentials
Documentation:

Device being in whitelist of the Call Home server along with correct global credentials will result to successful mount. CONNECTED should be the device status.
Start / End / Elapsed: 20241006 03:41:14.461 / 20241006 03:42:48.662 / 00:01:34.201
Status: FAIL
Message: Keyword 'NetconfCallHome.Check Device Status' failed after retrying for 1 minute 30 seconds. The last error was: '{"odl-netconf-callhome-server:netconf-callhome-server":{"allowed-devices":{"device":[{"unique-id":"netopeer2","ssh-host-key":"AAAAB3NzaC1yc2EAAAADAQABAAABAQDS1pwu/jnFZwGFNfier5T7mlqrDaYyahyxXGbQ5uUzoU8ysaB687WCtyxnqKIAYvglKT43AkgAWkUJ33O8BusPDqWhvt5MWr8to2IL2fQlb0RiY0D9+Ov5RNHy1Eyj8sYwBPqDUJEc1xj7/FGSNUXf8g9LOU+dCZfTHX2+NO4tDYmZtQWO816pgBtzfVric20R0W98IDQDYCaxhgufFqFywv0hL08sUxRE7Ne8FygScU9lj4MXNi4Vsve54pwuq5+vti3H0Ojf0snoLhsJIEqngsj0d5mcA1aYT/G0IG/n0kCdTIYiDQv+O6zYodFmdlCe9Mef/d1Vo2OAVa2CxuY5","device-status":"DISCONNECTED"}]}}}' does not contain '"callhome-status:device-status":"CONNECTED"'
00:01:33.934 TEST Successful CallHome with correct per-device credentials
Full Name: netconf-callhome.txt.Callhome.Successful CallHome with correct per-device credentials
Documentation:

Device being in whitelist of the Call Home server along with correct per-device credentials will result to successful mount. CONNECTED should be the device status.
Start / End / Elapsed: 20241006 03:42:48.663 / 20241006 03:44:22.597 / 00:01:33.934
Status: FAIL
Message: Keyword 'NetconfCallHome.Check Device Status' failed after retrying for 1 minute 30 seconds. The last error was: '{"odl-netconf-callhome-server:netconf-callhome-server":{"allowed-devices":{"device":[{"unique-id":"netopeer2","ssh-host-key":"AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ1Wy9QPITxi8InVzqlvRL949uekeAk9w9eJqAtYRKKfORvJoEm3xKLJM1senzvDIvGaJ+gi/lJY5imOdb4V1RAp1vmyEvhzz1vlKAbxpcLihTvhQmNaECQQGU8H2g3vdOilJpdFlPL7ff8fqkY2i3x2RUrsfrp0Eca+zCZxYrbgsIc8kWwUis6/CJhUDSqKb/AtykOzZuwJhAjP1KfUfx4MPlU+8lZdhXVQMYKjRjWuakijxvPuWQSXqnfeMdjFD7bgjkauG2THa2ac4c0y2UgmqP5QRQXhfuCUoHemUg7GCHYw6v7+DybbiNbbda/HYlau+iRWsuU4By/6QPBk6R","device-status":"DISCONNECTED"}]}}}' does not contain '"callhome-status:device-status":"CONNECTED"'
00:01:33.755 TEST CallHome over SSH with correct device credentials (APIv2)
Full Name: netconf-callhome.txt.Callhome.CallHome over SSH with correct device credentials (APIv2)
Documentation:

Correct credentials should result to successful mount. CONNECTED should be the device status.
Start / End / Elapsed: 20241006 03:44:22.597 / 20241006 03:45:56.352 / 00:01:33.755
Status: FAIL
Message: Keyword 'NetconfCallHome.Check Device Status' failed after retrying for 1 minute 30 seconds. The last error was: '{"odl-netconf-callhome-server:netconf-callhome-server":{"allowed-devices":{"device":[{"unique-id":"netopeer2","ssh-client-params":{"host-key":"AAAAB3NzaC1yc2EAAAADAQABAAABAQDhLfRgGK4LzONWnc62nUXOgtvGM7ahCVFfQ39cENTSt+8AGPSNH0arxFugMC/T5Xl/CpmGjqW+XVJ4Z6VzyGyxNpZB2quUn1kK0o01MrVucFkZVg5zzTnoA0Voqj8Vw92CvuUs7a4pAnYrxFuXcEhCmZKUXei6j3BdoR9crzA6Sryrz+uNqUAVcPqovq/O3Kkc0jWIEE6/NYAReOUYehF8+CTzsotYid1lEa6c+8IoEMDdm8ZvE+dXX4SF6hz+zsP3XdEcnR8XvOOhOXyLxDt9lesElKaxFwLH7tvxaGKPn0tGVDX98D3DEAbHUX1FhyUOX8aIQL65do6tb46SmtzR"},"device-status":"DISCONNECTED"}]}}}' does not contain '"callhome-status:device-status":"CONNECTED"'
00:01:33.855 TEST CallHome over SSH with incorrect device credentials (APIv2)
Full Name: netconf-callhome.txt.Callhome.CallHome over SSH with incorrect device credentials (APIv2)
Documentation:

Correct credentials should result to successful mount. CONNECTED should be the device status.
Start / End / Elapsed: 20241006 03:45:56.352 / 20241006 03:47:30.207 / 00:01:33.855
Status: FAIL
Message: Keyword 'NetconfCallHome.Check Device Status' failed after retrying for 1 minute 30 seconds. The last error was: '{"odl-netconf-callhome-server:netconf-callhome-server":{"allowed-devices":{"device":[{"unique-id":"netopeer2","ssh-client-params":{"host-key":"AAAAB3NzaC1yc2EAAAADAQABAAABAQCtXfLcSibA/XYldaZ86p8ubPKVIIi1j9po2HxTiwEoaHoFbGrEhSt5FJPeR7xVgWzH8HK4NNCJFYane9KMXoZ3jrKIgnXRUkJTWczWb3pGRIJPs5iujJKn0ciASHozTJKX2zeALiFC+Q0Pf3CEWxfBwHywgHPBwHkkgYh9fZX/4s8mtgxN6Gq0hDuK0jGwENbujwGHq9zQLBrmpyIBE9Io+/+y9jxLrp87vVWuknWzc0iKVLzia64m156dIcB7vE7GIYfl/uVBd+g045T3koLQo89cYx7e81VCxLEulibP/y/Uos3PFtLNo2Dp8yXqhV2ELbauYC25VBFnhcu/IfNt"},"device-status":"DISCONNECTED"}]}}}' does not contain '"callhome-status:device-status":"FAILED_AUTH_FAILURE"'
00:01:33.852 TEST CallHome over SSH with correct global credentials (APIv2)
Full Name: netconf-callhome.txt.Callhome.CallHome over SSH with correct global credentials (APIv2)
Documentation:

CallHome SSH device registered via APIv2 with global credentials from APIv1 should result to successful mount.
Start / End / Elapsed: 20241006 03:47:30.208 / 20241006 03:49:04.060 / 00:01:33.852
Status: FAIL
Message: Keyword 'NetconfCallHome.Check Device Status' failed after retrying for 1 minute 30 seconds. The last error was: '{"odl-netconf-callhome-server:netconf-callhome-server":{"allowed-devices":{"device":[{"unique-id":"netopeer2","ssh-client-params":{"host-key":"AAAAB3NzaC1yc2EAAAADAQABAAABAQDBRZKJ9F/Jbl24GRqCVmXKY+Q5h1ZABaSI3MQfvw7JxLXu944MBYLzPda8X727rG9doH3XgEGMjhUXwAiVPie/HdqxcQghtgkc6w0Rh73G77GuwcnTxHud2RM1Ne8OjZGFDvnjS+yqzt3sDWagGvR7qX1fy1HK87M2HhZv6DBDsR8JvbEHH3Bi5v0uwwmSv0VIFYRh9sRVuLN32KIg0Oh+liKRJ+ox3SELFpu3GO5MubPGca0VA9OLcXX0H0uh+acPJMLdpYqSYcX8bufz9QSPY5IJeFZwTDhZXM2ph06UNLzWStaYut1xdGyeigJZkm1VibjrcPC5SLOVhY9nb1Ax"},"device-status":"DISCONNECTED"}]}}}' does not contain '"callhome-status:device-status":"CONNECTED"'
00:01:33.768 TEST CallHome over SSH with incorrect global credentials (APIv2)
Full Name: netconf-callhome.txt.Callhome.CallHome over SSH with incorrect global credentials (APIv2)
Documentation:

CallHome SSH device registered via APIv2 with wrong global credentials from APIv1 should fail.
Start / End / Elapsed: 20241006 03:49:04.060 / 20241006 03:50:37.828 / 00:01:33.768
Status: FAIL
Message: Keyword 'NetconfCallHome.Check Device Status' failed after retrying for 1 minute 30 seconds. The last error was: '{"odl-netconf-callhome-server:netconf-callhome-server":{"allowed-devices":{"device":[{"unique-id":"netopeer2","ssh-client-params":{"host-key":"AAAAB3NzaC1yc2EAAAADAQABAAABAQDKui+PQh1CvDVz6WjQaBhSKN3EYMH6tB8aAR38eKEMNUrDnVJBJchE2qMDM6KS4Vw0cy3XEY5ONv9lTCYWOsYUQFLBkWSxs0qOdLSuYZE3mVmGpjGcqyb5TzLgdmvPt3YhSfDEgQ4pzDEIR2x/nGgnvrwUQyoXbFa5nIUbrsRzh3I/ApOWrYMyjfQrTFtUksip+L4Z60Pv2ZlzQBFLzKNpwEKBstCDNjhuBooLWO2v0h0ni3NXhsMlly0qGbpzxrte3u1P05mYTRJNI/Yi/zAXVd8+FHtIc0MpK6Ds5TEpAGHkxKBZFga525zxwvOhj4xYVAcNgybxFW4lCipv3gzB"},"device-status":"DISCONNECTED"}]}}}' does not contain '"callhome-status:device-status":"FAILED_AUTH_FAILURE"'
00:01:35.837 TEST CallHome over TLS with correct certificate and key (APIv2)
Full Name: netconf-callhome.txt.Callhome.CallHome over TLS with correct certificate and key (APIv2)
Documentation:

Using correct certificate and key pair should result to successful mount. CONNECTED should be the device status.
Start / End / Elapsed: 20241006 03:50:37.829 / 20241006 03:52:13.666 / 00:01:35.837
Status: FAIL
Message: Keyword 'NetconfCallHome.Check Device Status' failed after retrying for 1 minute 30 seconds. The last error was: '{"odl-netconf-callhome-server:netconf-callhome-server":{"allowed-devices":{"device":[{"unique-id":"netopeer2","tls-client-params":{"certificate-id":"tls-device-certificate","key-id":"tls-device-key"},"device-status":"DISCONNECTED"}]}}}' does not contain '"callhome-status:device-status":"CONNECTED"'