blob: bbc9eb79e8fa7d7f00433ff93e1469bcad5c6558 [file] [log] [blame]
Prashanth Kattifa699cf2020-04-06 10:13:33 -05001*** Settings ***
2Documentation Connections and authentication module stability tests.
3
4Resource ../lib/bmc_redfish_resource.robot
5Resource ../lib/bmc_network_utils.robot
6Resource ../lib/openbmc_ffdc.robot
Anvesh Kumar Rayankula85df1372020-04-28 05:01:14 -05007Resource ../lib/resource.robot
8Resource ../lib/utils.robot
9Resource ../lib/connection_client.robot
shrsuman123b844a872021-12-21 05:49:41 -060010Resource ../gui/lib/gui_resource.robot
Prashanth Kattifa699cf2020-04-06 10:13:33 -050011Library ../lib/bmc_network_utils.py
12
Anvesh Kumar Rayankula85df1372020-04-28 05:01:14 -050013Library SSHLibrary
Prashanth Kattifa699cf2020-04-06 10:13:33 -050014Library Collections
Prashanth Kattiee26d5e2021-05-21 00:38:31 -050015Library XvfbRobot
16Library OperatingSystem
George Keishing47d1e8e2022-02-17 10:38:49 -060017Library SeleniumLibrary 120 120
Prashanth Kattiee26d5e2021-05-21 00:38:31 -050018Library Telnet 30 Seconds
19Library Screenshot
20
shrsuman123a8ca2962022-01-07 03:30:08 -060021
22Suite Setup Redfish.Logout
23
Prashanth Kattiee26d5e2021-05-21 00:38:31 -050024Variables ../gui/data/gui_variables.py
Prashanth Kattifa699cf2020-04-06 10:13:33 -050025
26*** Variables ***
27
Anvesh Kumar Rayankula85df1372020-04-28 05:01:14 -050028${iterations} 10000
Anvesh Kumar Rayankula3cddd032020-03-26 04:16:13 -050029${loop_iteration} ${1000}
George Keishing23afcc52022-04-07 03:18:08 -050030${hostname} testhostname
Anvesh Kumar Rayankula85df1372020-04-28 05:01:14 -050031${MAX_UNAUTH_PER_IP} ${5}
Prashanth Kattiee26d5e2021-05-21 00:38:31 -050032${bmc_url} https://${OPENBMC_HOST}
33
Prashanth Kattifa699cf2020-04-06 10:13:33 -050034
35*** Test Cases ***
36
37Test Patch Without Auth Token Fails
38 [Documentation] Send patch method without auth token and verify it throws an error.
George Keishing966a4c52020-05-13 10:53:58 -050039 [Tags] Test_Patch_Without_Auth_Token_Fails
Prashanth Kattifa699cf2020-04-06 10:13:33 -050040
Anves Kumar rayankula816d3ce2021-06-13 23:55:41 -050041 ${active_channel_config}= Get Active Channel Config
42 ${ethernet_interface}= Set Variable ${active_channel_config['${CHANNEL_NUMBER}']['name']}
43
44 Redfish.Patch ${REDFISH_NW_ETH_IFACE}${ethernet_interface} body={'HostName': '${hostname}'}
Prashanth Kattifa699cf2020-04-06 10:13:33 -050045 ... valid_status_codes=[${HTTP_UNAUTHORIZED}, ${HTTP_FORBIDDEN}]
46
47
48Flood Patch Without Auth Token And Check Stability Of BMC
49 [Documentation] Flood patch method without auth token and check BMC stability.
50 [Tags] Flood_Patch_Without_Auth_Token_And_Check_Stability_Of_BMC
George Keishing23afcc52022-04-07 03:18:08 -050051
52 @{fail_list}= Create List
Prashanth Kattifa699cf2020-04-06 10:13:33 -050053
Anves Kumar rayankula816d3ce2021-06-13 23:55:41 -050054 ${active_channel_config}= Get Active Channel Config
55 ${ethernet_interface}= Set Variable ${active_channel_config['${CHANNEL_NUMBER}']['name']}
56
George Keishing23afcc52022-04-07 03:18:08 -050057 FOR ${iter} IN RANGE ${1} ${iterations} + 1
58 Log To Console ${iter}th iteration Patch Request without valid session token
59 # Expected valid fail status response code.
60 Redfish.Patch ${REDFISH_NW_ETH_IFACE}${ethernet_interface} body={'HostName': '${hostname}'}
61 ... valid_status_codes=[${HTTP_UNAUTHORIZED}, ${HTTP_FORBIDDEN}]
Prashanth Kattifa699cf2020-04-06 10:13:33 -050062
63 # Every 100th iteration, check BMC allows patch with auth token.
George Keishing23afcc52022-04-07 03:18:08 -050064 ${status}= Run Keyword If ${iter} % 100 == 0 Run Keyword And Return Status
65 ... Login And Configure Hostname ${REDFISH_NW_ETH_IFACE}${ethernet_interface}
66 Run Keyword If ${status} == False Append To List ${fail_list} ${iter}
Prashanth Kattifa699cf2020-04-06 10:13:33 -050067 END
68 ${verify_count}= Evaluate ${iterations}/100
George Keishing23afcc52022-04-07 03:18:08 -050069 ${fail_count}= Get Length ${fail_list}
Prashanth Kattifa699cf2020-04-06 10:13:33 -050070
George Keishing23afcc52022-04-07 03:18:08 -050071 Should Be Equal As Integers ${fail_count} ${0}
72 ... msg=Patch operation failed ${fail_count} times in ${verify_count} attempts; fails at iterations ${fail_list}
Prashanth Kattifa699cf2020-04-06 10:13:33 -050073
74
George Keishing4fb89c12022-01-06 22:29:33 -060075Verify User Cannot Login After 5 Non-Logged In Sessions
Anvesh Kumar Rayankula85df1372020-04-28 05:01:14 -050076 [Documentation] User should not be able to login when there
77 ... are 5 non-logged in sessions.
78 [Tags] Verify_User_Cannot_Login_After_5_Non-Logged_In_Sessions
Gene Ratzlaff05a29c82022-05-13 11:43:25 -040079 [Setup] Confirm Ability to Connect Then Close All Connections
80 [Teardown] Run Keywords Process.Terminate All Processes AND
81 ... SSHLibrary.Close All Connections AND FFDC On Test Case Fail
Anvesh Kumar Rayankula85df1372020-04-28 05:01:14 -050082
George Keishing23afcc52022-04-07 03:18:08 -050083 FOR ${iter} IN RANGE ${0} ${MAX_UNAUTH_PER_IP}
Anvesh Kumar Rayankula85df1372020-04-28 05:01:14 -050084 SSHLibrary.Open Connection ${OPENBMC_HOST}
85 Start Process ssh ${OPENBMC_USERNAME}@${OPENBMC_HOST} shell=True
86 END
87
88 SSHLibrary.Open Connection ${OPENBMC_HOST}
89 ${status}= Run Keyword And Return Status SSHLibrary.Login ${OPENBMC_USERNAME} ${OPENBMC_PASSWORD}
Prashanth Katti91e59712020-04-14 08:12:09 -050090
Anvesh Kumar Rayankula85df1372020-04-28 05:01:14 -050091 Should Be Equal ${status} ${False}
92
93
Prashanth Katti91e59712020-04-14 08:12:09 -050094Test Post Without Auth Token Fails
95 [Documentation] Send post method without auth token and verify it throws an error.
96 [Tags] Test_Post_Without_Auth_Token_Fails
97
Anvesh Kumar Rayankula3cddd032020-03-26 04:16:13 -050098 ${user_info}= Create Dictionary
99 ... UserName=test_user Password=TestPwd123 RoleId=Operator Enabled=${True}
Prashanth Katti91e59712020-04-14 08:12:09 -0500100 Redfish.Post /redfish/v1/AccountService/Accounts/ body=&{user_info}
101 ... valid_status_codes=[${HTTP_UNAUTHORIZED}, ${HTTP_FORBIDDEN}]
102
103
104Flood Post Without Auth Token And Check Stability Of BMC
105 [Documentation] Flood post method without auth token and check BMC stability.
106 [Tags] Flood_Post_Without_Auth_Token_And_Check_Stability_Of_BMC
107
George Keishing23afcc52022-04-07 03:18:08 -0500108 @{fail_list}= Create List
109
Anvesh Kumar Rayankula3cddd032020-03-26 04:16:13 -0500110 ${user_info}= Create Dictionary
111 ... UserName=test_user Password=TestPwd123 RoleId=Operator Enabled=${True}
Prashanth Katti91e59712020-04-14 08:12:09 -0500112
George Keishing23afcc52022-04-07 03:18:08 -0500113 FOR ${iter} IN RANGE ${1} ${iterations} + 1
114 Log To Console ${iter}th iteration Post Request without valid session token
115 # Expected valid fail status response code.
116 Redfish.Post /redfish/v1/AccountService/Accounts/ body=&{user_info}
117 ... valid_status_codes=[${HTTP_UNAUTHORIZED}, ${HTTP_FORBIDDEN}]
Prashanth Katti91e59712020-04-14 08:12:09 -0500118
119 # Every 100th iteration, check BMC allows post with auth token.
George Keishing23afcc52022-04-07 03:18:08 -0500120 ${status}= Run Keyword If ${iter} % 100 == 0 Run Keyword And Return Status
Prashanth Katti91e59712020-04-14 08:12:09 -0500121 ... Login And Create User
George Keishing23afcc52022-04-07 03:18:08 -0500122 Run Keyword If ${status} == False Append To List ${fail_list} ${iter}
Prashanth Katti91e59712020-04-14 08:12:09 -0500123 END
124 ${verify_count}= Evaluate ${iterations}/100
George Keishing23afcc52022-04-07 03:18:08 -0500125 ${fail_count}= Get Length ${fail_list}
Prashanth Katti91e59712020-04-14 08:12:09 -0500126
George Keishing23afcc52022-04-07 03:18:08 -0500127 Should Be Equal As Integers ${fail_count} ${0}
128 ... msg=Post operation failed ${fail_count} times in ${verify_count} attempts; fails at iterations ${fail_list}
Anvesh Kumar Rayankula3cddd032020-03-26 04:16:13 -0500129
130
131Make Large Number Of Wrong SSH Login Attempts And Check Stability
132 [Documentation] Check BMC stability with large number of SSH wrong login requests.
133 [Tags] Make_Large_Number_Of_Wrong_SSH_Login_Attempts_And_Check_Stability
134 [Setup] Set Account Lockout Threshold
135 [Teardown] FFDC On Test Case Fail
136
137 SSHLibrary.Open Connection ${OPENBMC_HOST}
138 @{ssh_status_list}= Create List
Gene Ratzlafffde32cf2022-05-06 15:21:31 -0400139 FOR ${iter} IN RANGE ${1} ${loop_iteration} + 1
George Keishing23afcc52022-04-07 03:18:08 -0500140 Log To Console ${iter}th iteration
141 ${invalid_password}= Catenate ${OPENBMC_PASSWORD}${iter}
Anvesh Kumar Rayankula3cddd032020-03-26 04:16:13 -0500142 Run Keyword and Ignore Error
143 ... Open Connection And Log In ${OPENBMC_USERNAME} ${invalid_password}
144
145 # Every 100th iteration Login with correct credentials
George Keishing23afcc52022-04-07 03:18:08 -0500146 ${status}= Run keyword If ${iter} % ${100} == ${0} Run Keyword And Return Status
Anvesh Kumar Rayankula3cddd032020-03-26 04:16:13 -0500147 ... Open Connection And Log In ${OPENBMC_USERNAME} ${OPENBMC_PASSWORD}
148 Run Keyword If ${status} == ${False} Append To List ${ssh_status_list} ${status}
149 SSHLibrary.Close Connection
150 END
151
152 ${valid_login_count}= Evaluate ${iterations}/100
153 ${fail_count}= Get Length ${ssh_status_list}
154 Should Be Equal ${fail_count} ${0}
155 ... msg= Login Failed ${fail_count} times in ${valid_login_count} attempts.
Prashanth Katti91e59712020-04-14 08:12:09 -0500156
157
Prashanth Kattiee26d5e2021-05-21 00:38:31 -0500158Test Stability On Large Number Of Wrong Login Attempts To GUI
159 [Documentation] Test stability on large number of wrong login attempts to GUI.
160 [Tags] Test_Stability_On_Large_Number_Of_Wrong_Login_Attempts_To_GUI
161
162 @{status_list}= Create List
163
164 # Open headless browser.
165 Start Virtual Display
166 ${browser_ID}= Open Browser ${bmc_url} alias=browser1
167 Set Window Size 1920 1080
168
169 Go To ${bmc_url}
170
George Keishing23afcc52022-04-07 03:18:08 -0500171 FOR ${iter} IN RANGE ${1} ${iterations} + 1
172 Log To Console ${iter}th login
George Keishingfef9aa92022-04-08 08:45:42 -0500173 Run Keyword And Ignore Error Login to GUI With Incorrect Credentials
Prashanth Kattiee26d5e2021-05-21 00:38:31 -0500174
175 # Every 100th iteration, check BMC GUI is responsive.
George Keishing23afcc52022-04-07 03:18:08 -0500176 ${status}= Run Keyword If ${iter} % 100 == 0 Run Keyword And Return Status
Prashanth Kattiee26d5e2021-05-21 00:38:31 -0500177 ... Open Browser ${bmc_url}
178 Append To List ${status_list} ${status}
George Keishing47d1e8e2022-02-17 10:38:49 -0600179 Run Keyword If '${status}' == 'True'
180 ... Run Keywords Close Browser AND Switch Browser browser1
Prashanth Kattiee26d5e2021-05-21 00:38:31 -0500181 END
182
183 ${fail_count}= Count Values In List ${status_list} False
184 Run Keyword If ${fail_count} > ${0} FAIL Could not open BMC GUI ${fail_count} times
185
shrsuman123b844a872021-12-21 05:49:41 -0600186Test BMC GUI Stability On Continuous Refresh Of GUI Home Page
187 [Documentation] Login to BMC GUI and keep refreshing home page and verify stability
188 ... by login at times in another browser.
189 [Tags] Test_BMC_GUI_Stability_On_Continuous_Refresh_Of_GUI_Home_Page
190 [Teardown] Close All Browsers
191
192 @{failed_list}= Create List
193
194 # Open headless browser.
195 Start Virtual Display
196 ${browser_ID}= Open Browser ${bmc_url} alias=browser1
197 Set Window Size 1920 1080
198 Login GUI
199
200 FOR ${iter} IN RANGE ${iterations}
201 Log To Console ${iter}th Refresh of home page
202
203 Refresh GUI
204 Continue For Loop If ${iter}%100 != 0
205
206 # Every 100th iteration, check BMC GUI is responsive.
207 ${status}= Run Keyword And Return Status
208 ... Run Keywords Launch Browser And Login GUI AND Logout GUI
209 Run Keyword If '${status}' == 'False' Append To List ${failed_list} ${iter}
210 ... ELSE IF '${status}' == 'True'
211 ... Run Keywords Close Browser AND Switch Browser browser1
212 END
213 Log ${failed_list}
214 ${fail_count}= Get Length ${failed_list}
215 Run Keyword If ${fail_count} > ${0} FAIL Could not open BMC GUI ${fail_count} times
Prashanth Kattiee26d5e2021-05-21 00:38:31 -0500216
shrsuman1232b8bfca2021-11-18 05:14:23 -0600217Test BMCweb Stability On Continuous Redfish Login Attempts With Invalid Credentials
218 [Documentation] Make invalid credentials Redfish login attempts continuously and
219 ... verify bmcweb stability by login to Redfish with valid credentials.
220 [Tags] Test_BMCweb_Stability_On_Continuous_Redfish_Login_Attempts_With_Invalid_Credentials
221
222 Invalid Credentials Redfish Login Attempts
223
224Test User Delete Operation Without Session Token And Expect Failure
225 [Documentation] Try to delete an object without valid session token and verifies it throws
226 ... an unauthorised error.
227 [Tags] Test_User_Delete_Operation_Without_Session_Token_And_Expect_Failure
228 [Setup] Redfish.Logout
229
230 Redfish.Delete /redfish/v1/AccountService/Accounts/test_user
231 ... valid_status_codes=[${HTTP_UNAUTHORIZED}]
232
233
234Test Bmcweb Stability On Continuous Redfish Delete Operation Request Without Session Token
235 [Documentation] Send delete object request without valid session token continuously and
236 ... verify bmcweb stability by sending delete request with valid session token.
237 [Tags] Test_Bmcweb_Stability_On_Continuous_Redfish_Delete_Operation_Request_Without_Session_Token
238
239 @{failed_iter_list}= Create List
240
241 FOR ${iter} IN RANGE ${iterations}
242 Log To Console ${iter}th Redfish Delete Object Request without valid session token
243
244 Run Keyword And Ignore Error
245 ... Redfish.Delete /redfish/v1/AccountService/Accounts/test_user
246 Continue For Loop If ${iter}%100 != 0
247
248 # Every 100th iteration, check delete operation with valid session token.
249 ${status}= Run Keyword And Return Status
250 ... Login And Delete User
251 Run Keyword If '${status}' == 'False' Append To List ${failed_iter_list} ${iter}
252 END
253 Log ${failed_iter_list}
254 ${fail_count}= Get Length ${failed_iter_list}
255 Run Keyword If ${fail_count} > ${0} FAIL Could not do Redfish delete operation ${fail_count} times
256
Prashanth Kattifa699cf2020-04-06 10:13:33 -0500257*** Keywords ***
258
259Login And Configure Hostname
260 [Documentation] Login and configure hostname
George Keishing23afcc52022-04-07 03:18:08 -0500261 [Arguments] ${ethernet_interface_uri}
Prashanth Kattifa699cf2020-04-06 10:13:33 -0500262 [Teardown] Redfish.Logout
263
George Keishing23afcc52022-04-07 03:18:08 -0500264 # Description of argument(s):
265 # ethernet_interface_uri Network interface URI path.
266
Prashanth Kattifa699cf2020-04-06 10:13:33 -0500267 Redfish.Login
268
George Keishing23afcc52022-04-07 03:18:08 -0500269 Redfish.Patch ${ethernet_interface_uri} body={'HostName': '${hostname}'}
Prashanth Kattifa699cf2020-04-06 10:13:33 -0500270 ... valid_status_codes=[${HTTP_OK}, ${HTTP_NO_CONTENT}]
271
Prashanth Katti91e59712020-04-14 08:12:09 -0500272
273Login And Create User
274 [Documentation] Login and create user
275
shrsuman1232b8bfca2021-11-18 05:14:23 -0600276 [Teardown] Run Keywords Redfish.Delete /redfish/v1/AccountService/Accounts/test_user
277 ... AND Redfish.Logout
278
279 Redfish.Login
280
281 ${user_info}= Create Dictionary
282 ... UserName=test_user Password=TestPwd123 RoleId=Operator Enabled=${True}
283 Redfish.Post /redfish/v1/AccountService/Accounts/ body=&{user_info}
284 ... valid_status_codes=[${HTTP_OK}, ${HTTP_CREATED}]
285
286Login And Delete User
287 [Documentation] Login create and delete user
288
Prashanth Katti91e59712020-04-14 08:12:09 -0500289 [Teardown] Redfish.Logout
290
291 Redfish.Login
292
Anvesh Kumar Rayankula3cddd032020-03-26 04:16:13 -0500293 ${user_info}= Create Dictionary
294 ... UserName=test_user Password=TestPwd123 RoleId=Operator Enabled=${True}
295 Redfish.Post /redfish/v1/AccountService/Accounts/ body=&{user_info}
shrsuman1232b8bfca2021-11-18 05:14:23 -0600296 ... valid_status_codes=[${HTTP_OK}, ${HTTP_CREATED}]
297 Redfish.Delete /redfish/v1/AccountService/Accounts/test_user
Anvesh Kumar Rayankula3cddd032020-03-26 04:16:13 -0500298
299Set Account Lockout Threshold
300 [Documentation] Set user account lockout threshold.
301
302 [Teardown] Redfish.Logout
303
304 Redfish.Login
305 Redfish.Patch /redfish/v1/AccountService body=[('AccountLockoutThreshold', 0)]
Prashanth Kattiee26d5e2021-05-21 00:38:31 -0500306
307
308Login to GUI With Incorrect Credentials
George Keishing0aeb54f2022-04-11 10:26:34 -0500309 [Documentation] Attempt to login to GUI as root, providing incorrect password argument.
Prashanth Kattiee26d5e2021-05-21 00:38:31 -0500310
rramyasr-ind1ae7fa2023-02-20 11:00:41 -0600311 Input Text ${xpath_login_username_input} root
312 Input Password ${xpath_login_password_input} incorrect_password
Prashanth Kattiee26d5e2021-05-21 00:38:31 -0500313 Click Button ${xpath_login_button}
shrsuman1232b8bfca2021-11-18 05:14:23 -0600314
315Invalid Credentials Redfish Login Attempts
316 [Documentation] Continuous invalid credentials login attempts to Redfish and
317 ... login to Redfish with valid credentials at times and get failed login attempts.
318 [Arguments] ${login_username}=${OPENBMC_USERNAME} ${login_password}=${OPENBMC_PASSWORD}
319
320 # Description of argument(s):
321 # login_username username for login user.
322 # login_password password for login user.
323
324 @{failed_iter_list}= Create List
325
326 FOR ${iter} IN RANGE ${iterations}
327 Log To Console ${iter}th Redfish login with invalid credentials
328 Run Keyword And Ignore Error Redfish.Login ${login_username} incorrect_password
329 Continue For Loop If ${iter}%100 != 0
330
331 # Every 100th iteration, check Redfish is responsive.
332 ${status}= Run Keyword And Return Status
333 ... Redfish.Login ${login_username} ${login_password}
334 Run Keyword If '${status}' == 'False' Append To List ${failed_iter_list} ${iter}
335 Redfish.Logout
336 END
337 Log ${failed_iter_list}
338 ${fail_count}= Get Length ${failed_iter_list}
339 Run Keyword If ${fail_count} > ${0} FAIL Could not Login to Redfish ${fail_count} times
Gene Ratzlaff05a29c82022-05-13 11:43:25 -0400340
341
342Confirm Ability to Connect Then Close All Connections
343 [Documentation] Confirm that SSH login works, otherwise, skip this test.
344 ... If login succeeds, close all SSH connections to BMC to prepare for test.
345
346 SSHLibrary.Close All Connections
347 SSHLibrary.Open Connection ${OPENBMC_HOST}
348 ${status}= Run Keyword And Return Status
349 ... SSHLibrary.Login ${OPENBMC_USERNAME} ${OPENBMC_PASSWORD}
350 Skip If ${status} == ${False} msg= SSH Login failed: test will be skipped
351 SSHLibrary.Close All Connections