blob: 6eeaff50228ecc8695652e7a4b64edeb547812c6 [file] [log] [blame]
George Keishing78ea2dc2016-11-18 04:33:45 -06001*** Settings ***
2Documentation This module will take whatever action is necessary
3... to bring the BMC to a stable, standby state. For our
4... purposes, a stable state is defined as:
5... - BMC is communicating
6... (pinging, sshing and REST commands working)
7... - Power state is 0 (off)
Rahul Maheshwari2c725042017-01-29 22:55:28 -06008... - BMC state is "Ready"
9... - HOST state is "Off"
George Keishingefc3ff22017-12-12 11:49:25 -060010... - Boot policy is "ALWAYS_POWER_OFF"
George Keishing34d4b8d2016-12-07 08:35:29 -060011... Power cycle system via PDU if specified
George Keishing0bd59f12016-12-14 10:39:21 -060012... Prune archived journal logs
George Keishing78ea2dc2016-11-18 04:33:45 -060013
George Keishing78ea2dc2016-11-18 04:33:45 -060014Resource ../lib/utils.robot
George Keishing34d4b8d2016-12-07 08:35:29 -060015Resource ../lib/pdu/pdu.robot
Rahul Maheshwari9bd3abc2017-02-07 00:51:30 -060016Resource ../lib/state_manager.robot
Michael Walsh1b0ceb22017-05-31 16:03:01 -050017Resource ../lib/bmc_network_utils.robot
Sunil Mec6fe312017-06-19 04:21:25 -050018Resource ../lib/bmc_cleanup.robot
George Keishing27a1f202017-08-30 22:40:26 -050019Resource ../lib/dump_utils.robot
George Keishingcaa718b2019-03-10 00:08:33 -060020Resource ../lib/bmc_redfish_resource.robot
21Resource ../lib/bmc_redfish_utils.robot
George Keishingc7748be2018-07-12 05:40:37 -050022Library ../lib/gen_misc.py
George Keishing78ea2dc2016-11-18 04:33:45 -060023
24*** Variables ***
25${HOST_SETTING} /org/openbmc/settings/host0
26
George Keishingc7748be2018-07-12 05:40:37 -050027${ERROR_REGEX} xyz.openbmc_project.Software.BMC.Updater.service: Failed with result 'core-dump'
28
Gunnar Mills7c8923f2016-12-12 21:19:52 -060029*** Test Cases ***
George Keishing78ea2dc2016-11-18 04:33:45 -060030
George Keishing62f94302017-01-31 07:00:52 -060031Get To Stable State
Rahul Maheshwari2c725042017-01-29 22:55:28 -060032 [Documentation] BMC cleanup drive to stable state
33 ... 1. PDU powercycle if specified
34 ... 1. Ping Test
35 ... 2. SSH Connection session Test
36 ... 3. REST Connection session Test
37 ... 4. Reboot BMC if REST Test failed
38 ... 5. Get BMC in Ready state if its not in this state
39 ... 6. Get Host in Off state if its not in this state
40 ... 7. Update restore policy
Sunil M89fb0f52017-05-26 05:25:33 -050041 ... 8. Verify and Update MAC address.
George Keishing62f94302017-01-31 07:00:52 -060042 [Tags] Get_To_Stable_State
George Keishing78ea2dc2016-11-18 04:33:45 -060043
Rahul Maheshwari2c725042017-01-29 22:55:28 -060044 Run Keyword And Ignore Error Powercycle System Via PDU
George Keishing34d4b8d2016-12-07 08:35:29 -060045
George Keishing13497eb2018-11-07 06:35:14 -060046 ${ping_status}= Run Keyword And Return Status
47 ... Wait For Host To Ping ${OPENBMC_HOST} 2 mins
48
49 # Check if the ping works using 1400 MTU.
50 Run Keyword if ${ping_status} == ${True} MTU Ping Test
51
52 Run Keyword if ${ping_status} == ${False}
53 ... Fail ${OPENBMC_HOST} ping test failed.
54
55 Open Connection And Log In host=${OPENBMC_HOST}
George Keishing78ea2dc2016-11-18 04:33:45 -060056
George Keishing59fa0482017-03-02 10:01:09 -060057 Wait Until Keyword Succeeds
58 ... 1 min 30 sec Initialize OpenBMC
George Keishing78ea2dc2016-11-18 04:33:45 -060059
Rahul Maheshwari9bd3abc2017-02-07 00:51:30 -060060 ${ready_status}= Run Keyword And Return Status Is BMC Ready
61 Run Keyword If '${ready_status}' == '${False}' Put BMC State Ready
George Keishing78ea2dc2016-11-18 04:33:45 -060062
Rahul Maheshwari9bd3abc2017-02-07 00:51:30 -060063 ${host_off_status}= Run Keyword And Return Status Is Host Off
64 Run Keyword If '${host_off_status}' == '${False}' Initiate Host PowerOff
George Keishing78ea2dc2016-11-18 04:33:45 -060065
George Keishing0bd59f12016-12-14 10:39:21 -060066 Prune Journal Log
67
George Keishingefc3ff22017-12-12 11:49:25 -060068 Run Keyword And Ignore Error Set BMC Power Policy ${ALWAYS_POWER_OFF}
George Keishing78ea2dc2016-11-18 04:33:45 -060069
George Keishing6bbce532017-09-21 13:03:55 -050070 # TODO: Enable MAC AES check latter.
71 # Reference : openbmc/openbmc-test-automation#998
72 #Run Keyword If '${MAC_ADDRESS}' != '${EMPTY}'
73 #... Check And Reset MAC
74
75 # TODO: Add new UBI File system cleanup.
76 # Reference : openbmc/openbmc-test-automation#998
77 #${rc}= Execute Command find ${CLEANUP_DIR_PATH}
78 #... return_stdout=False return_rc=True
79 #Run Keyword If '${CLEANUP_DIR_PATH}' != '${EMPTY}' and ${rc} == 0
80 #... Cleanup Dir
Sunil Mec6fe312017-06-19 04:21:25 -050081
Sunil M5dc827d2017-10-17 03:49:31 -050082 Run Keyword And Ignore Error Delete All Error Logs
George Keishingcda2c452020-02-13 09:15:58 -060083 Run Keyword And Ignore Error Redfish Purge Event Log
Sunil M5dc827d2017-10-17 03:49:31 -050084 Run Keyword And Ignore Error Delete All Dumps
George Keishingcaa718b2019-03-10 00:08:33 -060085 Run Keyword And Ignore Error Delete All Redfish Sessions
Charles Paul Hofer7cdb8b42018-09-10 12:12:04 -050086 Check For Current Boot Application Failures
George Keishing78ea2dc2016-11-18 04:33:45 -060087
88*** Keywords ***
89
George Keishing78ea2dc2016-11-18 04:33:45 -060090BMC Online Test
91 [Documentation] BMC ping, SSH, REST connection Test
92
Gunnar Mills597ffa02016-12-06 11:26:53 -060093 ${l_status}= Run Keyword and Return Status
George Keishing78ea2dc2016-11-18 04:33:45 -060094 ... Verify Ping and REST Authentication
95 Run Keyword If '${l_status}' == '${False}'
96 ... Fail msg=System not in ideal state to continue [ERROR]
97
98
George Keishing78ea2dc2016-11-18 04:33:45 -060099Update Policy Setting
100 [Documentation] Update the given restore policy
Gunnar Mills38032802016-12-12 13:43:40 -0600101 [Arguments] ${policy}
George Keishing78ea2dc2016-11-18 04:33:45 -0600102
Gunnar Mills597ffa02016-12-06 11:26:53 -0600103 ${valueDict}= create dictionary data=${policy}
George Keishing78ea2dc2016-11-18 04:33:45 -0600104 Write Attribute ${HOST_SETTING} power_policy data=${valueDict}
105 ${currentPolicy}= Read Attribute ${HOST_SETTING} power_policy
106 Should Be Equal ${currentPolicy} ${policy}
107
George Keishingd5123f72016-12-07 09:54:51 -0600108
109Trigger Warm Reset via Reboot
110 [Documentation] Execute reboot command on the remote BMC and
111 ... returns immediately. This keyword "Start Command"
112 ... returns nothing and does not wait for the command
113 ... execution to be finished.
114 Open Connection And Log In
115
116 Start Command /sbin/reboot
George Keishing34d4b8d2016-12-07 08:35:29 -0600117
118
119Powercycle System Via PDU
Joy Onyerikwuf4a807b2018-06-20 08:43:54 -0500120 [Documentation] AC cycle the system via PDU.
George Keishing34d4b8d2016-12-07 08:35:29 -0600121
122 Validate Parameters
123 PDU Power Cycle
124 Check If BMC is Up 5 min 10 sec
125
126
Charles Paul Hofer7cdb8b42018-09-10 12:12:04 -0500127Check For Current Boot Application Failures
George Keishingc7748be2018-07-12 05:40:37 -0500128 [Documentation] Parse the journal log and check for failures.
129 [Arguments] ${error_regex}=${ERROR_REGEX}
130
131 ${error_regex}= Escape Bash Quotes ${error_regex}
132 ${journal_log} ${stderr} ${rc}= BMC Execute Command
Charles Paul Hoferbcae08b2018-08-09 11:33:33 -0500133 ... journalctl -b --no-pager | egrep '${error_regex}' ignore_err=1
George Keishingc7748be2018-07-12 05:40:37 -0500134
135 Should Be Empty ${journal_log}
136
137
George Keishing34d4b8d2016-12-07 08:35:29 -0600138Validate Parameters
Joy Onyerikwuf4a807b2018-06-20 08:43:54 -0500139 [Documentation] Validate PDU parameters.
George Keishing34d4b8d2016-12-07 08:35:29 -0600140 Should Not Be Empty ${PDU_IP}
141 Should Not Be Empty ${PDU_TYPE}
142 Should Not Be Empty ${PDU_SLOT_NO}
143 Should Not Be Empty ${PDU_USERNAME}
144 Should Not Be Empty ${PDU_PASSWORD}
George Keishing13497eb2018-11-07 06:35:14 -0600145
146
147MTU Ping Test
148 [Documentation] Ping test using MTU.
149 [Arguments] ${mtu}=${1400}
150
151 # Description of argument(s):
152 # mtu The maximum transmission unit (MTU) of a network interface.
153
154 ${rc} ${output}= Run And Return RC And Output
155 ... ping -M do -s ${mtu} -c 10 ${OPENBMC_HOST}
156 Should Be Equal As Integers ${rc} 0
157 Should Not Contain ${output} 100% packet loss