blob: 30aa4d4f8eb27c7a72339ab18565fb8c6c6c6c99 [file] [log] [blame]
Chris Austenb29d2e82016-06-07 12:25:35 -05001*** Settings ***
2Resource ../lib/resource.txt
3Resource ../lib/rest_client.robot
George Keishing5e870cd2016-08-24 10:05:47 -05004Resource ../lib/connection_client.robot
Michael Walsh391ba9b2017-08-24 11:36:24 -05005Library String
George Keishing30c12ff2016-09-02 10:25:29 -05006Library DateTime
7Library Process
Chris Austenb29d2e82016-06-07 12:25:35 -05008Library OperatingSystem
Michael Walsha6723f22016-11-22 11:12:01 -06009Library gen_print.py
10Library gen_robot_print.py
Michael Walsh5f3f4142017-05-22 17:09:47 -050011Library gen_cmd.py
Sunil Macd110a2017-05-23 04:14:32 -050012Library gen_robot_keyword.py
Michael Walshe53e47a2017-06-30 17:03:24 -050013Library bmc_ssh_utils.py
Michael Walshfdc5ced2017-08-17 13:15:15 -050014Library utils.py
Charles Paul Hofer35816152017-10-02 11:55:11 -050015Library var_funcs.py
Sridevi Ramesh0d88ab32017-09-21 11:07:28 -050016Library SCPLibrary WITH NAME scp
Chris Austenb29d2e82016-06-07 12:25:35 -050017
18*** Variables ***
Sivas SRRd97aa9c2017-05-22 11:19:25 -050019${pflash_cmd} /usr/sbin/pflash -r /dev/stdout -P VERSION
Chris Austenb29d2e82016-06-07 12:25:35 -050020${SYSTEM_SHUTDOWN_TIME} ${5}
Michael Walsha6723f22016-11-22 11:12:01 -060021${dbuscmdBase}
George Keishing85ca05e2016-11-30 09:47:18 -060022... dbus-send --system --print-reply --dest=${OPENBMC_BASE_DBUS}.settings.Host
Michael Walsha6723f22016-11-22 11:12:01 -060023${dbuscmdGet}
George Keishing9485af92017-01-04 10:21:43 -060024... ${SETTINGS_URI}host0 org.freedesktop.DBus.Properties.Get
George Keishing85ca05e2016-11-30 09:47:18 -060025# Enable when ready with openbmc/openbmc-test-automation#203
26#${dbuscmdString}= string:"xyz.openbmc_project.settings.Host" string:
Michael Walsha6723f22016-11-22 11:12:01 -060027${dbuscmdString}= string:"org.openbmc.settings.Host" string:
28
29# Assign default value to QUIET for programs which may not define it.
30${QUIET} ${0}
Sivas SRRea85d1f2016-11-13 22:44:28 -060031${bmc_mem_free_cmd}= free | tr -s ' ' | sed '/^Mem/!d' | cut -d" " -f4
32${bmc_mem_total_cmd}= free | tr -s ' ' | sed '/^Mem/!d' | cut -d" " -f2
33${bmc_cpu_usage_cmd}= top -n 1 | grep CPU: | cut -c 7-9
Sridevi Ramesh1699d372016-12-06 00:20:22 -060034${HOST_SETTING} ${SETTINGS_URI}host0
Sivas SRR352bc162017-02-13 22:12:29 -060035# /run/initramfs/ro associate filesystem should be 100% full always
Sivas SRRaca55712016-12-21 04:32:35 -060036${bmc_file_system_usage_cmd}=
Sivas SRR352bc162017-02-13 22:12:29 -060037... df -h | grep -v /run/initramfs/ro | cut -c 52-54 | grep 100 | wc -l
Chris Austenb29d2e82016-06-07 12:25:35 -050038
George Keishingcce9df22017-01-24 06:19:33 -060039${BOOT_TIME} ${0}
40${BOOT_COUNT} ${0}
Sweta Potthuri025e0122017-02-21 00:42:48 -060041${count} ${0}
Sivas SRR8254db62017-02-07 09:39:46 -060042${devicetree_base} /sys/firmware/devicetree/base/model
George Keishingcce9df22017-01-24 06:19:33 -060043
George Keishingb7c9b542017-05-23 08:19:58 -050044# Initialize default debug value to 0.
45${DEBUG} ${0}
46
Michael Walshfdc5ced2017-08-17 13:15:15 -050047# These variables are used to straddle between new and old methods of setting
48# values.
Michael Walshc972d4d2017-08-16 15:38:03 -050049${boot_prog_method} ${EMPTY}
50
Michael Walshfdc5ced2017-08-17 13:15:15 -050051${power_policy_setup} ${0}
52${bmc_power_policy_method} ${EMPTY}
53@{valid_power_policy_vars} RESTORE_LAST_STATE ALWAYS_POWER_ON
54... ALWAYS_POWER_OFF
55
Sridevi Ramesh0d88ab32017-09-21 11:07:28 -050056${probe_cpu_tool_path} ${EXECDIR}/tools/ras/probe_cpus.sh
57${scom_addrs_tool_path} ${EXECDIR}/tools/ras/scom_addr_p9.sh
58${target_file_path} /root/
59
Chris Austenb29d2e82016-06-07 12:25:35 -050060*** Keywords ***
Sridevi Ramesh1699d372016-12-06 00:20:22 -060061
Sivas SRRc0957412017-10-06 13:02:08 -050062Check BMC Performance
63 [Documentation] Check BMC basic CPU Mem File system performance.
64
65 Check BMC CPU Performance
66 Check BMC Mem Performance
67 Check BMC File System Performance
68
Sivas SRRd97aa9c2017-05-22 11:19:25 -050069Verify PNOR Update
70 [Documentation] Verify that the PNOR is not corrupted.
71 # Example:
72 # FFS: Flash header not found. Code: 100
73 # Error 100 opening ffs !
74
75 Open Connection And Log In
76 ${pnor_info}= Execute Command On BMC ${pflash_cmd}
77 Should Not Contain Any ${pnor_info} Flash header not found Error
78
Sivas SRR8254db62017-02-07 09:39:46 -060079Get BMC System Model
80 [Documentation] Get the BMC model from the device tree.
81
Michael Walshe53e47a2017-06-30 17:03:24 -050082 ${bmc_model} ${stderr} ${rc}= BMC Execute Command
George Keishing90ab1772017-02-24 05:40:55 -060083 ... cat ${devicetree_base} | cut -d " " -f 1 return_stderr=True
Sivas SRR8254db62017-02-07 09:39:46 -060084 Should Be Empty ${stderr}
85 Should Not Be Empty ${bmc_model}
86 [Return] ${bmc_model}
87
88Verify BMC System Model
89 [Documentation] Verify the BMC model with ${OPENBMC_MODEL}.
90 [Arguments] ${bmc_model}
91
92 ${tmp_bmc_model}= Fetch From Right ${OPENBMC_MODEL} /
93 ${tmp_bmc_model}= Fetch From Left ${tmp_bmc_model} .
94 ${ret}= Run Keyword And Return Status Should Contain ${bmc_model}
95 ... ${tmp_bmc_model} ignore_case=True
96 [Return] ${ret}
97
Chris Austenb29d2e82016-06-07 12:25:35 -050098Wait For Host To Ping
root442f0ef2016-08-04 20:23:05 +000099 [Arguments] ${host} ${timeout}=${OPENBMC_REBOOT_TIMEOUT}min
100 ... ${interval}=5 sec
101
102 # host The DNS name or IP of the host to ping.
103 # timeout The amount of time after which attempts to ping cease.
104 # interval The amount of time in between attempts to ping.
105
106 Wait Until Keyword Succeeds ${timeout} ${interval} Ping Host ${host}
Chris Austenb29d2e82016-06-07 12:25:35 -0500107
108Ping Host
109 [Arguments] ${host}
George Keishing8a84f952016-08-25 04:54:53 -0500110 Should Not Be Empty ${host} msg=No host provided
Michael Walsha6723f22016-11-22 11:12:01 -0600111 ${RC} ${output}= Run and return RC and Output ping -c 4 ${host}
Chris Austenb29d2e82016-06-07 12:25:35 -0500112 Log RC: ${RC}\nOutput:\n${output}
113 Should be equal ${RC} ${0}
114
115Get Boot Progress
Michael Walshc972d4d2017-08-16 15:38:03 -0500116 [Documentation] Get the boot progress and return it.
Michael Walsha6723f22016-11-22 11:12:01 -0600117 [Arguments] ${quiet}=${QUIET}
118
Michael Walshc972d4d2017-08-16 15:38:03 -0500119 # Description of argument(s):
120 # quiet Indicates whether this keyword should run without any output to
121 # the console.
122
123 Set Boot Progress Method
124 ${state}= Run Keyword If '${boot_prog_method}' == 'New'
125 ... New Get Boot Progress quiet=${quiet}
126 ... ELSE
127 ... Old Get Boot Progress quiet=${quiet}
128
129 [Return] ${state}
130
131Set Boot Progress Method
132 [Documentation] Set the boot_prog_method to either 'Old' or 'New'.
133
134 # The boot progress data has moved from an 'org' location to an 'xyz'
135 # location. This keyword will determine whether the new method of getting
136 # the boot progress is valid and will set the global boot_prog_method
137 # variable accordingly. If boot_prog_method is already set (either by a
138 # prior call to this function or via a -v parm), this keyword will simply
139 # return.
140
Michael Walsh98d8c9e2017-10-04 12:24:29 -0500141 # Note: There are interim builds that contain boot_progress in both the
142 # old and the new location values. It is nearly impossible for this
143 # keyword to determine whether the old boot_progress or the new one is
144 # active. When using such builds where the old boot_progress is active,
145 # the only recourse users will have is that they may specify
146 # -v boot_prog_method:Old to force old behavior on such builds.
Michael Walshc972d4d2017-08-16 15:38:03 -0500147
148 Run Keyword If '${boot_prog_method}' != '${EMPTY}' Return From Keyword
149
150 ${new_status} ${new_value}= Run Keyword And Ignore Error
151 ... New Get Boot Progress
152 # If the new style read fails, the method must necessarily be "Old".
153 Run Keyword If '${new_status}' == 'PASS'
154 ... Run Keywords
155 ... Set Global Variable ${boot_prog_method} New AND
156 ... Rqpvars boot_prog_method AND
157 ... Return From Keyword
158
159 # Default method is "Old".
160 Set Global Variable ${boot_prog_method} Old
161 Rqpvars boot_prog_method
162
163Old Get Boot Progress
164 [Documentation] Get the boot progress the old way (via org location).
165 [Arguments] ${quiet}=${QUIET}
166
167 # Description of argument(s):
168 # quiet Indicates whether this keyword should run without any output to
169 # the console.
170
George Keishing85ca05e2016-11-30 09:47:18 -0600171 ${state}= Read Attribute ${OPENBMC_BASE_URI}sensors/host/BootProgress
Michael Walsha6723f22016-11-22 11:12:01 -0600172 ... value quiet=${quiet}
Michael Walshc972d4d2017-08-16 15:38:03 -0500173
Gunnar Millsc9ea9362016-12-13 16:21:13 -0600174 [Return] ${state}
Chris Austenb29d2e82016-06-07 12:25:35 -0500175
Michael Walshc972d4d2017-08-16 15:38:03 -0500176New Get Boot Progress
177 [Documentation] Get the boot progress the new way (via xyz location).
178 [Arguments] ${quiet}=${QUIET}
179
180 # Description of argument(s):
181 # quiet Indicates whether this keyword should run without any output to
182 # the console.
183
184 ${state}= Read Attribute ${HOST_STATE_URI} BootProgress quiet=${quiet}
185
186 [Return] ${state.rsplit('.', 1)[1]}
187
Chris Austenb29d2e82016-06-07 12:25:35 -0500188Is Power On
root442f0ef2016-08-04 20:23:05 +0000189 ${state}= Get Power State
190 Should be equal ${state} ${1}
Chris Austenb29d2e82016-06-07 12:25:35 -0500191
192Is Power Off
root442f0ef2016-08-04 20:23:05 +0000193 ${state}= Get Power State
194 Should be equal ${state} ${0}
Chris Austenb29d2e82016-06-07 12:25:35 -0500195
root442f0ef2016-08-04 20:23:05 +0000196Initiate Power On
197 [Documentation] Initiates the power on and waits until the Is Power On
198 ... keyword returns that the power state has switched to on.
Michael Walsha6723f22016-11-22 11:12:01 -0600199 [Arguments] ${wait}=${1}
200
Chris Austenb29d2e82016-06-07 12:25:35 -0500201 @{arglist}= Create List
202 ${args}= Create Dictionary data=@{arglist}
George Keishing85ca05e2016-11-30 09:47:18 -0600203 ${resp}= Call Method ${OPENBMC_BASE_URI}control/chassis0/ powerOn
Michael Walsha6723f22016-11-22 11:12:01 -0600204 ... data=${args}
Chris Austenb29d2e82016-06-07 12:25:35 -0500205 should be equal as strings ${resp.status_code} ${HTTP_OK}
Chris Austenb29d2e82016-06-07 12:25:35 -0500206
Michael Walsha6723f22016-11-22 11:12:01 -0600207 # Does caller want to wait for power on status?
208 Run Keyword If '${wait}' == '${0}' Return From Keyword
209 Wait Until Keyword Succeeds 3 min 10 sec Is Power On
Rahul Maheshwarif684ba72016-10-25 07:24:41 -0500210
root442f0ef2016-08-04 20:23:05 +0000211Initiate Power Off
212 [Documentation] Initiates the power off and waits until the Is Power Off
213 ... keyword returns that the power state has switched to off.
Chris Austenb29d2e82016-06-07 12:25:35 -0500214 @{arglist}= Create List
215 ${args}= Create Dictionary data=@{arglist}
George Keishing85ca05e2016-11-30 09:47:18 -0600216 ${resp}= Call Method ${OPENBMC_BASE_URI}control/chassis0/ powerOff
Michael Walsha6723f22016-11-22 11:12:01 -0600217 ... data=${args}
Chris Austenb29d2e82016-06-07 12:25:35 -0500218 should be equal as strings ${resp.status_code} ${HTTP_OK}
Michael Walsha6723f22016-11-22 11:12:01 -0600219 Wait Until Keyword Succeeds 1 min 10 sec Is Power Off
Chris Austenb29d2e82016-06-07 12:25:35 -0500220
Michael Walsh81843772017-03-02 14:44:44 -0600221Initiate OS Host Power Off
222 [Documentation] Initiate an OS reboot.
223 [Arguments] ${os_host}=${OS_HOST} ${os_username}=${OS_USERNAME}
224 ... ${os_password}=${OS_PASSWORD}
225
226 # Description of arguments:
227 # os_host The DNS name or IP of the OS.
228 # os_username The username to be used to sign in to the OS.
229 # os_password The password to be used to sign in to the OS.
230
Michael Walsh4549cd12017-09-07 18:02:36 -0500231 ${cmd_buf}= Run Keyword If '${os_username}' == 'root'
232 ... Set Variable shutdown
233 ... ELSE
234 ... Set Variable echo ${os_password} | sudo -S shutdown
235
236 ${output} ${stderr} ${rc}= OS Execute Command
237 ... ${cmd_buf} fork=${1}
Michael Walsh81843772017-03-02 14:44:44 -0600238
239Initiate OS Host Reboot
240 [Documentation] Initiate an OS reboot.
241 [Arguments] ${os_host}=${OS_HOST} ${os_username}=${OS_USERNAME}
242 ... ${os_password}=${OS_PASSWORD}
243
Michael Walshf1a59fb2017-09-01 17:07:13 -0500244 # Description of argument(s):
245 # os_host The host name or IP address of the OS.
Michael Walsh81843772017-03-02 14:44:44 -0600246 # os_username The username to be used to sign in to the OS.
247 # os_password The password to be used to sign in to the OS.
248
Michael Walshf1a59fb2017-09-01 17:07:13 -0500249 ${cmd_buf}= Run Keyword If '${os_username}' == 'root'
250 ... Set Variable reboot
251 ... ELSE
252 ... Set Variable echo ${os_password} | sudo -S reboot
253
254 ${output} ${stderr} ${rc}= OS Execute Command
255 ... ${cmd_buf} fork=${1}
Michael Walsh81843772017-03-02 14:44:44 -0600256
257Initiate Auto Reboot
258 [Documentation] Initiate an auto reboot.
259
260 # Set the auto reboot policy.
Sweta Potthuri62a23572017-07-28 04:05:13 -0500261 Set Auto Reboot ${1}
Michael Walsh81843772017-03-02 14:44:44 -0600262 # Set the watchdog timer. Note: 5000 = milliseconds which is 5 seconds.
George Keishing37cfa6b2017-06-15 10:25:55 -0500263 Trigger Host Watchdog Error 5000
Michael Walsh81843772017-03-02 14:44:44 -0600264
Chris Austenb29d2e82016-06-07 12:25:35 -0500265Trigger Warm Reset
266 log to console "Triggering warm reset"
Michael Walsha6723f22016-11-22 11:12:01 -0600267 ${data}= create dictionary data=@{EMPTY}
George Keishing85ca05e2016-11-30 09:47:18 -0600268 ${resp}= openbmc post request
269 ... ${OPENBMC_BASE_URI}control/bmc0/action/warmReset data=${data}
Chris Austenb29d2e82016-06-07 12:25:35 -0500270 Should Be Equal As Strings ${resp.status_code} ${HTTP_OK}
George Keishingb3700812016-08-31 03:03:30 -0500271 ${session_active}= Check If warmReset is Initiated
272 Run Keyword If '${session_active}' == '${True}'
273 ... Fail msg=warm reset didn't occur
274
Chris Austenb29d2e82016-06-07 12:25:35 -0500275 Sleep ${SYSTEM_SHUTDOWN_TIME}min
Rahul Maheshwari5f253c42017-01-30 05:19:51 -0600276 Check If BMC Is Up
Michael Walsh49ab0f42016-07-20 11:44:33 -0500277
278Check OS
root442f0ef2016-08-04 20:23:05 +0000279 [Documentation] Attempts to ping the host OS and then checks that the host
280 ... OS is up by running an SSH command.
Michael Walsh49ab0f42016-07-20 11:44:33 -0500281
282 [Arguments] ${os_host}=${OS_HOST} ${os_username}=${OS_USERNAME}
Michael Walsha6723f22016-11-22 11:12:01 -0600283 ... ${os_password}=${OS_PASSWORD} ${quiet}=${QUIET}
284 ... ${print_string}=${EMPTY}
Michael Walshac275512017-03-07 11:39:28 -0600285 [Teardown] SSHLibrary.Close Connection
Michael Walsh49ab0f42016-07-20 11:44:33 -0500286
287 # os_host The DNS name/IP of the OS host associated with our BMC.
288 # os_username The username to be used to sign on to the OS host.
289 # os_password The password to be used to sign on to the OS host.
Michael Walsha6723f22016-11-22 11:12:01 -0600290 # quiet Indicates whether this keyword should write to console.
291 # print_string A string to be printed before checking the OS.
292
293 rprint ${print_string}
Michael Walsh49ab0f42016-07-20 11:44:33 -0500294
root442f0ef2016-08-04 20:23:05 +0000295 # Attempt to ping the OS. Store the return code to check later.
296 ${ping_rc}= Run Keyword and Return Status Ping Host ${os_host}
297
Michael Walshac275512017-03-07 11:39:28 -0600298 SSHLibrary.Open connection ${os_host}
Michael Walsh49ab0f42016-07-20 11:44:33 -0500299
Michael Walsha6723f22016-11-22 11:12:01 -0600300 ${status} ${msg}= Run Keyword And Ignore Error Login ${os_username}
301 ... ${os_password}
302 ${err_msg1}= Sprint Error ${msg}
303 ${err_msg}= Catenate SEPARATOR= \n ${err_msg1}
304 Run Keyword If '${status}' == 'FAIL' Fail msg=${err_msg}
Michael Walsh49ab0f42016-07-20 11:44:33 -0500305 ${output} ${stderr} ${rc}= Execute Command uptime return_stderr=True
306 ... return_rc=True
307
Michael Walsha6723f22016-11-22 11:12:01 -0600308 ${temp_msg}= Catenate Could not execute a command on the operating
309 ... system.\n
310 ${err_msg1}= Sprint Error ${temp_msg}
311 ${err_msg}= Catenate SEPARATOR= \n ${err_msg1}
312
313 # If the return code returned by "Execute Command" is non-zero, this
314 # keyword will fail.
315 Should Be Equal ${rc} ${0} msg=${err_msg}
Michael Walsh49ab0f42016-07-20 11:44:33 -0500316 # We will likewise fail if there is any stderr data.
317 Should Be Empty ${stderr}
318
Michael Walsha6723f22016-11-22 11:12:01 -0600319 ${temp_msg}= Set Variable Could not ping the operating system.\n
320 ${err_msg1}= Sprint Error ${temp_msg}
321 ${err_msg}= Catenate SEPARATOR= \n ${err_msg1}
322 # We will likewise fail if the OS did not ping, as we could SSH but not
323 # ping
324 Should Be Equal As Strings ${ping_rc} ${TRUE} msg=${err_msg}
root442f0ef2016-08-04 20:23:05 +0000325
Michael Walsh49ab0f42016-07-20 11:44:33 -0500326Wait for OS
327 [Documentation] Waits for the host OS to come up via calls to "Check OS".
328 [Arguments] ${os_host}=${OS_HOST} ${os_username}=${OS_USERNAME}
329 ... ${os_password}=${OS_PASSWORD} ${timeout}=${OS_WAIT_TIMEOUT}
Michael Walsha6723f22016-11-22 11:12:01 -0600330 ... ${quiet}=${0}
331 [Teardown] rprintn
Michael Walsh49ab0f42016-07-20 11:44:33 -0500332
333 # os_host The DNS name or IP of the OS host associated with our
334 # BMC.
335 # os_username The username to be used to sign on to the OS host.
336 # os_password The password to be used to sign on to the OS host.
337 # timeout The timeout in seconds indicating how long you're
338 # willing to wait for the OS to respond.
Michael Walsha6723f22016-11-22 11:12:01 -0600339 # quiet Indicates whether this keyword should write to console.
Michael Walsh49ab0f42016-07-20 11:44:33 -0500340
341 # The interval to be used between calls to "Check OS".
342 ${interval}= Set Variable 5
343
Michael Walsha6723f22016-11-22 11:12:01 -0600344 ${message}= Catenate Checking every ${interval} seconds for up to
345 ... ${timeout} seconds for the operating system to communicate.
346 rqprint_timen ${message}
347
Michael Walsh49ab0f42016-07-20 11:44:33 -0500348 Wait Until Keyword Succeeds ${timeout} sec ${interval} Check OS
349 ... ${os_host} ${os_username} ${os_password}
Michael Walsha6723f22016-11-22 11:12:01 -0600350 ... print_string=\#
351
352 rqprintn
353
354 rqprint_timen The operating system is now communicating.
root442f0ef2016-08-04 20:23:05 +0000355
root442f0ef2016-08-04 20:23:05 +0000356
357Get Power State
358 [Documentation] Returns the power state as an integer. Either 0 or 1.
Michael Walsha6723f22016-11-22 11:12:01 -0600359 [Arguments] ${quiet}=${QUIET}
360
root442f0ef2016-08-04 20:23:05 +0000361 @{arglist}= Create List
362 ${args}= Create Dictionary data=@{arglist}
Michael Walsha6723f22016-11-22 11:12:01 -0600363
George Keishing85ca05e2016-11-30 09:47:18 -0600364 ${resp}= Call Method ${OPENBMC_BASE_URI}control/chassis0/ getPowerState
Michael Walsha6723f22016-11-22 11:12:01 -0600365 ... data=${args} quiet=${quiet}
root442f0ef2016-08-04 20:23:05 +0000366 Should be equal as strings ${resp.status_code} ${HTTP_OK}
367 ${content}= to json ${resp.content}
Gunnar Millsc9ea9362016-12-13 16:21:13 -0600368 [Return] ${content["data"]}
Jay Azurine4c52eb2016-08-16 20:51:10 -0500369
370Clear BMC Record Log
371 [Documentation] Clears all the event logs on the BMC. This would be
372 ... equivalent to ipmitool sel clear.
373 @{arglist}= Create List
374 ${args}= Create Dictionary data=@{arglist}
George Keishing85ca05e2016-11-30 09:47:18 -0600375 ${resp}= Call Method
376 ... ${OPENBMC_BASE_URI}records/events/ clear data=${args}
Jay Azurine4c52eb2016-08-16 20:51:10 -0500377 should be equal as strings ${resp.status_code} ${HTTP_OK}
378
379Copy PNOR to BMC
380 Import Library SCPLibrary WITH NAME scp
381 Open Connection for SCP
382 Log Copying ${PNOR_IMAGE_PATH} to /tmp
383 scp.Put File ${PNOR_IMAGE_PATH} /tmp
384
385Flash PNOR
386 [Documentation] Calls flash bios update method to flash PNOR image
Gunnar Mills38032802016-12-12 13:43:40 -0600387 [Arguments] ${pnor_image}
Jay Azurine4c52eb2016-08-16 20:51:10 -0500388 @{arglist}= Create List ${pnor_image}
389 ${args}= Create Dictionary data=@{arglist}
George Keishing85ca05e2016-11-30 09:47:18 -0600390 ${resp}= Call Method ${OPENBMC_BASE_URI}control/flash/bios/ update
Michael Walsha6723f22016-11-22 11:12:01 -0600391 ... data=${args}
Jay Azurine4c52eb2016-08-16 20:51:10 -0500392 should be equal as strings ${resp.status_code} ${HTTP_OK}
393 Wait Until Keyword Succeeds 2 min 10 sec Is PNOR Flashing
394
395Get Flash BIOS Status
396 [Documentation] Returns the status of the flash BIOS API as a string. For
397 ... example 'Flashing', 'Flash Done', etc
George Keishing85ca05e2016-11-30 09:47:18 -0600398 ${data}= Read Properties ${OPENBMC_BASE_URI}control/flash/bios
Gunnar Millsc9ea9362016-12-13 16:21:13 -0600399 [Return] ${data['status']}
Jay Azurine4c52eb2016-08-16 20:51:10 -0500400
401Is PNOR Flashing
402 [Documentation] Get BIOS 'Flashing' status. This indicates that PNOR
403 ... flashing has started.
404 ${status}= Get Flash BIOS Status
Rahul Maheshwari449dfb72017-05-08 02:06:48 -0500405 Should Contain ${status} Flashing
Jay Azurine4c52eb2016-08-16 20:51:10 -0500406
407Is PNOR Flash Done
408 [Documentation] Get BIOS 'Flash Done' status. This indicates that the
409 ... PNOR flashing has completed.
Leah McNutt9ba32272016-11-17 15:48:39 +0000410 ${status}= Get Flash BIOS Status
Jay Azurine4c52eb2016-08-16 20:51:10 -0500411 should be equal as strings ${status} Flash Done
412
George Keishing5e870cd2016-08-24 10:05:47 -0500413
Rahul Maheshwari2c725042017-01-29 22:55:28 -0600414Is OS Starting
415 [Documentation] Check if boot progress is OS starting.
416 ${boot_progress}= Get Boot Progress
Michael Walsh01975fa2017-08-20 20:51:36 -0500417 Should Be Equal ${boot_progress} OSStart
Rahul Maheshwari2c725042017-01-29 22:55:28 -0600418
George Keishing0af24412017-03-10 13:33:23 -0600419Is OS Off
420 [Documentation] Check if boot progress is "Off".
421 ${boot_progress}= Get Boot Progress
422 Should Be Equal ${boot_progress} Off
423
Rahul Maheshwariffd30de2017-06-27 05:57:45 -0500424Get Boot Progress To OS Starting State
425 [Documentation] Get the system to a boot progress state of 'FW Progress,
426 ... Starting OS'.
427
428 ${boot_progress}= Get Boot Progress
Michael Walsh01975fa2017-08-20 20:51:36 -0500429 Run Keyword If '${boot_progress}' == 'OSStart'
Rahul Maheshwariffd30de2017-06-27 05:57:45 -0500430 ... Log Host is already in OS starting state
431 ... ELSE
432 ... Run Keywords Initiate Host PowerOff AND Initiate Host Boot
433 ... AND Wait Until Keyword Succeeds 10 min 10 sec Is OS Starting
434
George Keishing5e870cd2016-08-24 10:05:47 -0500435Verify Ping and REST Authentication
Michael Walsha6723f22016-11-22 11:12:01 -0600436 ${l_ping}= Run Keyword And Return Status
George Keishing5e870cd2016-08-24 10:05:47 -0500437 ... Ping Host ${OPENBMC_HOST}
George Keishingc4d3dc02016-09-19 03:45:55 -0500438 Run Keyword If '${l_ping}' == '${False}'
439 ... Fail msg=Ping Failed
George Keishing5e870cd2016-08-24 10:05:47 -0500440
Michael Walsha6723f22016-11-22 11:12:01 -0600441 ${l_rest}= Run Keyword And Return Status
George Keishing5e870cd2016-08-24 10:05:47 -0500442 ... Initialize OpenBMC
George Keishingc4d3dc02016-09-19 03:45:55 -0500443 Run Keyword If '${l_rest}' == '${False}'
444 ... Fail msg=REST Authentication Failed
George Keishing5e870cd2016-08-24 10:05:47 -0500445
446 # Just to make sure the SSH is working for SCP
447 Open Connection And Log In
448 ${system} ${stderr}= Execute Command hostname return_stderr=True
449 Should Be Empty ${stderr}
450
George Keishingc4d3dc02016-09-19 03:45:55 -0500451Check If BMC is Up
452 [Documentation] Wait for Host to be online. Checks every X seconds
453 ... interval for Y minutes and fails if timed out.
454 ... Default MAX timedout is 10 min, interval 10 seconds.
Gunnar Mills38032802016-12-12 13:43:40 -0600455 [Arguments] ${max_timeout}=${OPENBMC_REBOOT_TIMEOUT} min
George Keishingc4d3dc02016-09-19 03:45:55 -0500456 ... ${interval}=10 sec
457
458 Wait Until Keyword Succeeds
459 ... ${max_timeout} ${interval} Verify Ping and REST Authentication
460
George Keishingb3700812016-08-31 03:03:30 -0500461
462Check If warmReset is Initiated
463 [Documentation] Ping would be still alive, so try SSH to connect
464 ... if fails the ports are down indicating reboot
465 ... is in progress
George Keishing3c05d352016-12-13 06:54:50 -0600466
467 # Warm reset adds 3 seconds delay before forcing reboot
468 # To minimize race conditions, we wait for 7 seconds
469 Sleep 7s
George Keishingb3700812016-08-31 03:03:30 -0500470 ${alive}= Run Keyword and Return Status
471 ... Open Connection And Log In
472 Return From Keyword If '${alive}' == '${False}' ${False}
Gunnar Millsc9ea9362016-12-13 16:21:13 -0600473 [Return] ${True}
George Keishingb3700812016-08-31 03:03:30 -0500474
George Keishing06ae4aa2016-08-30 01:41:28 -0500475Flush REST Sessions
476 [Documentation] Removes all the active session objects
477 Delete All Sessions
George Keishingb3700812016-08-31 03:03:30 -0500478
Sivas SRRe1143ae2016-08-26 22:31:02 -0500479Initialize DBUS cmd
480 [Documentation] Initialize dbus string with property string to extract
Gunnar Mills38032802016-12-12 13:43:40 -0600481 [Arguments] ${boot_property}
Michael Walsha6723f22016-11-22 11:12:01 -0600482 ${cmd}= Catenate ${dbuscmdBase} ${dbuscmdGet} ${dbuscmdString}
483 ${cmd}= Catenate ${cmd}${boot_property}
Sivas SRRe1143ae2016-08-26 22:31:02 -0500484 Set Global Variable ${dbuscmd} ${cmd}
485
David Shawba2d2c22017-01-23 16:56:38 -0600486Create OS Console File Path
487 [Documentation] Create OS console file path name and return it.
488 [Arguments] ${log_file_path}=${EMPTY}
George Keishing30c12ff2016-09-02 10:25:29 -0500489
David Shawba2d2c22017-01-23 16:56:38 -0600490 # Description of arguements:
491 # file_path The caller's candidate value. If this value is ${EMPTY}, this
492 # keyword will compose a file path name. Otherwise, this
493 # keyword will use the caller's file_path value. In either
494 # case, the value will be returned.
Gunnar Mills9c760342016-12-08 10:12:06 -0600495
George Keishing3deb7d12017-09-14 07:50:00 -0500496 ${default_file_path}= Catenate /tmp/${OPENBMC_HOST}_os_console.txt
David Shawba2d2c22017-01-23 16:56:38 -0600497 ${log_file_path}= Set Variable If '${log_file_path}' == '${EMPTY}'
498 ... ${default_file_path} ${log_file_path}
Michael Walsh01bd3682017-01-10 11:21:05 -0600499
David Shawba2d2c22017-01-23 16:56:38 -0600500 [Return] ${log_file_path}
Gunnar Mills9c760342016-12-08 10:12:06 -0600501
David Shawba2d2c22017-01-23 16:56:38 -0600502Create OS Console Command String
503 [Documentation] Return a command string to start OS console logging.
Gunnar Mills9c760342016-12-08 10:12:06 -0600504
David Shawba2d2c22017-01-23 16:56:38 -0600505 # First make sure that the ssh_pw program is available.
Michael Walsh98d8c9e2017-10-04 12:24:29 -0500506 ${cmd_buf}= Catenate which ssh_pw 2>/dev/null || find ${EXECDIR} -name 'ssh_pw'
David Shawba2d2c22017-01-23 16:56:38 -0600507 Rdpissuing ${cmd_buf}
508 ${rc} ${output}= Run And Return Rc And Output ${cmd_buf}
509 Rdpvars rc output
Gunnar Mills9c760342016-12-08 10:12:06 -0600510
Michael Walsh98d8c9e2017-10-04 12:24:29 -0500511 Should Be Equal As Integers 0 ${rc} msg=Could not find ssh_pw.
512
513 ${ssh_pw_file_path}= Set Variable ${output}
George Keishingb45d9522017-06-29 04:20:59 -0500514
515 ${cmd_buf}= Catenate ${ssh_pw_file_path} ${OPENBMC_PASSWORD} -p 2200
George Keishing1f9ec7f2017-06-06 08:59:19 -0500516 ... -o "StrictHostKeyChecking no" ${OPENBMC_USERNAME}@${OPENBMC_HOST}
George Keishing30c12ff2016-09-02 10:25:29 -0500517
David Shawba2d2c22017-01-23 16:56:38 -0600518 [Return] ${cmd_buf}
George Keishing30c12ff2016-09-02 10:25:29 -0500519
Michael Walshcadf1342017-08-28 13:49:25 -0500520Get SOL Console Pid
521 [Documentation] Get the pid of the active sol conole job.
522
523 # Find the pid of the active system console logging session (if any).
524 ${search_string}= Create OS Console Command String
525 # At least in some cases, ps output does not show double quotes so we must
526 # replace them in our search string with the regexes to indicate that they
527 # are optional.
528 ${search_string}= Replace String ${search_string} " ["]?
Michael Walshde7551a2017-10-20 10:53:54 -0500529 ${cmd_buf}= Catenate echo $(ps awwo user,pid,cmd | egrep
530 ... '${search_string}' | egrep -v grep | cut -c10-14)
Michael Walshcadf1342017-08-28 13:49:25 -0500531 Rdpissuing ${cmd_buf}
532 ${rc} ${os_con_pid}= Run And Return Rc And Output ${cmd_buf}
533 Rdpvars os_con_pid
534 # If rc is not zero it just means that there is no OS Console process
535 # running.
536
537 [Return] ${os_con_pid}
538
539
George Keishing30c12ff2016-09-02 10:25:29 -0500540Stop SOL Console Logging
David Shawba2d2c22017-01-23 16:56:38 -0600541 [Documentation] Stop system console logging and return log output.
George Keishing72992e42017-06-16 06:42:36 -0500542 [Arguments] ${log_file_path}=${EMPTY}
543 ... ${targ_file_path}=${EXECDIR}${/}logs${/}
Michael Walsh5f3f4142017-05-22 17:09:47 -0500544 ... ${return_data}=${1}
David Shawba2d2c22017-01-23 16:56:38 -0600545
546 # If there are muliple system console processes, they will all be stopped.
547 # If there is no existing log file this keyword will return an error
548 # message to that effect (and write that message to targ_file_path, if
549 # specified).
550 # NOTE: This keyword will not fail if there is no running system console
551 # process.
Michael Walsh01bd3682017-01-10 11:21:05 -0600552
553 # Description of arguments:
David Shawba2d2c22017-01-23 16:56:38 -0600554 # log_file_path The file path that was used to call "Start SOL
555 # Console Logging". See that keyword (above) for details.
556 # targ_file_path If specified, the file path to which the source
557 # file path (i.e. "log_file_path") should be copied.
Michael Walsh5f3f4142017-05-22 17:09:47 -0500558 # return_data If this is set to ${1}, this keyword will return the SOL
559 # data to the caller as a unicode string.
George Keishing30c12ff2016-09-02 10:25:29 -0500560
David Shawba2d2c22017-01-23 16:56:38 -0600561 ${log_file_path}= Create OS Console File Path ${log_file_path}
Michael Walshcadf1342017-08-28 13:49:25 -0500562
563 ${os_con_pid}= Get SOL Console Pid
George Keishing30c12ff2016-09-02 10:25:29 -0500564
David Shawba2d2c22017-01-23 16:56:38 -0600565 ${cmd_buf}= Catenate kill -9 ${os_con_pid}
566 Run Keyword If '${os_con_pid}' != '${EMPTY}' Rdpissuing ${cmd_buf}
567 ${rc} ${output}= Run Keyword If '${os_con_pid}' != '${EMPTY}'
568 ... Run And Return Rc And Output ${cmd_buf}
569 Run Keyword If '${os_con_pid}' != '${EMPTY}' Rdpvars rc output
George Keishing30c12ff2016-09-02 10:25:29 -0500570
Michael Walsh01bd3682017-01-10 11:21:05 -0600571 Run Keyword If '${targ_file_path}' != '${EMPTY}'
David Shawba2d2c22017-01-23 16:56:38 -0600572 ... Run Keyword And Ignore Error
573 ... Copy File ${log_file_path} ${targ_file_path}
George Keishing30c12ff2016-09-02 10:25:29 -0500574
Michael Walsh5f3f4142017-05-22 17:09:47 -0500575 ${output}= Set Variable ${EMPTY}
576 ${loc_quiet}= Evaluate ${debug}^1
577 ${rc} ${output}= Run Keyword If '${return_data}' == '${1}'
Michael Walsh98d8c9e2017-10-04 12:24:29 -0500578 ... Cmd Fnc cat ${log_file_path} 2>/dev/null quiet=${loc_quiet}
579 ... print_output=${0} show_err=${0}
Michael Walsh5f3f4142017-05-22 17:09:47 -0500580
David Shawba2d2c22017-01-23 16:56:38 -0600581 [Return] ${output}
582
583Start SOL Console Logging
584 [Documentation] Start system console log to file.
Michael Walsh5f3f4142017-05-22 17:09:47 -0500585 [Arguments] ${log_file_path}=${EMPTY} ${return_data}=${1}
David Shawba2d2c22017-01-23 16:56:38 -0600586
587 # This keyword will first call "Stop SOL Console Logging". Only then will
588 # it start SOL console logging. The data returned by "Stop SOL Console
589 # Logging" will in turn be returned by this keyword.
590
591 # Description of arguments:
Michael Walsh5f3f4142017-05-22 17:09:47 -0500592 # log_file_path The file path to which system console log data should be
593 # written. Note that this path is taken to be a location
594 # on the machine where this program is running rather than
595 # on the Open BMC system.
596 # return_data If this is set to ${1}, this keyword will return any SOL
597 # data to the caller as a unicode string.
David Shawba2d2c22017-01-23 16:56:38 -0600598
599 ${log_file_path}= Create OS Console File Path ${log_file_path}
600
601 ${log_output}= Stop SOL Console Logging ${log_file_path}
Michael Walsh5f3f4142017-05-22 17:09:47 -0500602 ... return_data=${return_data}
David Shawba2d2c22017-01-23 16:56:38 -0600603
604 # Validate by making sure we can create the file. Problems creating the
605 # file would not be noticed by the subsequent ssh command because we fork
606 # the command.
607 Create File ${log_file_path}
608 ${sub_cmd_buf}= Create OS Console Command String
609 # Routing stderr to stdout so that any startup error text will go to the
610 # output file.
George Keishing8c3c1df2017-09-13 13:50:20 -0500611 # TODO: Doesn't work with tox so reverting temporarily.
Michael Walsh460042e2017-09-05 16:55:49 -0500612 # nohup detaches the process completely from our pty.
George Keishing8c3c1df2017-09-13 13:50:20 -0500613 #${cmd_buf}= Catenate nohup ${sub_cmd_buf} &> ${log_file_path} &
614 ${cmd_buf}= Catenate ${sub_cmd_buf} > ${log_file_path} 2>&1 &
David Shawba2d2c22017-01-23 16:56:38 -0600615 Rdpissuing ${cmd_buf}
616 ${rc} ${output}= Run And Return Rc And Output ${cmd_buf}
617 # Because we are forking this command, we essentially will never get a
618 # non-zero return code or any output.
619 Should Be Equal ${rc} ${0}
620
Michael Walshcadf1342017-08-28 13:49:25 -0500621 Sleep 1
622 ${os_con_pid}= Get SOL Console Pid
623
624 Should Not Be Empty ${os_con_pid}
625
David Shawba2d2c22017-01-23 16:56:38 -0600626 [Return] ${log_output}
George Keishing30c12ff2016-09-02 10:25:29 -0500627
628Get Time Stamp
629 [Documentation] Get the current time stamp data
630 ${cur_time}= Get Current Date result_format=%Y%m%d%H%M%S%f
Sridevi Rameshb96a0c32016-10-19 05:09:52 -0500631 [Return] ${cur_time}
George Keishing30c12ff2016-09-02 10:25:29 -0500632
George Keishing1b150202016-09-29 08:51:58 -0500633
Rahul Maheshwarif684ba72016-10-25 07:24:41 -0500634Start Journal Log
635 [Documentation] Start capturing journal log to a file in /tmp using
636 ... journalctl command. By default journal log is collected
637 ... at /tmp/journal_log else user input location.
638 ... The File is appended with datetime.
639 [Arguments] ${file_path}=/tmp/journal_log
640
641 Open Connection And Log In
642
643 ${cur_time}= Get Time Stamp
644 Set Global Variable ${LOG_TIME} ${cur_time}
645 Start Command
646 ... journalctl -f > ${file_path}-${LOG_TIME}
647 Log Journal Log Started: ${file_path}-${LOG_TIME}
648
David Shawba2d2c22017-01-23 16:56:38 -0600649
Rahul Maheshwarif684ba72016-10-25 07:24:41 -0500650Stop Journal Log
651 [Documentation] Stop journalctl process if its running.
652 ... By default return log from /tmp/journal_log else
653 ... user input location.
654 [Arguments] ${file_path}=/tmp/journal_log
655
656 Open Connection And Log In
657
658 ${rc}=
659 ... Execute Command
660 ... ps ax | grep journalctl | grep -v grep
661 ... return_stdout=False return_rc=True
662
663 Return From Keyword If '${rc}' == '${1}'
664 ... No journal log process running
665
666 ${output} ${stderr}=
667 ... Execute Command killall journalctl
668 ... return_stderr=True
669 Should Be Empty ${stderr}
670
671 ${journal_log} ${stderr}=
672 ... Execute Command
673 ... cat ${file_path}-${LOG_TIME}
674 ... return_stderr=True
675 Should Be Empty ${stderr}
676
677 Log ${journal_log}
678
679 Execute Command rm ${file_path}-${LOG_TIME}
680
681 [Return] ${journal_log}
Rahul Maheshwari757d80c2016-10-17 01:09:55 -0500682
683Mac Address To Hex String
684 [Documentation] Converts MAC address into hex format.
685 ... Example
686 ... Given the following MAC: 00:01:6C:80:02:78
687 ... This keyword will return: 0x00 0x01 0x6C 0x80 0x02 0x78
688 ... Description of arguments:
Michael Walsh01bd3682017-01-10 11:21:05 -0600689 ... i_macaddress MAC address in the following format
690 ... 00:01:6C:80:02:78
Rahul Maheshwari757d80c2016-10-17 01:09:55 -0500691 [Arguments] ${i_macaddress}
692
693 ${mac_hex}= Catenate 0x${i_macaddress.replace(':', ' 0x')}
Gunnar Millsc9ea9362016-12-13 16:21:13 -0600694 [Return] ${mac_hex}
Rahul Maheshwari757d80c2016-10-17 01:09:55 -0500695
696IP Address To Hex String
697 [Documentation] Converts IP address into hex format.
698 ... Example:
699 ... Given the following IP: 10.3.164.100
700 ... This keyword will return: 0xa 0x3 0xa4 0xa0
701 ... Description of arguments:
Michael Walsh01bd3682017-01-10 11:21:05 -0600702 ... i_ipaddress IP address in the following format
703 ... 10.10.10.10
Rahul Maheshwari757d80c2016-10-17 01:09:55 -0500704 [Arguments] ${i_ipaddress}
705
706 @{ip}= Split String ${i_ipaddress} .
707 ${index}= Set Variable ${0}
708
709 :FOR ${item} IN @{ip}
710 \ ${hex}= Convert To Hex ${item} prefix=0x lowercase=yes
711 \ Set List Value ${ip} ${index} ${hex}
712 \ ${index}= Set Variable ${index + 1}
713 ${ip_hex}= Catenate @{ip}
Gunnar Millsc9ea9362016-12-13 16:21:13 -0600714 [Return] ${ip_hex}
Sivas SRRea85d1f2016-11-13 22:44:28 -0600715
716BMC CPU Performance Check
717 [Documentation] Minimal 10% of proc should be free in this instance
718
719 ${bmc_cpu_usage_output} ${stderr}= Execute Command ${bmc_cpu_usage_cmd}
720 ... return_stderr=True
721 Should be empty ${stderr}
722 ${bmc_cpu_percentage}= Fetch From Left ${bmc_cpu_usage_output} %
723 Should be true ${bmc_cpu_percentage} < 90
724
725BMC Mem Performance Check
726 [Documentation] Minimal 10% of memory should be free in this instance
727
728 ${bmc_mem_free_output} ${stderr}= Execute Command ${bmc_mem_free_cmd}
729 ... return_stderr=True
730 Should be empty ${stderr}
731
732 ${bmc_mem_total_output} ${stderr}= Execute Command ${bmc_mem_total_cmd}
733 ... return_stderr=True
734 Should be empty ${stderr}
735
736 ${bmc_mem_percentage}= Evaluate ${bmc_mem_free_output}*100
737 ${bmc_mem_percentage}= Evaluate
738 ... ${bmc_mem_percentage}/${bmc_mem_total_output}
739 Should be true ${bmc_mem_percentage} > 10
740
Sivas SRRaca55712016-12-21 04:32:35 -0600741BMC File System Usage Check
Sivas SRRc0957412017-10-06 13:02:08 -0500742 [Documentation] Check the file system space. 4 file system should be
743 ... 100% full which is expected
744 # Filesystem Size Used Available Use% Mounted on
745 # /dev/root 14.4M 14.4M 0 100% /
746 # /dev/ubiblock0_0 14.4M 14.4M 0 100% /media/rofs-c9249b0e
747 # /dev/ubiblock8_0 19.6M 19.6M 0 100% /media/pnor-ro-8764baa3
748 # /dev/ubiblock4_0 14.4M 14.4M 0 100% /media/rofs-407816c
Sivas SRRaca55712016-12-21 04:32:35 -0600749 ${bmc_fs_usage_output} ${stderr}= Execute Command
750 ... ${bmc_file_system_usage_cmd} return_stderr=True
751 Should Be Empty ${stderr}
Sivas SRRc0957412017-10-06 13:02:08 -0500752 Should Be True ${bmc_fs_usage_output}==4
Sivas SRRaca55712016-12-21 04:32:35 -0600753
Sivas SRRea85d1f2016-11-13 22:44:28 -0600754Check BMC CPU Performance
755 [Documentation] Minimal 10% of proc should be free in 3 sample
756 :FOR ${var} IN Range 1 4
757 \ BMC CPU Performance check
758
759Check BMC Mem Performance
760 [Documentation] Minimal 10% of memory should be free
761
762 :FOR ${var} IN Range 1 4
763 \ BMC Mem Performance check
764
Sivas SRRaca55712016-12-21 04:32:35 -0600765Check BMC File System Performance
766 [Documentation] Check for file system usage for 4 times
767
768 :FOR ${var} IN Range 1 4
769 \ BMC File System Usage check
770
Rahul Maheshwari63c105b2017-05-12 05:13:52 -0500771Get URL List
772 [Documentation] Return list of URLs under given URL.
773 [Arguments] ${openbmc_url}
774 # Description of argument(s):
Michael Walsh5f3f4142017-05-22 17:09:47 -0500775 # openbmc_url URL for list operation (e.g.
776 # /xyz/openbmc_project/inventory).
Rahul Maheshwari63c105b2017-05-12 05:13:52 -0500777
George Keishing335f5362017-06-30 15:11:20 -0500778 ${url_list}= Read Properties ${openbmc_url}/list quiet=${1}
George Keishing184a89a2017-06-27 07:12:16 -0500779 Sort List ${url_list}
Rahul Maheshwari63c105b2017-05-12 05:13:52 -0500780 [Return] ${url_list}
781
Rahul Maheshwari9a8d3b12016-12-05 04:06:16 -0600782Get Endpoint Paths
783 [Documentation] Returns all url paths ending with given endpoint
784 ... Example:
785 ... Given the following endpoint: cpu
Michael Walsh01bd3682017-01-10 11:21:05 -0600786 ... This keyword will return: list of all urls ending with
787 ... cpu -
Rahul Maheshwari9a8d3b12016-12-05 04:06:16 -0600788 ... /org/openbmc/inventory/system/chassis/motherboard/cpu0,
789 ... /org/openbmc/inventory/system/chassis/motherboard/cpu1
790 ... Description of arguments:
791 ... path URL path for enumeration
792 ... endpoint string for which url path ending
793 [Arguments] ${path} ${endpoint}
794
795 ${resp}= Read Properties ${path}/enumerate timeout=30
796 log Dictionary ${resp}
797
798 ${list}= Get Dictionary Keys ${resp}
799 ${resp}= Get Matches ${list} regexp=^.*[0-9a-z_].${endpoint}[0-9]*$
Gunnar Millsc9ea9362016-12-13 16:21:13 -0600800 [Return] ${resp}
Sridevi Rameshb96a0c32016-10-19 05:09:52 -0500801
802Check Zombie Process
803 [Documentation] Check if any defunct process exist or not on BMC
Michael Walsh01bd3682017-01-10 11:21:05 -0600804 ${count} ${stderr} ${rc}= Execute Command ps -o stat | grep Z | wc -l
Sridevi Rameshb96a0c32016-10-19 05:09:52 -0500805 ... return_stderr=True return_rc=True
806 Should Be True ${count}==0
807 Should Be Empty ${stderr}
George Keishing5327d012016-12-08 08:43:29 -0600808
809Prune Journal Log
810 [Documentation] Prune archived journal logs.
811 [Arguments] ${vacuum_size}=1M
812
813 # This keyword can be used to prevent the journal
814 # log from filling up the /run filesystem.
815 # This command will retain only the latest logs
816 # of the user specified size.
817
818 Open Connection And Log In
819 ${output} ${stderr} ${rc}=
820 ... Execute Command
821 ... journalctl --vacuum-size=${vacuum_size}
822 ... return_stderr=True return_rc=True
823
824 Should Be Equal ${rc} ${0} msg=${stderr}
Sridevi Ramesh1699d372016-12-06 00:20:22 -0600825
826Set BMC Power Policy
827 [Documentation] Set the given BMC power policy.
Michael Walshfdc5ced2017-08-17 13:15:15 -0500828 [Arguments] ${policy}
829
830 # Note that this function will translate the old style "RESTORE_LAST_STATE"
831 # policy to the new style "xyz.openbmc_project.Control.Power.RestorePolicy.
832 # Policy.Restore" for you.
Sridevi Ramesh1699d372016-12-06 00:20:22 -0600833
George Keishing1c3a9662017-08-11 10:16:36 -0500834 # Description of argument(s):
Michael Walshfdc5ced2017-08-17 13:15:15 -0500835 # policy Power restore policy (e.g "RESTORE_LAST_STATE",
836 # ${RESTORE_LAST_STATE}).
837
838 # Set the bmc_power_policy_method to either 'Old' or 'New'.
839 Set Power Policy Method
840 # This translation helps bridge between old and new method for calling.
841 ${policy}= Translate Power Policy Value ${policy}
842 # Run the appropriate keyword.
843 Run Key ${bmc_power_policy_method} Set Power Policy \ ${policy}
844 ${currentPolicy}= Get System Power Policy
845 Should Be Equal ${currentPolicy} ${policy}
846
847New Set Power Policy
848 [Documentation] Set the given BMC power policy (new method).
849 [Arguments] ${policy}
850
851 # Description of argument(s):
852 # policy Power restore policy (e.g. ${RESTORE_LAST_STATE}).
George Keishing1c3a9662017-08-11 10:16:36 -0500853
854 ${valueDict}= Create Dictionary data=${policy}
855 Write Attribute
Michael Walshfdc5ced2017-08-17 13:15:15 -0500856 ... ${POWER_RESTORE_URI} PowerRestorePolicy data=${valueDict}
857
858Old Set Power Policy
859 [Documentation] Set the given BMC power policy (old method).
860 [Arguments] ${policy}
861
862 # Description of argument(s):
863 # policy Power restore policy (e.g. "RESTORE_LAST_STATE").
864
865 ${valueDict}= create dictionary data=${policy}
866 Write Attribute ${HOST_SETTING} power_policy data=${valueDict}
George Keishingcce9df22017-01-24 06:19:33 -0600867
George Keishing4d6f3d62017-02-06 09:50:41 -0600868Get System Power Policy
869 [Documentation] Get the BMC power policy.
Michael Walshfdc5ced2017-08-17 13:15:15 -0500870
871 # Set the bmc_power_policy_method to either 'Old' or 'New'.
872 Set Power Policy Method
873 ${cmd_buf}= Create List ${bmc_power_policy_method} Get Power Policy
874 # Run the appropriate keyword.
875 ${currentPolicy}= Run Keyword @{cmd_buf}
876 [Return] ${currentPolicy}
877
878New Get Power Policy
879 [Documentation] Get the BMC power policy (new method).
George Keishing1c3a9662017-08-11 10:16:36 -0500880 ${currentPolicy}= Read Attribute ${POWER_RESTORE_URI} PowerRestorePolicy
George Keishing4d6f3d62017-02-06 09:50:41 -0600881 [Return] ${currentPolicy}
George Keishingcce9df22017-01-24 06:19:33 -0600882
Michael Walshfdc5ced2017-08-17 13:15:15 -0500883Old Get Power Policy
884 [Documentation] Get the BMC power policy (old method).
885 ${currentPolicy}= Read Attribute ${HOST_SETTING} power_policy
886 [Return] ${currentPolicy}
887
Rahul Maheshwari1cbf0042017-02-13 05:17:37 -0600888Get Auto Reboot
889 [Documentation] Returns auto reboot setting.
Sweta Potthuri62a23572017-07-28 04:05:13 -0500890 ${setting}= Read Attribute ${CONTROL_HOST_URI}/auto_reboot AutoReboot
Rahul Maheshwari1cbf0042017-02-13 05:17:37 -0600891 [Return] ${setting}
892
Rahul Maheshwari1cbf0042017-02-13 05:17:37 -0600893Set Auto Reboot
894 [Documentation] Set the given auto reboot setting.
895 [Arguments] ${setting}
Sweta Potthuri62a23572017-07-28 04:05:13 -0500896 # setting auto reboot's setting, i.e. 1 for enabling and 0 for disabling.
Rahul Maheshwari1cbf0042017-02-13 05:17:37 -0600897
898 ${valueDict}= Set Variable ${setting}
899 ${data}= Create Dictionary data=${valueDict}
Sweta Potthuri62a23572017-07-28 04:05:13 -0500900 Write Attribute ${CONTROL_HOST_URI}/auto_reboot AutoReboot data=${data}
Rahul Maheshwari1cbf0042017-02-13 05:17:37 -0600901 ${current_setting}= Get Auto Reboot
Sweta Potthuri62a23572017-07-28 04:05:13 -0500902 Should Be Equal As Integers ${current_setting} ${setting}
Rahul Maheshwari1cbf0042017-02-13 05:17:37 -0600903
904
George Keishingcce9df22017-01-24 06:19:33 -0600905Set BMC Reset Reference Time
906 [Documentation] Set current boot time as a reference and increment
George Keishing80dd5af2017-02-08 07:01:25 -0600907 ... boot count.
George Keishingcce9df22017-01-24 06:19:33 -0600908
909 ${cur_btime}= Get BMC Boot Time
George Keishing80dd5af2017-02-08 07:01:25 -0600910 Run Keyword If ${BOOT_TIME} == ${0} and ${BOOT_COUNT} == ${0}
George Keishingcce9df22017-01-24 06:19:33 -0600911 ... Set Global Variable ${BOOT_TIME} ${cur_btime}
George Keishing80dd5af2017-02-08 07:01:25 -0600912 ... ELSE IF ${cur_btime} > ${BOOT_TIME}
913 ... Run Keywords Set Global Variable ${BOOT_TIME} ${cur_btime}
George Keishingcce9df22017-01-24 06:19:33 -0600914 ... AND
915 ... Set Global Variable ${BOOT_COUNT} ${BOOT_COUNT + 1}
916
George Keishingcce9df22017-01-24 06:19:33 -0600917Get BMC Boot Time
918 [Documentation] Get boot time from /proc/stat.
919
920 Open Connection And Log In
921 ${output} ${stderr}=
922 ... Execute Command egrep '^btime ' /proc/stat | cut -f 2 -d ' '
923 ... return_stderr=True
924 Should Be Empty ${stderr}
925 ${btime}= Convert To Integer ${output}
926 [Return] ${btime}
George Keishingede30002017-02-02 09:33:07 -0600927
George Keishingede30002017-02-02 09:33:07 -0600928Execute Command On BMC
929 [Documentation] Execute given command on BMC and return output.
930 [Arguments] ${command}
931 ${stdout} ${stderr}= Execute Command ${command} return_stderr=True
932 Should Be Empty ${stderr}
933 [Return] ${stdout}
David Shawba2d2c22017-01-23 16:56:38 -0600934
Sridevi Rameshea36b412017-03-09 04:08:02 -0600935
George Keishing7a520222017-02-27 09:44:30 -0600936Enable Core Dump On BMC
937 [Documentation] Enable core dump collection.
938 Open Connection And Log In
939 ${core_pattern}= Execute Command On BMC
940 ... echo '/tmp/core_%e.%p' | tee /proc/sys/kernel/core_pattern
941 Should Be Equal As Strings ${core_pattern} /tmp/core_%e.%p
Rahul Maheshwarie95622c2017-02-24 10:04:29 -0600942
Sivas SRR01262bd2017-03-19 10:00:23 -0500943Get Number Of BMC Core Dump Files
944 [Documentation] Get number of core dump files on BMC.
945 Open Connection And Log In
946 ${num_of_core_dump}= Execute Command
947 ... ls /tmp/core* 2>/dev/null | wc -l
948 [Return] ${num_of_core_dump}
949
950Set Core Dump File Size Unlimited
951 [Documentation] Set core dump file size to unlimited.
952 Open Connection And Log In
953 Execute Command On BMC
954 ... ulimit -c unlimited
955
956Check For Core Dumps
957 [Documentation] Check for any core dumps exist.
958 ${output}= Get Number Of BMC Core Dump Files
959 Run Keyword If ${output} > 0
960 ... Log **Warning** BMC core dump files exist level=WARN
961
Rahul Maheshwarie95622c2017-02-24 10:04:29 -0600962Trigger Host Watchdog Error
George Keishing37cfa6b2017-06-15 10:25:55 -0500963 [Documentation] Inject host watchdog timeout error via REST.
Rahul Maheshwarie95622c2017-02-24 10:04:29 -0600964 [Arguments] ${milliseconds}=1000 ${sleep_time}=5s
Michael Walshb5839d02017-04-12 16:11:20 -0500965 # Description of argument(s):
966 # milliseconds The time watchdog timer value in milliseconds (e.g. 1000 =
967 # 1 second).
Rahul Maheshwarie95622c2017-02-24 10:04:29 -0600968 # sleep_time Time delay for host watchdog error to get injected.
969 # Default is 5 seconds.
970
George Keishing37cfa6b2017-06-15 10:25:55 -0500971 ${data}= Create Dictionary data=${True}
972 Write Attribute /xyz/openbmc_project/watchdog/host0 Enabled data=${data}
973
974 ${data}= Create Dictionary data=${milliseconds}
Michael Walsh98d8c9e2017-10-04 12:24:29 -0500975 Write Attribute /xyz/openbmc_project/watchdog/host0 TimeRemaining
976 ... data=${data}
George Keishing37cfa6b2017-06-15 10:25:55 -0500977
Rahul Maheshwarie95622c2017-02-24 10:04:29 -0600978 Sleep ${sleep_time}
Prashanth Kattiae7c2282017-03-15 07:43:46 -0500979
980Login To OS Host
981 [Documentation] Login to OS Host.
982 [Arguments] ${os_host}=${OS_HOST} ${os_username}=${OS_USERNAME}
983 ... ${os_password}=${OS_PASSWORD}
984 # Desription of arguments:
985 # ${os_host} IP address of the OS Host.
986 # ${os_username} OS Host Login user name.
987 # ${os_password} OS Host Login passwrd.
988
989 ${os_state}= Run Keyword And Return Status Ping Host ${os_host}
990 Run Keyword If '${os_state}' == 'False'
991 ... Run Keywords Initiate Host Reboot AND
992 ... Is Host Running AND
993 ... Wait for OS ${os_host} ${os_username} ${os_password}
994
George Keishing3f223b82017-06-28 03:50:35 -0500995 SSHLibrary.Open Connection ${os_host}
Sridevi Rameshea36b412017-03-09 04:08:02 -0600996 ${resp}= Login ${os_username} ${os_password}
997 [Return] ${resp}
Prashanth Katti884ee062017-03-16 05:05:03 -0500998
999Configure Initial Settings
1000 [Documentation] Restore old IP and route.
1001 ... This keyword requires initial settings viz IP address,
1002 ... Network Mask, default gatway and serial console IP and port
1003 ... information which should be provided in command line.
1004
Michael Walshb5839d02017-04-12 16:11:20 -05001005 [Arguments] ${host}=${OPENBMC_HOST} ${mask}=${NET_MASK}
1006 ... ${gw_ip}=${GW_IP}
Prashanth Katti884ee062017-03-16 05:05:03 -05001007
Michael Walshb5839d02017-04-12 16:11:20 -05001008 # Open telnet connection and ignore the error, in case telnet session is
1009 # already opened by the program calling this keyword.
Prashanth Katti884ee062017-03-16 05:05:03 -05001010
1011 Run Keyword And Ignore Error Open Telnet Connection to BMC Serial Console
1012 Telnet.write ifconfig eth0 ${host} netmask ${mask}
1013 Telnet.write route add default gw ${gw_ip}
George Keishingd05b1082017-03-24 05:27:32 -05001014
1015Install Debug Tarball On BMC
George Keishing55441822017-05-18 14:17:59 -05001016 [Documentation] Copy the debug tar file to BMC and install.
1017 [Arguments] ${tarball_file_path}=${EXECDIR}/obmc-phosphor-debug-tarball-witherspoon.tar.xz
George Keishing5591d332017-09-05 12:57:17 -05001018 ... ${targ_tarball_dir_path}=/tmp/tarball/
George Keishingd05b1082017-03-24 05:27:32 -05001019
George Keishing55441822017-05-18 14:17:59 -05001020 # Description of arguments:
1021 # tarball_file_path Path of the debug tarball file.
1022 # The tar file is downloaded from the build page
1023 # https://openpower.xyz/job/openbmc-build/
1024 # obmc-phosphor-debug-tarball-witherspoon.tar.xz
1025 #
1026 # targ_tarball_dir_path The directory path where the tarball is to be
1027 # installed.
1028
1029 OperatingSystem.File Should Exist ${tarball_file_path}
1030 ... msg=${tarball_file_path} doesn't exist.
1031
1032 # Upload the file to BMC.
George Keishingd05b1082017-03-24 05:27:32 -05001033 Import Library SCPLibrary WITH NAME scp
1034 Open Connection for SCP
George Keishing55441822017-05-18 14:17:59 -05001035 scp.Put File ${tarball_file_path} /tmp/debug-tarball.tar.xz
1036
1037 # Create tarball directory and install.
George Keishing95c371a2017-09-14 15:42:33 -05001038 BMC Execute Command mkdir -p ${targ_tarball_dir_path}
1039 BMC Execute Command
George Keishing55441822017-05-18 14:17:59 -05001040 ... tar -xf /tmp/debug-tarball.tar.xz -C ${targ_tarball_dir_path}
1041
George Keishing95c371a2017-09-14 15:42:33 -05001042 # Remove the tarball file from BMC.
1043 BMC Execute Command rm -f /tmp/debug-tarball.tar.xz
George Keishingd05b1082017-03-24 05:27:32 -05001044
George Keishing55441822017-05-18 14:17:59 -05001045
Sweta Potthuri025e0122017-02-21 00:42:48 -06001046Get BMC Boot Count
1047 [Documentation] Get BMC boot count based on boot time.
1048 ${cur_btime}= Get BMC Boot Time
1049
1050 # Set global variable BOOT_TIME to current boot time if current boot time
1051 # is changed. Also increase value of global variable BOOT_COUNT by 1.
1052 Run Keyword If ${cur_btime} > ${BOOT_TIME}
1053 ... Run Keywords Set Global Variable ${BOOT_TIME} ${cur_btime}
1054 ... AND
1055 ... Set Global Variable ${BOOT_COUNT} ${BOOT_COUNT + 1}
1056 [Return] ${BOOT_COUNT}
1057
1058Set BMC Boot Count
1059 [Documentation] Set BMC boot count to given value.
1060 [Arguments] ${count}
1061
1062 # Description of arguments:
1063 # count boot count value.
1064 ${cur_btime}= Get BMC Boot Time
1065
1066 # Set global variable BOOT_COUNT to given value.
1067 Set Global Variable ${BOOT_COUNT} ${count}
1068
1069 # Set BOOT_TIME variable to current boot time.
1070 Set Global Variable ${BOOT_COUNT} ${count}
Michael Walsh689fbbe2017-04-04 17:58:03 -05001071
Sweta Potthurie5a9fc72017-05-03 07:02:46 -05001072Get System LED State
1073 [Documentation] Return the state of given system LED.
1074 [Arguments] ${led_name}
1075
1076 # Description of argument(s):
1077 # led_name System LED name (e.g. heartbeat, identify, beep).
1078
1079 ${state}= Read Attribute ${LED_PHYSICAL_URI}${led_name} State
1080 [Return] ${state.rsplit('.', 1)[1]}
1081
George Keishing3987a1e2017-09-20 09:13:02 -05001082
George Keishingd2d90af2017-06-27 08:17:34 -05001083Delete Error Logs
Michael Walsh689fbbe2017-04-04 17:58:03 -05001084 [Documentation] Delete error logs.
1085
George Keishingd2d90af2017-06-27 08:17:34 -05001086 # Check if error logs entries exist, if not return.
George Keishing335f5362017-06-30 15:11:20 -05001087 ${resp}= OpenBMC Get Request ${BMC_LOGGING_ENTRY}${/}list quiet=${1}
George Keishingd2d90af2017-06-27 08:17:34 -05001088 Return From Keyword If ${resp.status_code} == ${HTTP_NOT_FOUND}
1089
1090 # Get the list of error logs entries and delete them all.
George Keishing335f5362017-06-30 15:11:20 -05001091 ${elog_entries}= Get URL List ${BMC_LOGGING_ENTRY}
George Keishingd2d90af2017-06-27 08:17:34 -05001092 :FOR ${entry} IN @{elog_entries}
1093 \ Delete Error Log Entry ${entry}
George Keishingdb34c2f2017-04-18 13:20:25 -05001094
George Keishing3987a1e2017-09-20 09:13:02 -05001095
George Keishingd2d90af2017-06-27 08:17:34 -05001096Delete Error Log Entry
George Keishingdb34c2f2017-04-18 13:20:25 -05001097 [Documentation] Delete error log entry.
1098 [Arguments] ${entry_path}
1099
1100 # Description of argument(s):
1101 # entry_path Delete an error log entry.
1102 # Ex. /xyz/openbmc_project/logging/entry/1
1103
George Keishing6a8ed0f2017-07-11 22:54:42 -05001104 # Skip delete if entry URI is a callout.
1105 # Example: /xyz/openbmc_project/logging/entry/1/callout
1106 Return From Keyword If '${entry_path.rsplit('/', 1)[1]}' == 'callout'
1107
George Keishingdb34c2f2017-04-18 13:20:25 -05001108 ${data}= Create Dictionary data=@{EMPTY}
1109 ${resp}= Openbmc Delete Request ${entry_path} data=${data}
1110 Should Be Equal As Strings ${resp.status_code} ${HTTP_OK}
Rahul Maheshwari43be6932017-05-01 02:37:06 -05001111
1112
George Keishingcc71c3c2017-09-20 09:38:03 -05001113Delete All Error Logs
George Keishing3987a1e2017-09-20 09:13:02 -05001114 [Documentation] Delete all error log entries using "DeleteAll" interface.
1115
1116 ${data}= Create Dictionary data=@{EMPTY}
1117 ${resp}= Openbmc Post Request ${BMC_LOGGING_URI}action/DeleteAll
1118 ... data=${data}
1119 Should Be Equal As Strings ${resp.status_code} ${HTTP_OK}
1120
1121
Rahul Maheshwari43be6932017-05-01 02:37:06 -05001122Get LED State XYZ
1123 [Documentation] Returns state of given LED.
1124 [Arguments] ${led_name}
1125 # Description of argument(s):
1126 # led_name Name of LED
1127
1128 ${state}= Read Attribute ${LED_GROUPS_URI}${led_name} Asserted
1129 [Return] ${state}
Rahul Maheshwari13256d92017-06-15 10:05:40 -05001130
1131
1132Get BMC Version
1133 [Documentation] Returns BMC version from /etc/os-release.
1134 ... e.g. "v1.99.6-141-ge662190"
1135
1136 Open Connection And Log In
1137 ${cmd}= Set Variable grep ^VERSION_ID= /etc/os-release | cut -f 2 -d '='
1138 ${output}= Execute Command On BMC ${cmd}
1139 [Return] ${output}
1140
George Keishingad5817a2017-06-28 10:19:03 -05001141
Charles Paul Hofere43fb2f2017-09-26 15:36:18 -05001142Get PNOR Version
1143 [Documentation] Get the PNOR version from the BMC.
1144
1145 ${pnor_attrs}= Get PNOR Attributes
1146 [Return] ${pnor_attrs['version']}
1147
1148
1149Get PNOR Attributes
1150 [Documentation] Return PNOR software attributes as a dictionary.
1151
Michael Walsh98d8c9e2017-10-04 12:24:29 -05001152 # This keyword parses /var/lib/phosphor-software-manager/pnor/ro/pnor.toc
1153 # into key/value pairs.
Charles Paul Hofere43fb2f2017-09-26 15:36:18 -05001154
1155 ${outbuf} ${stderr} ${rc}= BMC Execute Command
1156 ... cat /var/lib/phosphor-software-manager/pnor/ro/pnor.toc
1157 ${pnor_attrs}= Key Value Outbuf To Dict ${outbuf} delim==
1158
1159 [Return] ${pnor_attrs}
1160
1161
George Keishingad5817a2017-06-28 10:19:03 -05001162Get Elog URL List
1163 [Documentation] Return error log entry list of URLs.
1164
1165 ${url_list}= Read Properties /xyz/openbmc_project/logging/entry/
1166 Sort List ${url_list}
1167 [Return] ${url_list}
1168
1169
Steven Sombaraaf72c42017-09-05 12:02:00 -05001170Read Turbo Setting Via REST
1171 [Documentation] Return turbo setting via REST.
1172
1173 ${resp}= OpenBMC Get Request ${SENSORS_URI}host/TurboAllowed
1174 ${jsondata}= To JSON ${resp.content}
1175 Should Be Equal As Strings ${resp.status_code} ${HTTP_OK}
1176 [Return] ${jsondata["data"]["value"]}
1177
1178
Steven Sombaraaf72c42017-09-05 12:02:00 -05001179Set Turbo Setting Via REST
1180 [Documentation] Set turbo setting via REST.
1181 [Arguments] ${setting}
1182 # Description of argument(s):
1183 # setting Value which needs to be set.(i.e. False or True)
1184
1185 ${valueDict}= Create Dictionary data=${setting}
1186 Write Attribute ${SENSORS_URI}host/TurboAllowed value data=${valueDict}
George Keishingef74a8c2017-10-20 10:23:52 -05001187
George Keishingef74a8c2017-10-20 10:23:52 -05001188Set Control Boot Mode
1189 [Documentation] Set given boot mode on the boot object path attribute.
1190 [Arguments] ${boot_path} ${boot_mode}
1191
1192 # Description of argument(s):
1193 # boot_path Boot object path.
1194 # Example:
1195 # /xyz/openbmc_project/control/host0/boot
1196 # /xyz/openbmc_project/control/host0/boot/one_time
1197 # boot_mode Boot mode which need to be set.
1198 # Example:
1199 # "xyz.openbmc_project.Control.Boot.Mode.Modes.Regular"
1200
1201 ${valueDict}= Create Dictionary data=${boot_mode}
1202 Write Attribute ${boot_path} BootMode data=${valueDict}
Sridevi Ramesh0d88ab32017-09-21 11:07:28 -05001203
1204Copy Address Translation Utils To HOST OS
1205 [Documentation] Copy address translation utils to host OS.
1206
1207 OperatingSystem.File Should Exist ${probe_cpu_tool_path}
1208 ... msg=${probe_cpu_tool_path} doesn't exist.
1209 OperatingSystem.File Should Exist ${probe_cpu_tool_path}
1210 ... msg=${probe_cpu_tool_path} doesn't exist.
1211
1212 scp.Open connection ${OS_HOST} username=${OS_USERNAME}
1213 ... password=${OS_PASSWORD}
1214 scp.Put File ${probe_cpu_tool_path} ${target_file_path}
1215 scp.Put File ${scom_addrs_tool_path} ${target_file_path}