Author: Andrew Geissler (geissonator)
Primary assignee: Andrew Geissler (geissonator)
Other contributors:
Created: October 11th, 2021
Modern computer systems have a feature, automated power-on recovery, which in essence is the ability to tell your system what to do when it hits issues with power to the system. If the system had a black out (i.e. power was completely cut to the system), should it automatically power the system on? Should it leave it off? Or maybe the user would like the system to go to whichever state it was at before the power loss.
There are also instances where the user may not want automatic power recovery to occur. For example, some systems have op-panels, and on these op-panels there can be a pin hole reset. This is a manual mechanism for the user to force a hard reset to the BMC in situations where it is hung or not responding. In these situations, the user may wish for the system to not automatically power on the system, because they want to debug the reason for the BMC error.
The goal of this design document is to describe how OpenBMC firmware will deal with these questions.
The BMC already implements a limited subset of function in this area. The PowerRestorePolicy property out in phosphor-dbus-interface defines the function capability.
In smaller servers, this feature is commonly found within the Advanced Configuration and Power Interface (ACPI).
openbmc/phosphor-state-manager supports this property as defined in the phosphor-dbus-interface.
Future updates to this document will touch on more complex scenarios like brown outs (chassis power loss but BMC remains on), handling of external uninterrupted power devices (UPS), and enhanced tracking of the different types of errors that can occur in this area on systems.
OpenBMC software must ensure it persists the state of power to the chassis so it can know what to restore it to if necessary
OpenBMC software must provide support for the following options:
These options are only checked and enforced in situations where the BMC does not detect that chassis power is already on to the system when it comes out of reboot.
OpenBMC software must also support the concept of a one_time power restore policy. This is a separate instance of the PowerRestorePolicy
which will be hosted under a D-Bus object path which ends with "one_time". If this one_time setting is not the default, None
, then software will execute the policy defined under it, and then reset the one_time property to None
. This one_time feature is a way for software to utilize automated power-on recovery function for other areas like firmware update scenarios where a certain power on behavior is desired once an update has completed.
In situations where the BMC or the system have gotten into a bad state, and the user has initiated some form of manual reset which is detectable by the BMC as being user initiated, the BMC software must:
RebootCause
within the BMC state interfacePinholeReset
will be added. Others can be added as neededAn application will be run after the chassis and host states have been determined which will only run if the chassis power is not on.
This application will look for the one_time setting and use it if its value is not None
. If it does use the one_time setting then it will reset it to None
once it has read it. Otherwise the application will read the persistent value of the PowerRestorePolicy
. The application will then run the logic as defined in the Requirements above.
This function will be hosted in phosphor-state-manger and potentially x86-power-control.
The BMC state manager application currently looks at a file in the sysfs to try and determine the cause of a BMC reboot. It then puts this reason in the RebootCause
property.
One possible cause of a BMC reset is an external reset (EXTRST). There are a variety of reasons an external reset can occur. Some systems are adding GPIOs to provide additional detail on these types of resets.
A new GPIO name will be added to the device-tree-gpio-naming.md which reports whether a pin hole reset has occurred on the previous reboot of the BMC. The BMC state manager application will enhance its support of the RebootCause
to look for this GPIO and if present, read it and set RebootCause
accordingly when it can either not determine the reason for the reboot via the sysfs or sysfs reports a EXTRST reason (in which case the GPIO will be utilized to enhance the reboot reason).
If the power recovery software sees the PinholeReset
reason within the RebootCause
then it will not implement any of its policy. Future BMC reboots which are not pin hole reset caused, will cause RebootCause
to go back to a default and therefore power recovery policy will be reenabled on that BMC boot.
The phosphor-state-manager chassis software will not log a blackout error if it sees the PinholeReset
reason (or any other reason that indicates a user initiated a reset of the system).
None, this is a pretty basic feature that does not have a lot of alternatives (other then just not doing it).
None
The control of this policy can already bet set via the Redfish API.
# Power Restore Policy curl -k -X PATCH -d '{"PowerRestorePolicy":"AlwaysOn"}' https://${bmc}/redfish/v1/Systems/system curl -k -X PATCH -d '{"PowerRestorePolicy":"AlwaysOff"}' https://${bmc}/redfish/v1/Systems/system curl -k -X PATCH -d '{"PowerRestorePolicy":"LastState"}' https://${bmc}/redfish/v1/Systems/system
For testing, each policy should be set and verified. The one_time aspect should also be checked for each possible value and verified to only be used once.
Validate that when multiple black outs occur, the firmware continues to try and power on the system when policy is AlwaysOn
or Restore
.
On supported systems, a pin hole reset should be done with a system that has a policy set to always power on. Tester should verify system does not automatically power on after a pin hole reset. Verify it does automatically power on when a normal reboot of the BMC is done.