Add CI approved test cases tag infrastructure
Use Robot Test Framework's use of Tags to create a subset of tests that
can be run on real and simulated hardware for a basic set of validations
against each commit.
Our yocto qemu session has real basic support and can not pass very many
of the robot tests. Not because there is a bug but simply because the
simulation does not support many of the openbmc rest interfaces (i.e.
inventory, sensors). I found some REST and Event Log test suites that
are available in QEMU to start testing now with. When we move the QEMU
simulation to more of a palmetto based model more test cases will get
the CI tag. Eventually we will be able to go to a negative model where
we mark the tests that should not be part of a CI run rather then this
small set of includes.
The tag of 'CI' was chosen over a 'QEMUCI' because I fear the use of
tags could get out of hand (BARRELEYECI vs WEDGECI vs BARRELEYE_SIM_CI,
etc).
Invoking....
To test in QEMU first launch the session, find the IP and then run...
OPENBMC_HOST=<ip> tox -e qemu -- --include CI tests
You can also run the CI suite against real hardware...
OPENBMC_HOST=<ip> tox -e barreleye -- --include CI tests
Change-Id: I2c5fbcf2457d958edf7b89c70d7990f5f97e8b75
Signed-off-by: Chris Austen <austenc@us.ibm.com>
3 files changed