Andrew Geissler | f034379 | 2020-11-18 10:42:21 -0600 | [diff] [blame] | 1 | .. SPDX-License-Identifier: CC-BY-SA-2.0-UK |
Andrew Geissler | c9f7865 | 2020-09-18 14:11:35 -0500 | [diff] [blame] | 2 | |
| 3 | ***************************************************** |
| 4 | Yocto Project Releases and the Stable Release Process |
| 5 | ***************************************************** |
| 6 | |
| 7 | The Yocto Project release process is predictable and consists of both |
| 8 | major and minor (point) releases. This brief chapter provides |
| 9 | information on how releases are named, their life cycle, and their |
| 10 | stability. |
| 11 | |
| 12 | Major and Minor Release Cadence |
| 13 | =============================== |
| 14 | |
Andrew Geissler | d1e8949 | 2021-02-12 15:35:20 -0600 | [diff] [blame] | 15 | The Yocto Project delivers major releases (e.g. &DISTRO;) using a six |
Andrew Geissler | c9f7865 | 2020-09-18 14:11:35 -0500 | [diff] [blame] | 16 | month cadence roughly timed each April and October of the year. |
| 17 | Following are examples of some major YP releases with their codenames |
Andrew Geissler | 3b8a17c | 2021-04-15 15:55:55 -0500 | [diff] [blame] | 18 | also shown. See the ":ref:`ref-manual/release-process:major release codenames`" |
| 19 | section for information on codenames used with major releases. |
Andrew Geissler | c9f7865 | 2020-09-18 14:11:35 -0500 | [diff] [blame] | 20 | |
| 21 | - 2.2 (Morty) |
| 22 | - 2.1 (Krogoth) |
| 23 | - 2.0 (Jethro) |
| 24 | |
| 25 | While the cadence is never perfect, this timescale facilitates |
| 26 | regular releases that have strong QA cycles while not overwhelming users |
| 27 | with too many new releases. The cadence is predictable and avoids many |
| 28 | major holidays in various geographies. |
| 29 | |
| 30 | The Yocto project delivers minor (point) releases on an unscheduled |
| 31 | basis and are usually driven by the accumulation of enough significant |
| 32 | fixes or enhancements to the associated major release. Following are |
| 33 | some example past point releases: |
| 34 | |
| 35 | - 2.1.1 |
| 36 | - 2.1.2 |
| 37 | - 2.2.1 |
| 38 | |
| 39 | The point release |
| 40 | indicates a point in the major release branch where a full QA cycle and |
| 41 | release process validates the content of the new branch. |
| 42 | |
| 43 | .. note:: |
| 44 | |
| 45 | Realize that there can be patches merged onto the stable release |
| 46 | branches as and when they become available. |
| 47 | |
| 48 | Major Release Codenames |
| 49 | ======================= |
| 50 | |
| 51 | Each major release receives a codename that identifies the release in |
Andrew Geissler | 09209ee | 2020-12-13 08:44:15 -0600 | [diff] [blame] | 52 | the :ref:`overview-manual/development-environment:yocto project source repositories`. |
Andrew Geissler | c9f7865 | 2020-09-18 14:11:35 -0500 | [diff] [blame] | 53 | The concept is that branches of :term:`Metadata` with the same |
| 54 | codename are likely to be compatible and thus work together. |
| 55 | |
| 56 | .. note:: |
| 57 | |
| 58 | Codenames are associated with major releases because a Yocto Project |
Andrew Geissler | d1e8949 | 2021-02-12 15:35:20 -0600 | [diff] [blame] | 59 | release number (e.g. &DISTRO;) could conflict with a given layer or |
Andrew Geissler | c9f7865 | 2020-09-18 14:11:35 -0500 | [diff] [blame] | 60 | company versioning scheme. Codenames are unique, interesting, and |
| 61 | easily identifiable. |
| 62 | |
| 63 | Releases are given a nominal release version as well but the codename is |
| 64 | used in repositories for this reason. You can find information on Yocto |
Andrew Geissler | 0903674 | 2021-06-25 14:25:14 -0500 | [diff] [blame] | 65 | Project releases and codenames at :yocto_wiki:`/Releases`. |
| 66 | |
| 67 | Our :doc:`/migration-guides/index` detail how to migrate from one release of |
| 68 | the Yocto Project to the next. |
Andrew Geissler | c9f7865 | 2020-09-18 14:11:35 -0500 | [diff] [blame] | 69 | |
| 70 | Stable Release Process |
| 71 | ====================== |
| 72 | |
| 73 | Once released, the release enters the stable release process at which |
| 74 | time a person is assigned as the maintainer for that stable release. |
| 75 | This maintainer monitors activity for the release by investigating and |
| 76 | handling nominated patches and backport activity. Only fixes and |
| 77 | enhancements that have first been applied on the "master" branch (i.e. |
| 78 | the current, in-development branch) are considered for backporting to a |
| 79 | stable release. |
| 80 | |
| 81 | .. note:: |
| 82 | |
| 83 | The current Yocto Project policy regarding backporting is to consider |
| 84 | bug fixes and security fixes only. Policy dictates that features are |
| 85 | not backported to a stable release. This policy means generic recipe |
| 86 | version upgrades are unlikely to be accepted for backporting. The |
William A. Kennington III | ac69b48 | 2021-06-02 12:28:27 -0700 | [diff] [blame] | 87 | exception to this policy occurs when there is a strong reason such as |
Andrew Geissler | c9f7865 | 2020-09-18 14:11:35 -0500 | [diff] [blame] | 88 | the fix happens to also be the preferred upstream approach. |
| 89 | |
| 90 | Stable release branches have strong maintenance for about a year after |
| 91 | their initial release. Should significant issues be found for any |
| 92 | release regardless of its age, fixes could be backported to older |
| 93 | releases. For issues that are not backported given an older release, |
William A. Kennington III | ac69b48 | 2021-06-02 12:28:27 -0700 | [diff] [blame] | 94 | Community LTS trees and branches allow community members to share |
Andrew Geissler | c9f7865 | 2020-09-18 14:11:35 -0500 | [diff] [blame] | 95 | patches for older releases. However, these types of patches do not go |
| 96 | through the same release process as do point releases. You can find more |
| 97 | information about stable branch maintenance at |
Andrew Geissler | 09209ee | 2020-12-13 08:44:15 -0600 | [diff] [blame] | 98 | :yocto_wiki:`/Stable_branch_maintenance`. |
Andrew Geissler | c9f7865 | 2020-09-18 14:11:35 -0500 | [diff] [blame] | 99 | |
| 100 | Testing and Quality Assurance |
| 101 | ============================= |
| 102 | |
| 103 | Part of the Yocto Project development and release process is quality |
| 104 | assurance through the execution of test strategies. Test strategies |
| 105 | provide the Yocto Project team a way to ensure a release is validated. |
| 106 | Additionally, because the test strategies are visible to you as a |
| 107 | developer, you can validate your projects. This section overviews the |
| 108 | available test infrastructure used in the Yocto Project. For information |
| 109 | on how to run available tests on your projects, see the |
Andrew Geissler | 517393d | 2023-01-13 08:55:19 -0600 | [diff] [blame] | 110 | ":ref:`dev-manual/runtime-testing:performing automated runtime testing`" |
Andrew Geissler | c9f7865 | 2020-09-18 14:11:35 -0500 | [diff] [blame] | 111 | section in the Yocto Project Development Tasks Manual. |
| 112 | |
| 113 | The QA/testing infrastructure is woven into the project to the point |
| 114 | where core developers take some of it for granted. The infrastructure |
| 115 | consists of the following pieces: |
| 116 | |
| 117 | - ``bitbake-selftest``: A standalone command that runs unit tests on |
| 118 | key pieces of BitBake and its fetchers. |
| 119 | |
Andrew Geissler | 7e0e3c0 | 2022-02-25 20:34:39 +0000 | [diff] [blame] | 120 | - :ref:`ref-classes-sanity`: This automatically |
Andrew Geissler | c9f7865 | 2020-09-18 14:11:35 -0500 | [diff] [blame] | 121 | included class checks the build environment for missing tools (e.g. |
| 122 | ``gcc``) or common misconfigurations such as |
| 123 | :term:`MACHINE` set incorrectly. |
| 124 | |
Andrew Geissler | 7e0e3c0 | 2022-02-25 20:34:39 +0000 | [diff] [blame] | 125 | - :ref:`ref-classes-insane`: This class checks the |
Andrew Geissler | c9f7865 | 2020-09-18 14:11:35 -0500 | [diff] [blame] | 126 | generated output from builds for sanity. For example, if building for |
| 127 | an ARM target, did the build produce ARM binaries. If, for example, |
| 128 | the build produced PPC binaries then there is a problem. |
| 129 | |
Patrick Williams | 975a06f | 2022-10-21 14:42:47 -0500 | [diff] [blame] | 130 | - :ref:`ref-classes-testimage`: This class |
Andrew Geissler | c9f7865 | 2020-09-18 14:11:35 -0500 | [diff] [blame] | 131 | performs runtime testing of images after they are built. The tests |
Andrew Geissler | 09209ee | 2020-12-13 08:44:15 -0600 | [diff] [blame] | 132 | are usually used with :doc:`QEMU </dev-manual/qemu>` |
Andrew Geissler | c9f7865 | 2020-09-18 14:11:35 -0500 | [diff] [blame] | 133 | to boot the images and check the combined runtime result boot |
| 134 | operation and functions. However, the test can also use the IP |
| 135 | address of a machine to test. |
| 136 | |
Andrew Geissler | 517393d | 2023-01-13 08:55:19 -0600 | [diff] [blame] | 137 | - :ref:`ptest <dev-manual/packages:testing packages with ptest>`: |
Andrew Geissler | c9f7865 | 2020-09-18 14:11:35 -0500 | [diff] [blame] | 138 | Runs tests against packages produced during the build for a given |
Andrew Geissler | 3b8a17c | 2021-04-15 15:55:55 -0500 | [diff] [blame] | 139 | piece of software. The test allows the packages to be run within a |
Andrew Geissler | c9f7865 | 2020-09-18 14:11:35 -0500 | [diff] [blame] | 140 | target image. |
| 141 | |
| 142 | - ``oe-selftest``: Tests combination BitBake invocations. These tests |
| 143 | operate outside the OpenEmbedded build system itself. The |
| 144 | ``oe-selftest`` can run all tests by default or can run selected |
| 145 | tests or test suites. |
| 146 | |
| 147 | .. note:: |
| 148 | |
Andrew Geissler | 4c19ea1 | 2020-10-27 13:52:24 -0500 | [diff] [blame] | 149 | Running ``oe-selftest`` requires host packages beyond the "Essential" |
Andrew Geissler | 09209ee | 2020-12-13 08:44:15 -0600 | [diff] [blame] | 150 | grouping. See the :ref:`ref-manual/system-requirements:required packages for the build host` |
Andrew Geissler | 4c19ea1 | 2020-10-27 13:52:24 -0500 | [diff] [blame] | 151 | section for more information. |
Andrew Geissler | c9f7865 | 2020-09-18 14:11:35 -0500 | [diff] [blame] | 152 | |
| 153 | Originally, much of this testing was done manually. However, significant |
| 154 | effort has been made to automate the tests so that more people can use |
| 155 | them and the Yocto Project development team can run them faster and more |
| 156 | efficiently. |
| 157 | |
Andrew Geissler | 4c19ea1 | 2020-10-27 13:52:24 -0500 | [diff] [blame] | 158 | The Yocto Project's main Autobuilder (&YOCTO_AB_URL;) |
Andrew Geissler | c9f7865 | 2020-09-18 14:11:35 -0500 | [diff] [blame] | 159 | publicly tests each Yocto Project release's code in the |
| 160 | :term:`OpenEmbedded-Core (OE-Core)`, Poky, and BitBake repositories. The testing |
| 161 | occurs for both the current state of the "master" branch and also for |
| 162 | submitted patches. Testing for submitted patches usually occurs in the |
| 163 | "ross/mut" branch in the ``poky-contrib`` repository (i.e. the |
| 164 | master-under-test branch) or in the "master-next" branch in the ``poky`` |
| 165 | repository. |
| 166 | |
| 167 | .. note:: |
| 168 | |
Andrew Geissler | 0903674 | 2021-06-25 14:25:14 -0500 | [diff] [blame] | 169 | You can find all these branches in the |
| 170 | :ref:`overview-manual/development-environment:yocto project source repositories`. |
Andrew Geissler | c9f7865 | 2020-09-18 14:11:35 -0500 | [diff] [blame] | 171 | |
| 172 | Testing within these public branches ensures in a publicly visible way |
| 173 | that all of the main supposed architectures and recipes in OE-Core |
| 174 | successfully build and behave properly. |
| 175 | |
| 176 | Various features such as ``multilib``, sub architectures (e.g. ``x32``, |
| 177 | ``poky-tiny``, ``musl``, ``no-x11`` and and so forth), |
| 178 | ``bitbake-selftest``, and ``oe-selftest`` are tested as part of the QA |
| 179 | process of a release. Complete testing and validation for a release |
| 180 | takes the Autobuilder workers several hours. |
| 181 | |
| 182 | .. note:: |
| 183 | |
| 184 | The Autobuilder workers are non-homogeneous, which means regular |
| 185 | testing across a variety of Linux distributions occurs. The |
| 186 | Autobuilder is limited to only testing QEMU-based setups and not real |
| 187 | hardware. |
| 188 | |
| 189 | Finally, in addition to the Autobuilder's tests, the Yocto Project QA |
| 190 | team also performs testing on a variety of platforms, which includes |
| 191 | actual hardware, to ensure expected results. |