Changes in Makefile

02376be32d6bcccc0c722c08779bd71e70516599 - tests/ci: Use :H:H rather than ../..

Tue, 23 Dec 2025 16:42:13 +0100

tests/ci: Use :H:H rather than ../..In general we want to strip subdir components, rather than appending`..`s.Reviewed by: lwhsuSponsored by: The FreeBSD FoundationDifferential Revision: https://reviews.freebsd.org/D54352 List of files: /freebsd/tests/ci/Makefile

4d185f54576acc6542e894e5d11d92bd7383eb27 - tests/ci: Fix building in Github

Wed, 17 Dec 2025 21:47:47 +0100

tests/ci: Fix building in GithubWhen we are using Cirrus-CI and using a PR branch it creates a filenamein the form "pull/XXXX" which becomes a path seperator and the filecreation process fails.Fails to complete the process with the following:/bin/sh: cannot create/tmp/meta.hUNGUq/ci-FreeBSD-16.0-pull/1932-amd64-nullhash-GENERIC.env:No such file or directoryFor future also apply the same regex for OSRELEASE and VOLUME_LABEL. List of files: /freebsd/tests/ci/Makefile

14d5c13a89269862b51ef2a7f190b0d28cfbf8a2 - tests/ci: Collect environment information

Tue, 16 Dec 2025 10:24:55 +0100

tests/ci: Collect environment informationFor reproducing errors or test results it is important to gatherenvironment information. These environments are divided into two parts.One part is in which environment the artifacts were built into and thesecond part is in which environment the tests were run.This patch collects thesee information and saves into a .env file inthe metadir. After this patch lands we will also need to change ourjenkins job where we are uploading the artifact to a central location.This environment file should also be stored along with the artifact.For easier location the image basename and the environment basename arekept same.Approved by: lwhsuMFC after: 3 daysSponsored by: The FreeBSD FoundationDifferential Revision: https://reviews.freebsd.org/D54247 List of files: /freebsd/tests/ci/Makefile

932cf5fa44b7ff3b7ea21ccb32bbbefff11c160c - tests/ci: Add CIENV variable

Wed, 27 Aug 2025 12:46:59 +0200

tests/ci: Add CIENV variableThe default behavior of of pre-commit script is to suppress all the logsas it is assumed that developers will run this on their terminal for thetests. But there are also other use cases like running these indifferent CI tools like Cirrus, GH Actions etc where these build logsare important in the web interface itself.To fix this issue introduce a new variable named CIENV which defaults tolocal if empty or undefined. If the CIENV is local in those cases thelogs are suppressed while for anything else it is not. This variable isalso important for some other WIP projects of CI I am working on likerunning the CI tests on remote cloud AWS, Azure, GCP etc.Approved by: lwhsuDifferential Revision: https://reviews.freebsd.org/D51178Event: Oslo hackathon 202508 List of files: /freebsd/tests/ci/Makefile

92a7f2d577630d670643f855a1d123a2260102af - tests/ci: Add KYUA_TEST_FILTERS to allow user to select specific tests

Wed, 13 Aug 2025 22:09:32 +0200

tests/ci: Add KYUA_TEST_FILTERS to allow user to select specific testsSponsored by: The FreeBSD FoundationDifferential Revision: https://reviews.freebsd.org/D51306 List of files: /freebsd/tests/ci/Makefile

9ec37e8ff49c6b555e8d4f522adc9378157df170 - tests/ci: Use QEMU blockdev declaration for all platforms

Fri, 25 Jul 2025 23:46:08 +0200

tests/ci: Use QEMU blockdev declaration for all platformsThis patch uses the QEMU manpage-recommended '-blockdev' option insteadof '-drive' to declare block devices. This also makes the mandatory'-device' declarations constant across all platforms, which fixes themissing QEMU_DEVICES tarfs device declarations on all Makefile.files.Signed-off-by: Siva Mahadevan Reviewed by: imp, lwhsuSponsored by: The FreeBSD FoundationDifferential Revision: https://reviews.freebsd.org/D51479 List of files: /freebsd/tests/ci/Makefile

66fe805070d121d4b93f63b7b02a70d76069edfc - tests/ci: Fix wrong chflags target path in 'beforeclean' target

Thu, 24 Jul 2025 22:11:18 +0200

tests/ci: Fix wrong chflags target path in 'beforeclean' targetSigned-off-by: Siva Mahadevan Sponsored by: The FreeBSD FoundationDifferential Revision: https://reviews.freebsd.org/D51304 List of files: /freebsd/tests/ci/Makefile

10fb5e7117e522540167fa02692e1e7b8e38eec0 - tests/ci: Fix race condition with ci-extractmeta

Thu, 24 Jul 2025 22:01:50 +0200

tests/ci: Fix race condition with ci-extractmetaThis solves an issue where 'ci-extractmeta' runs in parallel with'ci-runtest', which would extract an empty test result into thefinal test reports output dir. This also cleans up the intermediatetemporary files created along the way.Signed-off-by: Siva Mahadevan Reviewed by: emaste, lwhsuSponsored by: The FreeBSD FoundationDifferential Revision: https://reviews.freebsd.org/D51363 List of files: /freebsd/tests/ci/Makefile

7f849b7f4e192d32d617c492d50197c09bd20a56 - tests/ci: Indent Makefile properly

Tue, 22 Jul 2025 12:39:51 +0200

tests/ci: Indent Makefile properlyApproved by: imp, lwhsuSponsored by: The FreeBSD FoundationDifferential Revision: https://reviews.freebsd.org/D51445 List of files: /freebsd/tests/ci/Makefile

9f3e4b28f9dec27b73eeebd161d119d1e9864081 - tests/ci: Fix missing qemu devices

Tue, 22 Jul 2025 12:37:38 +0200

tests/ci: Fix missing qemu devicesFix missing QEMU_DEVICES which in turn is the META_TAR deviceApproved by: imp, lwhsuSponsored by: The FreeBSD FoundationPull Request: https://reviews.freebsd.org/D51445 List of files: /freebsd/tests/ci/Makefile

2f50ea54c6e3b15f655e800eb680ddcb80e30b4f - tests/ci: fix race condition in bhyveload boot

Mon, 07 Jul 2025 19:16:13 +0200

tests/ci: fix race condition in bhyveload bootCurrently, there is a race condition where theMakefile sh invocation of 'bhyveload -c stdio'exits before receiving any user input in the bootloader(e.g. in the form of a user typically pressing ),causing the 'expect' script to wrongly spawn the 'bhyve'invocation while still in the bootloader.This patch wraps bhyveload in expect(1) to ensure thatstdio is correctly consumed before the process exits.Signed-off-by: Siva Mahadevan Sponsored by: The FreeBSD FoundationPull Request: https://github.com/freebsd/freebsd-src/pull/1757 List of files: /freebsd/tests/ci/Makefile

ed4c64bc792fd2509d8fd6805f8e174c2db62338 - tests/ci: Use suitable variable for qemu-user-static existence check

Wed, 02 Jul 2025 21:00:06 +0200

tests/ci: Use suitable variable for qemu-user-static existence checkAnd simplify a qemu-system existence check.Signed-off-by: Siva Mahadevan Reviewed by: impSponsored by: The FreeBSD FoundationPull Request: https://github.com/freebsd/freebsd-src/pull/1751 List of files: /freebsd/tests/ci/Makefile

2c6e4aed07b268f9ddb33950dc117c21b021e390 - Fix typos in the CI configuration

Tue, 24 Jun 2025 18:14:27 +0200

Fix typos in the CI configurationFixes: a5f03413aade8f69cf954162151da043d34dd1f5Fixes: c08f5ad160bf7c844677e1960b1a882d492006f8Reviewed by: asomers, imp, zleiPull Request: https://github.com/freebsd/freebsd-src/pull/1736 List of files: /freebsd/tests/ci/Makefile

4b656ded9248840ebc7afb8aba2384c8b0a2afb3 - Refactor pre-commit CI

Wed, 07 May 2025 22:23:57 +0200

Refactor pre-commit CICurrently our test mechanism is not fit for building withoutcross-toolchain as we are not allowing EXTRA_MAKE_FLAGS. Also we are notallowing to build and test other KERNCONF. So allow these variables tobe overridden in command line.Approved by: lwhsuSponsored by: The FreeBSD FoundationDifferential Revision: https://reviews.freebsd.org/D50220 List of files: /freebsd/tests/ci/Makefile

5ea28c51397906a7cabb06089974feb21e2a7979 - tests/ci: Switch vmm detection

Fri, 02 May 2025 19:28:51 +0200

tests/ci: Switch vmm detectionPreviously, the CI Makefile used `kldload -n vmm` to determine whetherthe host supported bhyve virtualization. However, due to changes in howQEMU/KVM exposes CPU features to guests, this check no longer reliablyindicates the presence of usable VMX/SVM support.In particular, modern QEMU configurations expose the vmx CPUID bit bydefault, allowing the vmm module to load even when nested virtualizationis disabled. This causes the old check to incorrectly succeed insidevirtualized environments where bhyve cannot function.This patch replaces the check with a sysctl-based approach that inspectskern.vm_guest. If the system identifies itself as running inside a guest(!= "none"), we assume nested virtualization is unavailable and fallbackto QEMU.This change ensures CI behaves correctly on platforms where the vmmmodule loads but is not usable.Approved by: emasteSponsored by: The FreeBSD FoundationDifferential Revision: https://reviews.freebsd.org/D50115 List of files: /freebsd/tests/ci/Makefile

c08f5ad160bf7c844677e1960b1a882d492006f8 - CI: Add full test support

Wed, 30 Apr 2025 10:14:31 +0200

CI: Add full test supportThe patch adds support for running full tests in the local CIEnvironment. New features added:- New target `ci-full` which runs the full test. This is also the default now- Renamed the previous target `ci-smokeit` to `ci-smoke`- Unlike previous if the available memory is more than 16G a default of 8G will be used- Removed some unnecessary debug messages- Added `dummybuf` kernel module to the list of modules to be loaded on the VMThe features that can be tested:`make TARGET= TARGET_ARCH= CITYPE=full ci``make TARGET= TARGET_ARCH= ci` is also the same asabove as CITYPE full is the default nowApproved by: lwhsuSponsored by: The FreeBSD FoundationDifferential Revision: https://reviews.freebsd.org/D48015 List of files: /freebsd/tests/ci/Makefile

a5f03413aade8f69cf954162151da043d34dd1f5 - ci: Redirect output for builds.

Thu, 23 May 2024 19:37:01 +0200

ci: Redirect output for builds.This target is far too noisy to be at all useful. Save the output alamake universe in _. files. Also report where to find errors.Sponsored by: Netflix List of files: /freebsd/tests/ci/Makefile

cb9d4bb1fbb9ac0eb9f211656e91f9d5254c166c - Add preliminary in-tree CI infrastructure for developers

Thu, 18 Apr 2024 19:57:38 +0200

Add preliminary in-tree CI infrastructure for developersThe goal of this project is to integrate the relevant scripts from theFreeBSD-CI project (https://github.com/freebsd/freebsd-ci) into the srcrepository. This allows developers to run the test suite similar to howit is executed on ci.freebsd.org, and eventually, have it directly usedby our CI system. This effort is also part of the workflow improvementproject, aiming to incorporate pre-merge testing.Current Features:* Does smoke tests using either bhyve(amd64 only) or qemu(Non x86_64 or when defined USE_QEMU=1). Currently defined CITYPE=smoke. Once we have added full tests we can also utilize something like CITYPE=full* Most of the resources are dynamically allocated based on available resources in the host* If CPU supports POPCNT or vmm can be loaded then bhyve is used for amd64 otherwise automatically installs and uses qemu@nox11* When required third party applications or packages for booting non-x86 images are automatically installedCurrent Limitation:* Does not support full tests like the one in our Jenkins* At this moment this is also not suitable to be used in our Jenkins platform as the jobs are divided in multiple smaller tasks and artifacts are moved here and there which are not exactly the scenario for individual developers.Future Works:* Add full tests like the one in ci.freebsd.org* Add different tests or options to disable some tests* Add test profiles full* Possibly add test through Cloud Providers like AWS/GCP/Azure or Cirrus or Github Actions* Update documentationTest Plan:cd /usr/src/tests/cimake cimake TARGET=amd64 TARGET_ARCH=amd64 cimake TARGET=amd64 TARGET_ARCH=amd64 USE_QEMU=1 cimake TARGET=arm64 TARGET_ARCH=aarch64 cimake TARGET=powerpc TARGET_ARCH=powerpc64 cimake TARGET=powerpc TARGET_ARCH=powerpc64le cimake TARGET=riscv TARGET_ARCH=riscv64 ciReviewed by: lwhsuSponsored by: The FreeBSD FoundationDifferential Revision: https://reviews.freebsd.org/D43786 List of files: /freebsd/tests/ci/Makefile