1.. SPDX-License-Identifier: GPL-2.0 2 3Writing Tests 4============= 5 6Test Cases 7---------- 8 9The fundamental unit in KUnit is the test case. A test case is a function with 10the signature ``void (*)(struct kunit *test)``. It calls the function under test 11and then sets *expectations* for what should happen. For example: 12 13.. code-block:: c 14 15 void example_test_success(struct kunit *test) 16 { 17 } 18 19 void example_test_failure(struct kunit *test) 20 { 21 KUNIT_FAIL(test, "This test never passes."); 22 } 23 24In the above example, ``example_test_success`` always passes because it does 25nothing; no expectations are set, and therefore all expectations pass. On the 26other hand ``example_test_failure`` always fails because it calls ``KUNIT_FAIL``, 27which is a special expectation that logs a message and causes the test case to 28fail. 29 30Expectations 31~~~~~~~~~~~~ 32An *expectation* specifies that we expect a piece of code to do something in a 33test. An expectation is called like a function. A test is made by setting 34expectations about the behavior of a piece of code under test. When one or more 35expectations fail, the test case fails and information about the failure is 36logged. For example: 37 38.. code-block:: c 39 40 void add_test_basic(struct kunit *test) 41 { 42 KUNIT_EXPECT_EQ(test, 1, add(1, 0)); 43 KUNIT_EXPECT_EQ(test, 2, add(1, 1)); 44 } 45 46In the above example, ``add_test_basic`` makes a number of assertions about the 47behavior of a function called ``add``. The first parameter is always of type 48``struct kunit *``, which contains information about the current test context. 49The second parameter, in this case, is what the value is expected to be. The 50last value is what the value actually is. If ``add`` passes all of these 51expectations, the test case, ``add_test_basic`` will pass; if any one of these 52expectations fails, the test case will fail. 53 54A test case *fails* when any expectation is violated; however, the test will 55continue to run, and try other expectations until the test case ends or is 56otherwise terminated. This is as opposed to *assertions* which are discussed 57later. 58 59To learn about more KUnit expectations, see Documentation/dev-tools/kunit/api/test.rst. 60 61.. note:: 62 A single test case should be short, easy to understand, and focused on a 63 single behavior. 64 65For example, if we want to rigorously test the ``add`` function above, create 66additional tests cases which would test each property that an ``add`` function 67should have as shown below: 68 69.. code-block:: c 70 71 void add_test_basic(struct kunit *test) 72 { 73 KUNIT_EXPECT_EQ(test, 1, add(1, 0)); 74 KUNIT_EXPECT_EQ(test, 2, add(1, 1)); 75 } 76 77 void add_test_negative(struct kunit *test) 78 { 79 KUNIT_EXPECT_EQ(test, 0, add(-1, 1)); 80 } 81 82 void add_test_max(struct kunit *test) 83 { 84 KUNIT_EXPECT_EQ(test, INT_MAX, add(0, INT_MAX)); 85 KUNIT_EXPECT_EQ(test, -1, add(INT_MAX, INT_MIN)); 86 } 87 88 void add_test_overflow(struct kunit *test) 89 { 90 KUNIT_EXPECT_EQ(test, INT_MIN, add(INT_MAX, 1)); 91 } 92 93Assertions 94~~~~~~~~~~ 95 96An assertion is like an expectation, except that the assertion immediately 97terminates the test case if the condition is not satisfied. For example: 98 99.. code-block:: c 100 101 static void test_sort(struct kunit *test) 102 { 103 int *a, i, r = 1; 104 a = kunit_kmalloc_array(test, TEST_LEN, sizeof(*a), GFP_KERNEL); 105 KUNIT_ASSERT_NOT_ERR_OR_NULL(test, a); 106 for (i = 0; i < TEST_LEN; i++) { 107 r = (r * 725861) % 6599; 108 a[i] = r; 109 } 110 sort(a, TEST_LEN, sizeof(*a), cmpint, NULL); 111 for (i = 0; i < TEST_LEN-1; i++) 112 KUNIT_EXPECT_LE(test, a[i], a[i + 1]); 113 } 114 115In this example, we need to be able to allocate an array to test the ``sort()`` 116function. So we use ``KUNIT_ASSERT_NOT_ERR_OR_NULL()`` to abort the test if 117there's an allocation error. 118 119.. note:: 120 In other test frameworks, ``ASSERT`` macros are often implemented by calling 121 ``return`` so they only work from the test function. In KUnit, we stop the 122 current kthread on failure, so you can call them from anywhere. 123 124.. note:: 125 Warning: There is an exception to the above rule. You shouldn't use assertions 126 in the suite's exit() function, or in the free function for a resource. These 127 run when a test is shutting down, and an assertion here prevents further 128 cleanup code from running, potentially leading to a memory leak. 129 130Customizing error messages 131-------------------------- 132 133Each of the ``KUNIT_EXPECT`` and ``KUNIT_ASSERT`` macros have a ``_MSG`` 134variant. These take a format string and arguments to provide additional 135context to the automatically generated error messages. 136 137.. code-block:: c 138 139 char some_str[41]; 140 generate_sha1_hex_string(some_str); 141 142 /* Before. Not easy to tell why the test failed. */ 143 KUNIT_EXPECT_EQ(test, strlen(some_str), 40); 144 145 /* After. Now we see the offending string. */ 146 KUNIT_EXPECT_EQ_MSG(test, strlen(some_str), 40, "some_str='%s'", some_str); 147 148Alternatively, one can take full control over the error message by using 149``KUNIT_FAIL()``, e.g. 150 151.. code-block:: c 152 153 /* Before */ 154 KUNIT_EXPECT_EQ(test, some_setup_function(), 0); 155 156 /* After: full control over the failure message. */ 157 if (some_setup_function()) 158 KUNIT_FAIL(test, "Failed to setup thing for testing"); 159 160Suppressing warning backtraces 161------------------------------ 162 163Some unit tests trigger warning backtraces either intentionally or as a side 164effect. Such backtraces are normally undesirable since they distract from 165the actual test and may result in the impression that there is a problem. 166 167Backtraces can be suppressed with **task-scoped suppression**: while 168suppression is active on the current task, the backtrace and stack dump from 169``WARN*()``, ``WARN_ON*()``, and related macros on that task are suppressed. 170Two API forms are available. 171 172- Scoped suppression is the simplest form. Wrap the code that triggers 173 warnings in a ``kunit_warning_suppress()`` block: 174 175.. code-block:: c 176 177 static void some_test(struct kunit *test) 178 { 179 kunit_warning_suppress(test) { 180 trigger_backtrace(); 181 KUNIT_EXPECT_SUPPRESSED_WARNING_COUNT(test, 1); 182 } 183 } 184 185.. note:: 186 The warning count must be checked inside the block; the suppression handle 187 is not accessible after the block exits. 188 189- Direct functions return an explicit handle pointer. Use them when the handle 190 needs to be retained or passed across helper functions: 191 192.. code-block:: c 193 194 static void some_test(struct kunit *test) 195 { 196 struct kunit_suppressed_warning *w; 197 198 w = kunit_start_suppress_warning(test); 199 trigger_backtrace(); 200 kunit_end_suppress_warning(test, w); 201 202 KUNIT_EXPECT_EQ(test, kunit_suppressed_warning_count(w), 1); 203 } 204 205Test Suites 206~~~~~~~~~~~ 207 208We need many test cases covering all the unit's behaviors. It is common to have 209many similar tests. In order to reduce duplication in these closely related 210tests, most unit testing frameworks (including KUnit) provide the concept of a 211*test suite*. A test suite is a collection of test cases for a unit of code 212with optional setup and teardown functions that run before/after the whole 213suite and/or every test case. 214 215.. note:: 216 A test case will only run if it is associated with a test suite. 217 218For example: 219 220.. code-block:: c 221 222 static struct kunit_case example_test_cases[] = { 223 KUNIT_CASE(example_test_foo), 224 KUNIT_CASE(example_test_bar), 225 KUNIT_CASE(example_test_baz), 226 {} 227 }; 228 229 static struct kunit_suite example_test_suite = { 230 .name = "example", 231 .init = example_test_init, 232 .exit = example_test_exit, 233 .suite_init = example_suite_init, 234 .suite_exit = example_suite_exit, 235 .test_cases = example_test_cases, 236 }; 237 kunit_test_suite(example_test_suite); 238 239In the above example, the test suite ``example_test_suite`` would first run 240``example_suite_init``, then run the test cases ``example_test_foo``, 241``example_test_bar``, and ``example_test_baz``. Each would have 242``example_test_init`` called immediately before it and ``example_test_exit`` 243called immediately after it. Finally, ``example_suite_exit`` would be called 244after everything else. ``kunit_test_suite(example_test_suite)`` registers the 245test suite with the KUnit test framework. 246 247.. note:: 248 The ``exit`` and ``suite_exit`` functions will run even if ``init`` or 249 ``suite_init`` fail. Make sure that they can handle any inconsistent 250 state which may result from ``init`` or ``suite_init`` encountering errors 251 or exiting early. 252 253``kunit_test_suite(...)`` is a macro which tells the linker to put the 254specified test suite in a special linker section so that it can be run by KUnit 255either after ``late_init``, or when the test module is loaded (if the test was 256built as a module). 257 258For more information, see Documentation/dev-tools/kunit/api/test.rst. 259 260.. _kunit-on-non-uml: 261 262Writing Tests For Other Architectures 263------------------------------------- 264 265It is better to write tests that run on UML to tests that only run under a 266particular architecture. It is better to write tests that run under QEMU or 267another easy to obtain (and monetarily free) software environment to a specific 268piece of hardware. 269 270Nevertheless, there are still valid reasons to write a test that is architecture 271or hardware specific. For example, we might want to test code that really 272belongs in ``arch/some-arch/*``. Even so, try to write the test so that it does 273not depend on physical hardware. Some of our test cases may not need hardware, 274only few tests actually require the hardware to test it. When hardware is not 275available, instead of disabling tests, we can skip them. 276 277Now that we have narrowed down exactly what bits are hardware specific, the 278actual procedure for writing and running the tests is same as writing normal 279KUnit tests. 280 281.. important:: 282 We may have to reset hardware state. If this is not possible, we may only 283 be able to run one test case per invocation. 284 285.. TODO(brendanhiggins@google.com): Add an actual example of an architecture- 286 dependent KUnit test. 287 288Common Patterns 289=============== 290 291Isolating Behavior 292------------------ 293 294Unit testing limits the amount of code under test to a single unit. It controls 295what code gets run when the unit under test calls a function. Where a function 296is exposed as part of an API such that the definition of that function can be 297changed without affecting the rest of the code base. In the kernel, this comes 298from two constructs: classes, which are structs that contain function pointers 299provided by the implementer, and architecture-specific functions, which have 300definitions selected at compile time. 301 302Classes 303~~~~~~~ 304 305Classes are not a construct that is built into the C programming language; 306however, it is an easily derived concept. Accordingly, in most cases, every 307project that does not use a standardized object oriented library (like GNOME's 308GObject) has their own slightly different way of doing object oriented 309programming; the Linux kernel is no exception. 310 311The central concept in kernel object oriented programming is the class. In the 312kernel, a *class* is a struct that contains function pointers. This creates a 313contract between *implementers* and *users* since it forces them to use the 314same function signature without having to call the function directly. To be a 315class, the function pointers must specify that a pointer to the class, known as 316a *class handle*, be one of the parameters. Thus the member functions (also 317known as *methods*) have access to member variables (also known as *fields*) 318allowing the same implementation to have multiple *instances*. 319 320A class can be *overridden* by *child classes* by embedding the *parent class* 321in the child class. Then when the child class *method* is called, the child 322implementation knows that the pointer passed to it is of a parent contained 323within the child. Thus, the child can compute the pointer to itself because the 324pointer to the parent is always a fixed offset from the pointer to the child. 325This offset is the offset of the parent contained in the child struct. For 326example: 327 328.. code-block:: c 329 330 struct shape { 331 int (*area)(struct shape *this); 332 }; 333 334 struct rectangle { 335 struct shape parent; 336 int length; 337 int width; 338 }; 339 340 int rectangle_area(struct shape *this) 341 { 342 struct rectangle *self = container_of(this, struct rectangle, parent); 343 344 return self->length * self->width; 345 }; 346 347 void rectangle_new(struct rectangle *self, int length, int width) 348 { 349 self->parent.area = rectangle_area; 350 self->length = length; 351 self->width = width; 352 } 353 354In this example, computing the pointer to the child from the pointer to the 355parent is done by ``container_of``. 356 357Faking Classes 358~~~~~~~~~~~~~~ 359 360In order to unit test a piece of code that calls a method in a class, the 361behavior of the method must be controllable, otherwise the test ceases to be a 362unit test and becomes an integration test. 363 364A fake class implements a piece of code that is different than what runs in a 365production instance, but behaves identical from the standpoint of the callers. 366This is done to replace a dependency that is hard to deal with, or is slow. For 367example, implementing a fake EEPROM that stores the "contents" in an 368internal buffer. Assume we have a class that represents an EEPROM: 369 370.. code-block:: c 371 372 struct eeprom { 373 ssize_t (*read)(struct eeprom *this, size_t offset, char *buffer, size_t count); 374 ssize_t (*write)(struct eeprom *this, size_t offset, const char *buffer, size_t count); 375 }; 376 377And we want to test code that buffers writes to the EEPROM: 378 379.. code-block:: c 380 381 struct eeprom_buffer { 382 ssize_t (*write)(struct eeprom_buffer *this, const char *buffer, size_t count); 383 int flush(struct eeprom_buffer *this); 384 size_t flush_count; /* Flushes when buffer exceeds flush_count. */ 385 }; 386 387 struct eeprom_buffer *new_eeprom_buffer(struct eeprom *eeprom); 388 void destroy_eeprom_buffer(struct eeprom *eeprom); 389 390We can test this code by *faking out* the underlying EEPROM: 391 392.. code-block:: c 393 394 struct fake_eeprom { 395 struct eeprom parent; 396 char contents[FAKE_EEPROM_CONTENTS_SIZE]; 397 }; 398 399 ssize_t fake_eeprom_read(struct eeprom *parent, size_t offset, char *buffer, size_t count) 400 { 401 struct fake_eeprom *this = container_of(parent, struct fake_eeprom, parent); 402 403 count = min(count, FAKE_EEPROM_CONTENTS_SIZE - offset); 404 memcpy(buffer, this->contents + offset, count); 405 406 return count; 407 } 408 409 ssize_t fake_eeprom_write(struct eeprom *parent, size_t offset, const char *buffer, size_t count) 410 { 411 struct fake_eeprom *this = container_of(parent, struct fake_eeprom, parent); 412 413 count = min(count, FAKE_EEPROM_CONTENTS_SIZE - offset); 414 memcpy(this->contents + offset, buffer, count); 415 416 return count; 417 } 418 419 void fake_eeprom_init(struct fake_eeprom *this) 420 { 421 this->parent.read = fake_eeprom_read; 422 this->parent.write = fake_eeprom_write; 423 memset(this->contents, 0, FAKE_EEPROM_CONTENTS_SIZE); 424 } 425 426We can now use it to test ``struct eeprom_buffer``: 427 428.. code-block:: c 429 430 struct eeprom_buffer_test { 431 struct fake_eeprom *fake_eeprom; 432 struct eeprom_buffer *eeprom_buffer; 433 }; 434 435 static void eeprom_buffer_test_does_not_write_until_flush(struct kunit *test) 436 { 437 struct eeprom_buffer_test *ctx = test->priv; 438 struct eeprom_buffer *eeprom_buffer = ctx->eeprom_buffer; 439 struct fake_eeprom *fake_eeprom = ctx->fake_eeprom; 440 char buffer[] = {0xff}; 441 442 eeprom_buffer->flush_count = SIZE_MAX; 443 444 eeprom_buffer->write(eeprom_buffer, buffer, 1); 445 KUNIT_EXPECT_EQ(test, fake_eeprom->contents[0], 0); 446 447 eeprom_buffer->write(eeprom_buffer, buffer, 1); 448 KUNIT_EXPECT_EQ(test, fake_eeprom->contents[1], 0); 449 450 eeprom_buffer->flush(eeprom_buffer); 451 KUNIT_EXPECT_EQ(test, fake_eeprom->contents[0], 0xff); 452 KUNIT_EXPECT_EQ(test, fake_eeprom->contents[1], 0xff); 453 } 454 455 static void eeprom_buffer_test_flushes_after_flush_count_met(struct kunit *test) 456 { 457 struct eeprom_buffer_test *ctx = test->priv; 458 struct eeprom_buffer *eeprom_buffer = ctx->eeprom_buffer; 459 struct fake_eeprom *fake_eeprom = ctx->fake_eeprom; 460 char buffer[] = {0xff}; 461 462 eeprom_buffer->flush_count = 2; 463 464 eeprom_buffer->write(eeprom_buffer, buffer, 1); 465 KUNIT_EXPECT_EQ(test, fake_eeprom->contents[0], 0); 466 467 eeprom_buffer->write(eeprom_buffer, buffer, 1); 468 KUNIT_EXPECT_EQ(test, fake_eeprom->contents[0], 0xff); 469 KUNIT_EXPECT_EQ(test, fake_eeprom->contents[1], 0xff); 470 } 471 472 static void eeprom_buffer_test_flushes_increments_of_flush_count(struct kunit *test) 473 { 474 struct eeprom_buffer_test *ctx = test->priv; 475 struct eeprom_buffer *eeprom_buffer = ctx->eeprom_buffer; 476 struct fake_eeprom *fake_eeprom = ctx->fake_eeprom; 477 char buffer[] = {0xff, 0xff}; 478 479 eeprom_buffer->flush_count = 2; 480 481 eeprom_buffer->write(eeprom_buffer, buffer, 1); 482 KUNIT_EXPECT_EQ(test, fake_eeprom->contents[0], 0); 483 484 eeprom_buffer->write(eeprom_buffer, buffer, 2); 485 KUNIT_EXPECT_EQ(test, fake_eeprom->contents[0], 0xff); 486 KUNIT_EXPECT_EQ(test, fake_eeprom->contents[1], 0xff); 487 /* Should have only flushed the first two bytes. */ 488 KUNIT_EXPECT_EQ(test, fake_eeprom->contents[2], 0); 489 } 490 491 static int eeprom_buffer_test_init(struct kunit *test) 492 { 493 struct eeprom_buffer_test *ctx; 494 495 ctx = kunit_kzalloc(test, sizeof(*ctx), GFP_KERNEL); 496 KUNIT_ASSERT_NOT_ERR_OR_NULL(test, ctx); 497 498 ctx->fake_eeprom = kunit_kzalloc(test, sizeof(*ctx->fake_eeprom), GFP_KERNEL); 499 KUNIT_ASSERT_NOT_ERR_OR_NULL(test, ctx->fake_eeprom); 500 fake_eeprom_init(ctx->fake_eeprom); 501 502 ctx->eeprom_buffer = new_eeprom_buffer(&ctx->fake_eeprom->parent); 503 KUNIT_ASSERT_NOT_ERR_OR_NULL(test, ctx->eeprom_buffer); 504 505 test->priv = ctx; 506 507 return 0; 508 } 509 510 static void eeprom_buffer_test_exit(struct kunit *test) 511 { 512 struct eeprom_buffer_test *ctx = test->priv; 513 514 destroy_eeprom_buffer(ctx->eeprom_buffer); 515 } 516 517Testing Against Multiple Inputs 518------------------------------- 519 520Testing just a few inputs is not enough to ensure that the code works correctly, 521for example: testing a hash function. 522 523We can write a helper macro or function. The function is called for each input. 524For example, to test ``sha1sum(1)``, we can write: 525 526.. code-block:: c 527 528 #define TEST_SHA1(in, want) \ 529 sha1sum(in, out); \ 530 KUNIT_EXPECT_STREQ_MSG(test, out, want, "sha1sum(%s)", in); 531 532 char out[40]; 533 TEST_SHA1("hello world", "2aae6c35c94fcfb415dbe95f408b9ce91ee846ed"); 534 TEST_SHA1("hello world!", "430ce34d020724ed75a196dfc2ad67c77772d169"); 535 536Note the use of the ``_MSG`` version of ``KUNIT_EXPECT_STREQ`` to print a more 537detailed error and make the assertions clearer within the helper macros. 538 539The ``_MSG`` variants are useful when the same expectation is called multiple 540times (in a loop or helper function) and thus the line number is not enough to 541identify what failed, as shown below. 542 543In complicated cases, we recommend using a *table-driven test* compared to the 544helper macro variation, for example: 545 546.. code-block:: c 547 548 int i; 549 char out[40]; 550 551 struct sha1_test_case { 552 const char *str; 553 const char *sha1; 554 }; 555 556 struct sha1_test_case cases[] = { 557 { 558 .str = "hello world", 559 .sha1 = "2aae6c35c94fcfb415dbe95f408b9ce91ee846ed", 560 }, 561 { 562 .str = "hello world!", 563 .sha1 = "430ce34d020724ed75a196dfc2ad67c77772d169", 564 }, 565 }; 566 for (i = 0; i < ARRAY_SIZE(cases); ++i) { 567 sha1sum(cases[i].str, out); 568 KUNIT_EXPECT_STREQ_MSG(test, out, cases[i].sha1, 569 "sha1sum(%s)", cases[i].str); 570 } 571 572 573There is more boilerplate code involved, but it can: 574 575* be more readable when there are multiple inputs/outputs (due to field names). 576 577 * For example, see ``fs/ext4/inode-test.c``. 578 579* reduce duplication if test cases are shared across multiple tests. 580 581 * For example: if we want to test ``sha256sum``, we could add a ``sha256`` 582 field and reuse ``cases``. 583 584* be converted to a "parameterized test". 585 586Parameterized Testing 587~~~~~~~~~~~~~~~~~~~~~ 588 589To run a test case against multiple inputs, KUnit provides a parameterized 590testing framework. This feature formalizes and extends the concept of 591table-driven tests discussed previously. 592 593A KUnit test is determined to be parameterized if a parameter generator function 594is provided when registering the test case. A test user can either write their 595own generator function or use one that is provided by KUnit. The generator 596function is stored in ``kunit_case->generate_params`` and can be set using the 597macros described in the section below. 598 599To establish the terminology, a "parameterized test" is a test which is run 600multiple times (once per "parameter" or "parameter run"). Each parameter run has 601both its own independent ``struct kunit`` (the "parameter run context") and 602access to a shared parent ``struct kunit`` (the "parameterized test context"). 603 604Passing Parameters to a Test 605^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 606There are three ways to provide the parameters to a test: 607 608Array Parameter Macros: 609 610 KUnit provides special support for the common table-driven testing pattern. 611 By applying either ``KUNIT_ARRAY_PARAM`` or ``KUNIT_ARRAY_PARAM_DESC`` to the 612 ``cases`` array from the previous section, we can create a parameterized test 613 as shown below: 614 615.. code-block:: c 616 617 // This is copy-pasted from above. 618 struct sha1_test_case { 619 const char *str; 620 const char *sha1; 621 }; 622 static const struct sha1_test_case cases[] = { 623 { 624 .str = "hello world", 625 .sha1 = "2aae6c35c94fcfb415dbe95f408b9ce91ee846ed", 626 }, 627 { 628 .str = "hello world!", 629 .sha1 = "430ce34d020724ed75a196dfc2ad67c77772d169", 630 }, 631 }; 632 633 // Creates `sha1_gen_params()` to iterate over `cases` while using 634 // the struct member `str` for the case description. 635 KUNIT_ARRAY_PARAM_DESC(sha1, cases, str); 636 637 // Looks no different from a normal test. 638 static void sha1_test(struct kunit *test) 639 { 640 // This function can just contain the body of the for-loop. 641 // The former `cases[i]` is accessible under test->param_value. 642 char out[40]; 643 struct sha1_test_case *test_param = (struct sha1_test_case *)(test->param_value); 644 645 sha1sum(test_param->str, out); 646 KUNIT_EXPECT_STREQ_MSG(test, out, test_param->sha1, 647 "sha1sum(%s)", test_param->str); 648 } 649 650 // Instead of KUNIT_CASE, we use KUNIT_CASE_PARAM and pass in the 651 // function declared by KUNIT_ARRAY_PARAM or KUNIT_ARRAY_PARAM_DESC. 652 static struct kunit_case sha1_test_cases[] = { 653 KUNIT_CASE_PARAM(sha1_test, sha1_gen_params), 654 {} 655 }; 656 657Custom Parameter Generator Function: 658 659 The generator function is responsible for generating parameters one-by-one 660 and has the following signature: 661 ``const void* (*)(struct kunit *test, const void *prev, char *desc)``. 662 You can pass the generator function to the ``KUNIT_CASE_PARAM`` 663 or ``KUNIT_CASE_PARAM_WITH_INIT`` macros. 664 665 The function receives the previously generated parameter as the ``prev`` argument 666 (which is ``NULL`` on the first call) and can also access the parameterized 667 test context passed as the ``test`` argument. KUnit calls this function 668 repeatedly until it returns ``NULL``, which signifies that a parameterized 669 test ended. 670 671 Below is an example of how it works: 672 673.. code-block:: c 674 675 #define MAX_TEST_BUFFER_SIZE 8 676 677 // Example generator function. It produces a sequence of buffer sizes that 678 // are powers of two, starting at 1 (e.g., 1, 2, 4, 8). 679 static const void *buffer_size_gen_params(struct kunit *test, const void *prev, char *desc) 680 { 681 long prev_buffer_size = (long)prev; 682 long next_buffer_size = 1; // Start with an initial size of 1. 683 684 // Stop generating parameters if the limit is reached or exceeded. 685 if (prev_buffer_size >= MAX_TEST_BUFFER_SIZE) 686 return NULL; 687 688 // For subsequent calls, calculate the next size by doubling the previous one. 689 if (prev) 690 next_buffer_size = prev_buffer_size << 1; 691 692 return (void *)next_buffer_size; 693 } 694 695 // Simple test to validate that kunit_kzalloc provides zeroed memory. 696 static void buffer_zero_test(struct kunit *test) 697 { 698 long buffer_size = (long)test->param_value; 699 // Use kunit_kzalloc to allocate a zero-initialized buffer. This makes the 700 // memory "parameter run managed," meaning it's automatically cleaned up at 701 // the end of each parameter run. 702 int *buf = kunit_kzalloc(test, buffer_size * sizeof(int), GFP_KERNEL); 703 704 // Ensure the allocation was successful. 705 KUNIT_ASSERT_NOT_NULL(test, buf); 706 707 // Loop through the buffer and confirm every element is zero. 708 for (int i = 0; i < buffer_size; i++) 709 KUNIT_EXPECT_EQ(test, buf[i], 0); 710 } 711 712 static struct kunit_case buffer_test_cases[] = { 713 KUNIT_CASE_PARAM(buffer_zero_test, buffer_size_gen_params), 714 {} 715 }; 716 717Runtime Parameter Array Registration in the Init Function: 718 719 For scenarios where you might need to initialize a parameterized test, you 720 can directly register a parameter array to the parameterized test context. 721 722 To do this, you must pass the parameterized test context, the array itself, 723 the array size, and a ``get_description()`` function to the 724 ``kunit_register_params_array()`` macro. This macro populates 725 ``struct kunit_params`` within the parameterized test context, effectively 726 storing a parameter array object. The ``get_description()`` function will 727 be used for populating parameter descriptions and has the following signature: 728 ``void (*)(struct kunit *test, const void *param, char *desc)``. Note that it 729 also has access to the parameterized test context. 730 731 .. important:: 732 When using this way to register a parameter array, you will need to 733 manually pass ``kunit_array_gen_params()`` as the generator function to 734 ``KUNIT_CASE_PARAM_WITH_INIT``. ``kunit_array_gen_params()`` is a KUnit 735 helper that will use the registered array to generate the parameters. 736 737 If needed, instead of passing the KUnit helper, you can also pass your 738 own custom generator function that utilizes the parameter array. To 739 access the parameter array from within the parameter generator 740 function use ``test->params_array.params``. 741 742 The ``kunit_register_params_array()`` macro should be called within a 743 ``param_init()`` function that initializes the parameterized test and has 744 the following signature ``int (*)(struct kunit *test)``. For a detailed 745 explanation of this mechanism please refer to the "Adding Shared Resources" 746 section that is after this one. This method supports registering both 747 dynamically built and static parameter arrays. 748 749 The code snippet below shows the ``example_param_init_dynamic_arr`` test that 750 utilizes ``make_fibonacci_params()`` to create a dynamic array, which is then 751 registered using ``kunit_register_params_array()``. To see the full code 752 please refer to lib/kunit/kunit-example-test.c. 753 754.. code-block:: c 755 756 /* 757 * Example of a parameterized test param_init() function that registers a dynamic 758 * array of parameters. 759 */ 760 static int example_param_init_dynamic_arr(struct kunit *test) 761 { 762 size_t seq_size; 763 int *fibonacci_params; 764 765 kunit_info(test, "initializing parameterized test\n"); 766 767 seq_size = 6; 768 fibonacci_params = make_fibonacci_params(test, seq_size); 769 if (!fibonacci_params) 770 return -ENOMEM; 771 /* 772 * Passes the dynamic parameter array information to the parameterized test 773 * context struct kunit. The array and its metadata will be stored in 774 * test->parent->params_array. The array itself will be located in 775 * params_data.params. 776 */ 777 kunit_register_params_array(test, fibonacci_params, seq_size, 778 example_param_dynamic_arr_get_desc); 779 return 0; 780 } 781 782 static struct kunit_case example_test_cases[] = { 783 /* 784 * Note how we pass kunit_array_gen_params() to use the array we 785 * registered in example_param_init_dynamic_arr() to generate 786 * parameters. 787 */ 788 KUNIT_CASE_PARAM_WITH_INIT(example_params_test_with_init_dynamic_arr, 789 kunit_array_gen_params, 790 example_param_init_dynamic_arr, 791 example_param_exit_dynamic_arr), 792 {} 793 }; 794 795Adding Shared Resources 796^^^^^^^^^^^^^^^^^^^^^^^ 797All parameter runs in this framework hold a reference to the parameterized test 798context, which can be accessed using the parent ``struct kunit`` pointer. The 799parameterized test context is not used to execute any test logic itself; instead, 800it serves as a container for shared resources. 801 802It's possible to add resources to share between parameter runs within a 803parameterized test by using ``KUNIT_CASE_PARAM_WITH_INIT``, to which you pass 804custom ``param_init()`` and ``param_exit()`` functions. These functions run once 805before and once after the parameterized test, respectively. 806 807The ``param_init()`` function, with the signature ``int (*)(struct kunit *test)``, 808can be used for adding resources to the ``resources`` or ``priv`` fields of 809the parameterized test context, registering the parameter array, and any other 810initialization logic. 811 812The ``param_exit()`` function, with the signature ``void (*)(struct kunit *test)``, 813can be used to release any resources that were not parameterized test managed (i.e. 814not automatically cleaned up after the parameterized test ends) and for any other 815exit logic. 816 817Both ``param_init()`` and ``param_exit()`` are passed the parameterized test 818context behind the scenes. However, the test case function receives the parameter 819run context. Therefore, to manage and access shared resources from within a test 820case function, you must use ``test->parent``. 821 822For instance, finding a shared resource allocated by the Resource API requires 823passing ``test->parent`` to ``kunit_find_resource()``. This principle extends to 824all other APIs that might be used in the test case function, including 825``kunit_kzalloc()``, ``kunit_kmalloc_array()``, and others (see 826Documentation/dev-tools/kunit/api/test.rst and the 827Documentation/dev-tools/kunit/api/resource.rst). 828 829.. note:: 830 The ``suite->init()`` function, which executes before each parameter run, 831 receives the parameter run context. Therefore, any resources set up in 832 ``suite->init()`` are cleaned up after each parameter run. 833 834The code below shows how you can add the shared resources. Note that this code 835utilizes the Resource API, which you can read more about here: 836Documentation/dev-tools/kunit/api/resource.rst. To see the full version of this 837code please refer to lib/kunit/kunit-example-test.c. 838 839.. code-block:: c 840 841 static int example_resource_init(struct kunit_resource *res, void *context) 842 { 843 ... /* Code that allocates memory and stores context in res->data. */ 844 } 845 846 /* This function deallocates memory for the kunit_resource->data field. */ 847 static void example_resource_free(struct kunit_resource *res) 848 { 849 kfree(res->data); 850 } 851 852 /* This match function locates a test resource based on defined criteria. */ 853 static bool example_resource_alloc_match(struct kunit *test, struct kunit_resource *res, 854 void *match_data) 855 { 856 return res->data && res->free == example_resource_free; 857 } 858 859 /* Function to initialize the parameterized test. */ 860 static int example_param_init(struct kunit *test) 861 { 862 int ctx = 3; /* Data to be stored. */ 863 void *data = kunit_alloc_resource(test, example_resource_init, 864 example_resource_free, 865 GFP_KERNEL, &ctx); 866 if (!data) 867 return -ENOMEM; 868 kunit_register_params_array(test, example_params_array, 869 ARRAY_SIZE(example_params_array)); 870 return 0; 871 } 872 873 /* Example test that uses shared resources in test->resources. */ 874 static void example_params_test_with_init(struct kunit *test) 875 { 876 int threshold; 877 const struct example_param *param = test->param_value; 878 /* Here we pass test->parent to access the parameterized test context. */ 879 struct kunit_resource *res = kunit_find_resource(test->parent, 880 example_resource_alloc_match, 881 NULL); 882 883 threshold = *((int *)res->data); 884 KUNIT_ASSERT_LE(test, param->value, threshold); 885 kunit_put_resource(res); 886 } 887 888 static struct kunit_case example_test_cases[] = { 889 KUNIT_CASE_PARAM_WITH_INIT(example_params_test_with_init, kunit_array_gen_params, 890 example_param_init, NULL), 891 {} 892 }; 893 894As an alternative to using the KUnit Resource API for sharing resources, you can 895place them in ``test->parent->priv``. This serves as a more lightweight method 896for resource storage, best for scenarios where complex resource management is 897not required. 898 899As stated previously ``param_init()`` and ``param_exit()`` get the parameterized 900test context. So, you can directly use ``test->priv`` within ``param_init/exit`` 901to manage shared resources. However, from within the test case function, you must 902navigate up to the parent ``struct kunit`` i.e. the parameterized test context. 903Therefore, you need to use ``test->parent->priv`` to access those same 904resources. 905 906The resources placed in ``test->parent->priv`` will need to be allocated in 907memory to persist across the parameter runs. If memory is allocated using the 908KUnit memory allocation APIs (described more in the "Allocating Memory" section 909below), you won't need to worry about deallocation. The APIs will make the memory 910parameterized test 'managed', ensuring that it will automatically get cleaned up 911after the parameterized test concludes. 912 913The code below demonstrates example usage of the ``priv`` field for shared 914resources: 915 916.. code-block:: c 917 918 static const struct example_param { 919 int value; 920 } example_params_array[] = { 921 { .value = 3, }, 922 { .value = 2, }, 923 { .value = 1, }, 924 { .value = 0, }, 925 }; 926 927 /* Initialize the parameterized test context. */ 928 static int example_param_init_priv(struct kunit *test) 929 { 930 int ctx = 3; /* Data to be stored. */ 931 int arr_size = ARRAY_SIZE(example_params_array); 932 933 /* 934 * Allocate memory using kunit_kzalloc(). Since the `param_init` 935 * function receives the parameterized test context, this memory 936 * allocation will be scoped to the lifetime of the parameterized test. 937 */ 938 test->priv = kunit_kzalloc(test, sizeof(int), GFP_KERNEL); 939 940 /* Assign the context value to test->priv.*/ 941 *((int *)test->priv) = ctx; 942 943 /* Register the parameter array. */ 944 kunit_register_params_array(test, example_params_array, arr_size, NULL); 945 return 0; 946 } 947 948 static void example_params_test_with_init_priv(struct kunit *test) 949 { 950 int threshold; 951 const struct example_param *param = test->param_value; 952 953 /* By design, test->parent will not be NULL. */ 954 KUNIT_ASSERT_NOT_NULL(test, test->parent); 955 956 /* Here we use test->parent->priv to access the shared resource. */ 957 threshold = *(int *)test->parent->priv; 958 959 KUNIT_ASSERT_LE(test, param->value, threshold); 960 } 961 962 static struct kunit_case example_tests[] = { 963 KUNIT_CASE_PARAM_WITH_INIT(example_params_test_with_init_priv, 964 kunit_array_gen_params, 965 example_param_init_priv, NULL), 966 {} 967 }; 968 969Allocating Memory 970----------------- 971 972Where you might use ``kzalloc``, you can instead use ``kunit_kzalloc`` as KUnit 973will then ensure that the memory is freed once the test completes. 974 975This is useful because it lets us use the ``KUNIT_ASSERT_EQ`` macros to exit 976early from a test without having to worry about remembering to call ``kfree``. 977For example: 978 979.. code-block:: c 980 981 void example_test_allocation(struct kunit *test) 982 { 983 char *buffer = kunit_kzalloc(test, 16, GFP_KERNEL); 984 /* Ensure allocation succeeded. */ 985 KUNIT_ASSERT_NOT_ERR_OR_NULL(test, buffer); 986 987 KUNIT_ASSERT_STREQ(test, buffer, ""); 988 } 989 990Registering Cleanup Actions 991--------------------------- 992 993If you need to perform some cleanup beyond simple use of ``kunit_kzalloc``, 994you can register a custom "deferred action", which is a cleanup function 995run when the test exits (whether cleanly, or via a failed assertion). 996 997Actions are simple functions with no return value, and a single ``void*`` 998context argument, and fulfill the same role as "cleanup" functions in Python 999and Go tests, "defer" statements in languages which support them, and 1000(in some cases) destructors in RAII languages. 1001 1002These are very useful for unregistering things from global lists, closing 1003files or other resources, or freeing resources. 1004 1005For example: 1006 1007.. code-block:: C 1008 1009 static void cleanup_device(void *ctx) 1010 { 1011 struct device *dev = (struct device *)ctx; 1012 1013 device_unregister(dev); 1014 } 1015 1016 void example_device_test(struct kunit *test) 1017 { 1018 struct my_device dev; 1019 1020 device_register(&dev); 1021 1022 kunit_add_action(test, &cleanup_device, &dev); 1023 } 1024 1025Note that, for functions like device_unregister which only accept a single 1026pointer-sized argument, it's possible to automatically generate a wrapper 1027with the ``KUNIT_DEFINE_ACTION_WRAPPER()`` macro, for example: 1028 1029.. code-block:: C 1030 1031 KUNIT_DEFINE_ACTION_WRAPPER(device_unregister, device_unregister_wrapper, struct device *); 1032 kunit_add_action(test, &device_unregister_wrapper, &dev); 1033 1034You should do this in preference to manually casting to the ``kunit_action_t`` type, 1035as casting function pointers will break Control Flow Integrity (CFI). 1036 1037``kunit_add_action`` can fail if, for example, the system is out of memory. 1038You can use ``kunit_add_action_or_reset`` instead which runs the action 1039immediately if it cannot be deferred. 1040 1041If you need more control over when the cleanup function is called, you 1042can trigger it early using ``kunit_release_action``, or cancel it entirely 1043with ``kunit_remove_action``. 1044 1045 1046Testing Static Functions 1047------------------------ 1048 1049If you want to test static functions without exposing those functions outside of 1050testing, one option is conditionally export the symbol. When KUnit is enabled, 1051the symbol is exposed but remains static otherwise. To use this method, follow 1052the template below. 1053 1054.. code-block:: c 1055 1056 /* In the file containing functions to test "my_file.c" */ 1057 1058 #include <kunit/visibility.h> 1059 #include <my_file.h> 1060 ... 1061 VISIBLE_IF_KUNIT int do_interesting_thing() 1062 { 1063 ... 1064 } 1065 EXPORT_SYMBOL_IF_KUNIT(do_interesting_thing); 1066 1067 /* In the header file "my_file.h" */ 1068 1069 #if IS_ENABLED(CONFIG_KUNIT) 1070 int do_interesting_thing(void); 1071 #endif 1072 1073 /* In the KUnit test file "my_file_test.c" */ 1074 1075 #include <kunit/visibility.h> 1076 #include <my_file.h> 1077 ... 1078 MODULE_IMPORT_NS("EXPORTED_FOR_KUNIT_TESTING"); 1079 ... 1080 // Use do_interesting_thing() in tests 1081 1082For a full example, see this `patch <https://lore.kernel.org/all/20221207014024.340230-3-rmoar@google.com/>`_ 1083where a test is modified to conditionally expose static functions for testing 1084using the macros above. 1085 1086As an **alternative** to the method above, you could conditionally ``#include`` 1087the test file at the end of your .c file. This is not recommended but works 1088if needed. For example: 1089 1090.. code-block:: c 1091 1092 /* In "my_file.c" */ 1093 1094 static int do_interesting_thing(); 1095 1096 #ifdef CONFIG_MY_KUNIT_TEST 1097 #include "my_kunit_test.c" 1098 #endif 1099 1100Injecting Test-Only Code 1101------------------------ 1102 1103Similar to as shown above, we can add test-specific logic. For example: 1104 1105.. code-block:: c 1106 1107 /* In my_file.h */ 1108 1109 #ifdef CONFIG_MY_KUNIT_TEST 1110 /* Defined in my_kunit_test.c */ 1111 void test_only_hook(void); 1112 #else 1113 void test_only_hook(void) { } 1114 #endif 1115 1116This test-only code can be made more useful by accessing the current ``kunit_test`` 1117as shown in next section: *Accessing The Current Test*. 1118 1119Accessing The Current Test 1120-------------------------- 1121 1122In some cases, we need to call test-only code from outside the test file. This 1123is helpful, for example, when providing a fake implementation of a function, or 1124to fail any current test from within an error handler. 1125We can do this via the ``kunit_test`` field in ``task_struct``, which we can 1126access using the ``kunit_get_current_test()`` function in ``kunit/test-bug.h``. 1127 1128``kunit_get_current_test()`` is safe to call even if KUnit is not enabled. If 1129KUnit is not enabled, or if no test is running in the current task, it will 1130return ``NULL``. This compiles down to either a no-op or a static key check, 1131so will have a negligible performance impact when no test is running. 1132 1133The example below uses this to implement a "mock" implementation of a function, ``foo``: 1134 1135.. code-block:: c 1136 1137 #include <kunit/test-bug.h> /* for kunit_get_current_test */ 1138 1139 struct test_data { 1140 int foo_result; 1141 int want_foo_called_with; 1142 }; 1143 1144 static int fake_foo(int arg) 1145 { 1146 struct kunit *test = kunit_get_current_test(); 1147 struct test_data *test_data = test->priv; 1148 1149 KUNIT_EXPECT_EQ(test, test_data->want_foo_called_with, arg); 1150 return test_data->foo_result; 1151 } 1152 1153 static void example_simple_test(struct kunit *test) 1154 { 1155 /* Assume priv (private, a member used to pass test data from 1156 * the init function) is allocated in the suite's .init */ 1157 struct test_data *test_data = test->priv; 1158 1159 test_data->foo_result = 42; 1160 test_data->want_foo_called_with = 1; 1161 1162 /* In a real test, we'd probably pass a pointer to fake_foo somewhere 1163 * like an ops struct, etc. instead of calling it directly. */ 1164 KUNIT_EXPECT_EQ(test, fake_foo(1), 42); 1165 } 1166 1167In this example, we are using the ``priv`` member of ``struct kunit`` as a way 1168of passing data to the test from the init function. In general ``priv`` is 1169pointer that can be used for any user data. This is preferred over static 1170variables, as it avoids concurrency issues. 1171 1172Had we wanted something more flexible, we could have used a named ``kunit_resource``. 1173Each test can have multiple resources which have string names providing the same 1174flexibility as a ``priv`` member, but also, for example, allowing helper 1175functions to create resources without conflicting with each other. It is also 1176possible to define a clean up function for each resource, making it easy to 1177avoid resource leaks. For more information, see Documentation/dev-tools/kunit/api/resource.rst. 1178 1179Failing The Current Test 1180------------------------ 1181 1182If we want to fail the current test, we can use ``kunit_fail_current_test(fmt, args...)`` 1183which is defined in ``<kunit/test-bug.h>`` and does not require pulling in ``<kunit/test.h>``. 1184For example, we have an option to enable some extra debug checks on some data 1185structures as shown below: 1186 1187.. code-block:: c 1188 1189 #include <kunit/test-bug.h> 1190 1191 #ifdef CONFIG_EXTRA_DEBUG_CHECKS 1192 static void validate_my_data(struct data *data) 1193 { 1194 if (is_valid(data)) 1195 return; 1196 1197 kunit_fail_current_test("data %p is invalid", data); 1198 1199 /* Normal, non-KUnit, error reporting code here. */ 1200 } 1201 #else 1202 static void my_debug_function(void) { } 1203 #endif 1204 1205``kunit_fail_current_test()`` is safe to call even if KUnit is not enabled. If 1206KUnit is not enabled, or if no test is running in the current task, it will do 1207nothing. This compiles down to either a no-op or a static key check, so will 1208have a negligible performance impact when no test is running. 1209 1210Managing Fake Devices and Drivers 1211--------------------------------- 1212 1213When testing drivers or code which interacts with drivers, many functions will 1214require a ``struct device`` or ``struct device_driver``. In many cases, setting 1215up a real device is not required to test any given function, so a fake device 1216can be used instead. 1217 1218KUnit provides helper functions to create and manage these fake devices, which 1219are internally of type ``struct kunit_device``, and are attached to a special 1220``kunit_bus``. These devices support managed device resources (devres), as 1221described in Documentation/driver-api/driver-model/devres.rst 1222 1223To create a KUnit-managed ``struct device_driver``, use ``kunit_driver_create()``, 1224which will create a driver with the given name, on the ``kunit_bus``. This driver 1225will automatically be destroyed when the corresponding test finishes, but can also 1226be manually destroyed with ``driver_unregister()``. 1227 1228To create a fake device, use the ``kunit_device_register()``, which will create 1229and register a device, using a new KUnit-managed driver created with ``kunit_driver_create()``. 1230To provide a specific, non-KUnit-managed driver, use ``kunit_device_register_with_driver()`` 1231instead. Like with managed drivers, KUnit-managed fake devices are automatically 1232cleaned up when the test finishes, but can be manually cleaned up early with 1233``kunit_device_unregister()``. 1234 1235The KUnit devices should be used in preference to ``root_device_register()``, and 1236instead of ``platform_device_register()`` in cases where the device is not otherwise 1237a platform device. 1238 1239For example: 1240 1241.. code-block:: c 1242 1243 #include <kunit/device.h> 1244 1245 static void test_my_device(struct kunit *test) 1246 { 1247 struct device *fake_device; 1248 const char *dev_managed_string; 1249 1250 // Create a fake device. 1251 fake_device = kunit_device_register(test, "my_device"); 1252 KUNIT_ASSERT_NOT_ERR_OR_NULL(test, fake_device) 1253 1254 // Pass it to functions which need a device. 1255 dev_managed_string = devm_kstrdup(fake_device, "Hello, World!"); 1256 1257 // Everything is cleaned up automatically when the test ends. 1258 } 1259