1.. SPDX-License-Identifier: GPL-2.0 2 3.. _kfuncs-header-label: 4 5============================= 6BPF Kernel Functions (kfuncs) 7============================= 8 91. Introduction 10=============== 11 12BPF Kernel Functions or more commonly known as kfuncs are functions in the Linux 13kernel which are exposed for use by BPF programs. Unlike normal BPF helpers, 14kfuncs do not have a stable interface and can change from one kernel release to 15another. Hence, BPF programs need to be updated in response to changes in the 16kernel. See :ref:`BPF_kfunc_lifecycle_expectations` for more information. 17 182. Defining a kfunc 19=================== 20 21There are two ways to expose a kernel function to BPF programs, either make an 22existing function in the kernel visible, or add a new wrapper for BPF. In both 23cases, care must be taken that BPF program can only call such function in a 24valid context. To enforce this, visibility of a kfunc can be per program type. 25 26If you are not creating a BPF wrapper for existing kernel function, skip ahead 27to :ref:`BPF_kfunc_nodef`. 28 292.1 Creating a wrapper kfunc 30---------------------------- 31 32When defining a wrapper kfunc, the wrapper function should have extern linkage. 33This prevents the compiler from optimizing away dead code, as this wrapper kfunc 34is not invoked anywhere in the kernel itself. It is not necessary to provide a 35prototype in a header for the wrapper kfunc. 36 37An example is given below:: 38 39 /* Disables missing prototype warnings */ 40 __bpf_kfunc_start_defs(); 41 42 __bpf_kfunc struct task_struct *bpf_find_get_task_by_vpid(pid_t nr) 43 { 44 return find_get_task_by_vpid(nr); 45 } 46 47 __bpf_kfunc_end_defs(); 48 49A wrapper kfunc is often needed when we need to annotate parameters of the 50kfunc. Otherwise one may directly make the kfunc visible to the BPF program by 51registering it with the BPF subsystem. See :ref:`BPF_kfunc_nodef`. 52 532.2 kfunc Parameters 54-------------------- 55 56All kfuncs now require trusted arguments by default. This means that all 57pointer arguments must be valid, and all pointers to BTF objects must be 58passed in their unmodified form (at a zero offset, and without having been 59obtained from walking another pointer, with exceptions described below). 60 61There are two types of pointers to kernel objects which are considered "trusted": 62 631. Pointers which are passed as tracepoint or struct_ops callback arguments. 642. Pointers which were returned from a KF_ACQUIRE kfunc. 65 66Pointers to non-BTF objects (e.g. scalar pointers) may also be passed to 67kfuncs, and may have a non-zero offset. 68 69The definition of "valid" pointers is subject to change at any time, and has 70absolutely no ABI stability guarantees. 71 72As mentioned above, a nested pointer obtained from walking a trusted pointer is 73no longer trusted, with one exception. If a struct type has a field that is 74guaranteed to be valid (trusted or rcu, as in KF_RCU description below) as long 75as its parent pointer is valid, the following macros can be used to express 76that to the verifier: 77 78* ``BTF_TYPE_SAFE_TRUSTED`` 79* ``BTF_TYPE_SAFE_RCU`` 80* ``BTF_TYPE_SAFE_RCU_OR_NULL`` 81 82For example, 83 84.. code-block:: c 85 86 BTF_TYPE_SAFE_TRUSTED(struct socket) { 87 struct sock *sk; 88 }; 89 90or 91 92.. code-block:: c 93 94 BTF_TYPE_SAFE_RCU(struct task_struct) { 95 const cpumask_t *cpus_ptr; 96 struct css_set __rcu *cgroups; 97 struct task_struct __rcu *real_parent; 98 struct task_struct *group_leader; 99 }; 100 101In other words, you must: 102 1031. Wrap the valid pointer type in a ``BTF_TYPE_SAFE_*`` macro. 104 1052. Specify the type and name of the valid nested field. This field must match 106 the field in the original type definition exactly. 107 108A new type declared by a ``BTF_TYPE_SAFE_*`` macro also needs to be emitted so 109that it appears in BTF. For example, ``BTF_TYPE_SAFE_TRUSTED(struct socket)`` 110is emitted in the ``type_is_trusted()`` function as follows: 111 112.. code-block:: c 113 114 BTF_TYPE_EMIT(BTF_TYPE_SAFE_TRUSTED(struct socket)); 115 1162.3 Annotating kfunc parameters 117------------------------------- 118 119Similar to BPF helpers, there is sometime need for additional context required 120by the verifier to make the usage of kernel functions safer and more useful. 121Hence, we can annotate a parameter by suffixing the name of the argument of the 122kfunc with a __tag, where tag may be one of the supported annotations. 123 1242.3.1 __sz Annotation 125--------------------- 126 127This annotation is used to indicate a memory and size pair in the argument list. 128An example is given below:: 129 130 __bpf_kfunc void bpf_memzero(void *mem, int mem__sz) 131 { 132 ... 133 } 134 135Here, the verifier will treat first argument as a PTR_TO_MEM, and second 136argument as its size. By default, without __sz annotation, the size of the type 137of the pointer is used. Without __sz annotation, a kfunc cannot accept a void 138pointer. 139 1402.3.2 __k Annotation 141-------------------- 142 143This annotation is only understood for scalar arguments, where it indicates that 144the verifier must check the scalar argument to be a known constant, which does 145not indicate a size parameter, and the value of the constant is relevant to the 146safety of the program. 147 148An example is given below:: 149 150 __bpf_kfunc void *bpf_obj_new(u32 local_type_id__k, ...) 151 { 152 ... 153 } 154 155Here, bpf_obj_new uses local_type_id argument to find out the size of that type 156ID in program's BTF and return a sized pointer to it. Each type ID will have a 157distinct size, hence it is crucial to treat each such call as distinct when 158values don't match during verifier state pruning checks. 159 160Hence, whenever a constant scalar argument is accepted by a kfunc which is not a 161size parameter, and the value of the constant matters for program safety, __k 162suffix should be used. 163 1642.3.3 __uninit Annotation 165------------------------- 166 167This annotation is used to indicate that the argument will be treated as 168uninitialized. 169 170An example is given below:: 171 172 __bpf_kfunc int bpf_dynptr_from_skb(..., struct bpf_dynptr_kern *ptr__uninit) 173 { 174 ... 175 } 176 177Here, the dynptr will be treated as an uninitialized dynptr. Without this 178annotation, the verifier will reject the program if the dynptr passed in is 179not initialized. 180 1812.3.4 __nullable Annotation 182--------------------------- 183 184This annotation is used to indicate that the pointer argument may be NULL. 185The verifier will allow passing NULL for such arguments. 186 187An example is given below:: 188 189 __bpf_kfunc void bpf_task_release(struct task_struct *task__nullable) 190 { 191 ... 192 } 193 194Here, the task pointer may be NULL. The kfunc is responsible for checking if 195the pointer is NULL before dereferencing it. 196 197The __nullable annotation can be combined with other annotations. For example, 198when used with __sz or __szk annotations for memory and size pairs, the 199verifier will skip size validation when a NULL pointer is passed, but will 200still process the size argument to extract constant size information when 201needed:: 202 203 __bpf_kfunc void *bpf_dynptr_slice(..., void *buffer__nullable, 204 u32 buffer__szk) 205 206Here, the buffer may be NULL. If the buffer is not NULL, it must be at least 207buffer__szk bytes in size. The kfunc is responsible for checking if the buffer 208is NULL before using it. 209 2102.3.5 __nonown_allowed Annotation 211--------------------------------- 212 213This annotation is used to indicate that the parameter may be a non-owning reference. 214 215An example is given below:: 216 217 __bpf_kfunc int bpf_list_add(..., struct bpf_list_node 218 *prev__nonown_allowed, ...) 219 { 220 ... 221 } 222 223For the ``prev__nonown_allowed`` parameter (resolved as ``KF_ARG_PTR_TO_LIST_NODE``), 224suffix ``__nonown_allowed`` retains the usual owning-pointer rules and also 225permits a non-owning reference with no ref_obj_id (e.g. the return value of 226bpf_list_front() / bpf_list_back()). 227 2282.3.6 __str Annotation 229---------------------- 230This annotation is used to indicate that the argument is a constant string. 231 232An example is given below:: 233 234 __bpf_kfunc bpf_get_file_xattr(..., const char *name__str, ...) 235 { 236 ... 237 } 238 239In this case, ``bpf_get_file_xattr()`` can be called as:: 240 241 bpf_get_file_xattr(..., "xattr_name", ...); 242 243Or:: 244 245 const char name[] = "xattr_name"; /* This need to be global */ 246 int BPF_PROG(...) 247 { 248 ... 249 bpf_get_file_xattr(..., name, ...); 250 ... 251 } 252 2532.3.7 __const_map and __map Annotations 254--------------------------------------- 255 256These annotations are used for ``struct bpf_map *`` arguments and distinguish a 257verifier-known map from an opaque one. 258 259``__const_map`` indicates a map must be known at the verification time, i.e. a 260concrete map fd the BPF program references directly. 261 262An example is given below:: 263 264 __bpf_kfunc int bpf_wq_init(struct bpf_wq *wq, void *p__const_map, 265 unsigned int flags) 266 { 267 ... 268 } 269 270``__map`` indicates an opaque ``struct bpf_map *`` that may be resolved 271at run time. The argument may take either a map fd or a ``PTR_TO_BTF_ID`` 272``struct bpf_map`` pointer. 273 274An example is given below:: 275 276 __bpf_kfunc void *bpf_arena_alloc_pages(void *p__map, ...) 277 { 278 ... 279 } 280 2812.3.8 __arena and __arena__nullable Annotations 282----------------------------------------------- 283 284Both annotations indicate that the pointer argument points into the 285calling program's arena. The JIT rebases the value at the call site so 286the kfunc receives a directly dereferenceable kernel address, subject to 287the access rules described in :ref:`BPF_kfunc_arena_access` (at most 288``GUARD_SZ / 2``, 32 KiB, past the pointer in a single unchecked access). 289 290With ``__arena`` the rebase is unconditional and the argument is never 291NULL: a value whose lower 32 bits are zero arrives as the arena base 292address (arena offset 0). The kfunc must not check the argument for NULL. 293With ``__arena__nullable`` such a value arrives as NULL instead and the 294kfunc must check before dereferencing. 295 296An example is given below:: 297 298 __bpf_kfunc int bpf_process_item(struct item *item__arena) 299 { 300 ... 301 } 302 303Calling such a kfunc requires the program to use an arena map and a JIT with 304arena argument support (currently x86-64 and arm64); verification fails 305otherwise. The program can pass any value without compromising the kernel. A 306value that does not point into the arena is a program bug. 307 308The suffixes have the same meaning on the arguments of struct_ops stub 309functions, with the conversion running in the opposite direction. The 310kernel caller passes the kernel arena address and the trampoline converts 311it while saving the arguments, so the callback receives an arena pointer 312it can dereference directly. With ``__arena`` the kernel caller must not 313pass NULL. With ``__arena__nullable`` a NULL kernel pointer arrives as NULL. 314However, there is no obligation to prove to the verifier that such a pointer is 315non-NULL before use, in-line with existing semantics of arena pointers used in 316a program (or obtained from any other source). 317 318.. _BPF_kfunc_nodef: 319 3202.4 Using an existing kernel function 321------------------------------------- 322 323When an existing function in the kernel is fit for consumption by BPF programs, 324it can be directly registered with the BPF subsystem. However, care must still 325be taken to review the context in which it will be invoked by the BPF program 326and whether it is safe to do so. 327 3282.5 Annotating kfuncs 329--------------------- 330 331In addition to kfuncs' arguments, verifier may need more information about the 332type of kfunc(s) being registered with the BPF subsystem. To do so, we define 333flags on a set of kfuncs as follows:: 334 335 BTF_KFUNCS_START(bpf_task_set) 336 BTF_ID_FLAGS(func, bpf_get_task_pid, KF_ACQUIRE | KF_RET_NULL) 337 BTF_ID_FLAGS(func, bpf_put_pid, KF_RELEASE) 338 BTF_KFUNCS_END(bpf_task_set) 339 340This set encodes the BTF ID of each kfunc listed above, and encodes the flags 341along with it. It is also allowed to specify no flags. 342 343kfunc definitions should also always be annotated with the ``__bpf_kfunc`` 344macro. This prevents issues such as the compiler inlining the kfunc, or the 345function being elided in an LTO build as it's not used in the rest of the 346kernel. Developers should not manually add annotations to their kfunc to prevent 347these issues. If an annotation is required to prevent such an issue with your 348kfunc, it is a bug and should be added to the definition of the macro so that 349other kfuncs are similarly protected. An example is given below:: 350 351 __bpf_kfunc struct task_struct *bpf_get_task_pid(s32 pid) 352 { 353 ... 354 } 355 356Note that kfuncs must not be declared ``static``. A kfunc can be called from a 357BPF program ``*.c`` file outside the compilation unit that defines it, so its 358externally visible name must remain available for BTF ID lookup. ``static`` 359linkage allows the compiler to rename the function, which can break this 360BTF-based kfunc resolution. Further note that sparse may warn that an otherwise 361unreferenced kfunc should be static. Such warnings should be ignored for kfunc 362definitions. 363 3642.5.1 KF_ACQUIRE flag 365--------------------- 366 367The KF_ACQUIRE flag is used to indicate that the kfunc returns a pointer to a 368refcounted object. The verifier will then ensure that the pointer to the object 369is eventually released using a release kfunc, or transferred to a map using a 370referenced kptr (by invoking bpf_kptr_xchg). If not, the verifier fails the 371loading of the BPF program until no lingering references remain in all possible 372explored states of the program. 373 3742.5.2 KF_RET_NULL flag 375---------------------- 376 377The KF_RET_NULL flag is used to indicate that the pointer returned by the kfunc 378may be NULL. Hence, it forces the user to do a NULL check on the pointer 379returned from the kfunc before making use of it (dereferencing or passing to 380another helper). This flag is often used in pairing with KF_ACQUIRE flag, but 381both are orthogonal to each other. 382 3832.5.3 KF_RELEASE flag 384--------------------- 385 386The KF_RELEASE flag is used to indicate that the kfunc releases the pointer 387passed in to it. There can be only one referenced pointer that can be passed 388in. All copies of the pointer being released are invalidated as a result of 389invoking kfunc with this flag. 390 3912.5.4 KF_SLEEPABLE flag 392----------------------- 393 394The KF_SLEEPABLE flag is used for kfuncs that may sleep. Such kfuncs can only 395be called by sleepable BPF programs (BPF_F_SLEEPABLE). 396 3972.5.5 KF_DESTRUCTIVE flag 398-------------------------- 399 400The KF_DESTRUCTIVE flag is used to indicate functions calling which is 401destructive to the system. For example such a call can result in system 402rebooting or panicking. Due to this additional restrictions apply to these 403calls. At the moment they only require CAP_SYS_BOOT capability, but more can be 404added later. 405 4062.5.6 KF_RCU flag 407----------------- 408 409The KF_RCU flag allows kfuncs to opt out of the default trusted args 410requirement and accept RCU pointers with weaker guarantees. The kfuncs marked 411with KF_RCU expect either PTR_TRUSTED or MEM_RCU arguments. The verifier 412guarantees that the objects are valid and there is no use-after-free. The 413pointers are not NULL, but the object's refcount could have reached zero. The 414kfuncs need to consider doing refcnt != 0 check, especially when returning a 415KF_ACQUIRE pointer. Note as well that a KF_ACQUIRE kfunc that is KF_RCU should 416very likely also be KF_RET_NULL. 417 4182.5.7 KF_RCU_PROTECTED flag 419--------------------------- 420 421The KF_RCU_PROTECTED flag is used to indicate that the kfunc must be invoked in 422an RCU critical section. This is assumed by default in non-sleepable programs, 423and must be explicitly ensured by calling ``bpf_rcu_read_lock`` for sleepable 424ones. 425 426If the kfunc returns a pointer value, this flag also enforces that the returned 427pointer is RCU protected, and can only be used while the RCU critical section is 428active. 429 430The flag is distinct from the ``KF_RCU`` flag, which only ensures that its 431arguments are at least RCU protected pointers. This may transitively imply that 432RCU protection is ensured, but it does not work in cases of kfuncs which require 433RCU protection but do not take RCU protected arguments. 434 435.. _KF_deprecated_flag: 436 4372.5.8 KF_DEPRECATED flag 438------------------------ 439 440The KF_DEPRECATED flag is used for kfuncs which are scheduled to be 441changed or removed in a subsequent kernel release. A kfunc that is 442marked with KF_DEPRECATED should also have any relevant information 443captured in its kernel doc. Such information typically includes the 444kfunc's expected remaining lifespan, a recommendation for new 445functionality that can replace it if any is available, and possibly a 446rationale for why it is being removed. 447 448Note that while on some occasions, a KF_DEPRECATED kfunc may continue to be 449supported and have its KF_DEPRECATED flag removed, it is likely to be far more 450difficult to remove a KF_DEPRECATED flag after it's been added than it is to 451prevent it from being added in the first place. As described in 452:ref:`BPF_kfunc_lifecycle_expectations`, users that rely on specific kfuncs are 453encouraged to make their use-cases known as early as possible, and participate 454in upstream discussions regarding whether to keep, change, deprecate, or remove 455those kfuncs if and when such discussions occur. 456 4572.5.9 KF_IMPLICIT_ARGS flag 458------------------------------------ 459 460The KF_IMPLICIT_ARGS flag is used to indicate that the BPF signature 461of the kfunc is different from it's kernel signature, and the values 462for implicit arguments are provided at load time by the verifier. 463 464Only arguments of specific types are implicit. 465Currently only ``struct bpf_prog_aux *`` type is supported. 466 467A kfunc with KF_IMPLICIT_ARGS flag therefore has two types in BTF: one 468function matching the kernel declaration (with _impl suffix in the 469name by convention), and another matching the intended BPF API. 470 471Verifier only allows calls to the non-_impl version of a kfunc, that 472uses a signature without the implicit arguments. 473 474Example declaration: 475 476.. code-block:: c 477 478 __bpf_kfunc int bpf_task_work_schedule_signal(struct task_struct *task, struct bpf_task_work *tw, 479 void *map__const_map, bpf_task_work_callback_t callback, 480 struct bpf_prog_aux *aux) { ... } 481 482Example usage in BPF program: 483 484.. code-block:: c 485 486 /* note that the last argument is omitted */ 487 bpf_task_work_schedule_signal(task, &work->tw, &arrmap, task_work_callback); 488 4892.5.10 KF_PERFMON flag 490---------------------- 491 492The KF_PERFMON flag is used for kfuncs that can expose kernel memory or kernel 493addresses to the BPF program, for example by reading through a pointer that the 494verifier does not check. Calling such a kfunc requires CAP_PERFMON, or 495CAP_SYS_ADMIN, in the same way that the equivalent BPF helpers are gated in 496bpf_base_func_proto(). A program loaded with CAP_BPF alone is rejected at load 497time. 498 4992.6 Registering the kfuncs 500-------------------------- 501 502Once the kfunc is prepared for use, the final step to making it visible is 503registering it with the BPF subsystem. Registration is done per BPF program 504type. An example is shown below:: 505 506 BTF_KFUNCS_START(bpf_task_set) 507 BTF_ID_FLAGS(func, bpf_get_task_pid, KF_ACQUIRE | KF_RET_NULL) 508 BTF_ID_FLAGS(func, bpf_put_pid, KF_RELEASE) 509 BTF_KFUNCS_END(bpf_task_set) 510 511 static const struct btf_kfunc_id_set bpf_task_kfunc_set = { 512 .owner = THIS_MODULE, 513 .set = &bpf_task_set, 514 }; 515 516 static int init_subsystem(void) 517 { 518 return register_btf_kfunc_id_set(BPF_PROG_TYPE_TRACING, &bpf_task_kfunc_set); 519 } 520 late_initcall(init_subsystem); 521 522At kernel build time the ``resolve_btfids`` tool finds all kfuncs declared with 523``BTF_KFUNCS_START()`` and emits their BTF annotations into the kernel's BTF. 524For each kfunc it emits a ``bpf_kfunc`` BTF decl tag, a ``bpf_fastcall`` decl 525tag when the kfunc is flagged ``KF_FASTCALL``, and the ``address_space(1)`` type 526attribute on the return value and/or arguments that use arena pointers (see 527sections 2.3.8 and 2.8). 528 5292.7 Specifying no-cast aliases with ___init 530-------------------------------------------- 531 532The verifier will always enforce that the BTF type of a pointer passed to a 533kfunc by a BPF program, matches the type of pointer specified in the kfunc 534definition. The verifier, does, however, allow types that are equivalent 535according to the C standard to be passed to the same kfunc arg, even if their 536BTF_IDs differ. 537 538For example, for the following type definition: 539 540.. code-block:: c 541 542 struct bpf_cpumask { 543 cpumask_t cpumask; 544 refcount_t usage; 545 }; 546 547The verifier would allow a ``struct bpf_cpumask *`` to be passed to a kfunc 548taking a ``cpumask_t *`` (which is a typedef of ``struct cpumask *``). For 549instance, both ``struct cpumask *`` and ``struct bpf_cpmuask *`` can be passed 550to bpf_cpumask_test_cpu(). 551 552In some cases, this type-aliasing behavior is not desired. ``struct 553nf_conn___init`` is one such example: 554 555.. code-block:: c 556 557 struct nf_conn___init { 558 struct nf_conn ct; 559 }; 560 561The C standard would consider these types to be equivalent, but it would not 562always be safe to pass either type to a trusted kfunc. ``struct 563nf_conn___init`` represents an allocated ``struct nf_conn`` object that has 564*not yet been initialized*, so it would therefore be unsafe to pass a ``struct 565nf_conn___init *`` to a kfunc that's expecting a fully initialized ``struct 566nf_conn *`` (e.g. ``bpf_ct_change_timeout()``). 567 568In order to accommodate such requirements, the verifier will enforce strict 569PTR_TO_BTF_ID type matching if two types have the exact same name, with one 570being suffixed with ``___init``. 571 572.. _BPF_kfunc_arena_access: 573 5742.8 Accessing arena memory through kfunc arguments 575-------------------------------------------------- 576 577A read or write at any address inside an arena does not oops the kernel. 578Unallocated arena pages are lazily backed by a scratch page and the 579access is reported through the program's BPF stream as an error. Only 580the BPF program's correctness is affected; the kernel itself remains 581intact. 582 583The arena is followed by a ``GUARD_SZ / 2`` (32 KiB) guard region that 584is also covered by this recovery. A kfunc handed an arena pointer may 585therefore access up to ``GUARD_SZ / 2`` past it without bounds-checking 586against the arena. Larger accesses must verify the range explicitly. 587 588.. _BPF_kfunc_lifecycle_expectations: 589 5903. kfunc lifecycle expectations 591=============================== 592 593kfuncs provide a kernel <-> kernel API, and thus are not bound by any of the 594strict stability restrictions associated with kernel <-> user UAPIs. This means 595they can be thought of as similar to EXPORT_SYMBOL_GPL, and can therefore be 596modified or removed by a maintainer of the subsystem they're defined in when 597it's deemed necessary. 598 599Like any other change to the kernel, maintainers will not change or remove a 600kfunc without having a reasonable justification. Whether or not they'll choose 601to change a kfunc will ultimately depend on a variety of factors, such as how 602widely used the kfunc is, how long the kfunc has been in the kernel, whether an 603alternative kfunc exists, what the norm is in terms of stability for the 604subsystem in question, and of course what the technical cost is of continuing 605to support the kfunc. 606 607There are several implications of this: 608 609a) kfuncs that are widely used or have been in the kernel for a long time will 610 be more difficult to justify being changed or removed by a maintainer. In 611 other words, kfuncs that are known to have a lot of users and provide 612 significant value provide stronger incentives for maintainers to invest the 613 time and complexity in supporting them. It is therefore important for 614 developers that are using kfuncs in their BPF programs to communicate and 615 explain how and why those kfuncs are being used, and to participate in 616 discussions regarding those kfuncs when they occur upstream. 617 618b) Unlike regular kernel symbols marked with EXPORT_SYMBOL_GPL, BPF programs 619 that call kfuncs are generally not part of the kernel tree. This means that 620 refactoring cannot typically change callers in-place when a kfunc changes, 621 as is done for e.g. an upstreamed driver being updated in place when a 622 kernel symbol is changed. 623 624 Unlike with regular kernel symbols, this is expected behavior for BPF 625 symbols, and out-of-tree BPF programs that use kfuncs should be considered 626 relevant to discussions and decisions around modifying and removing those 627 kfuncs. The BPF community will take an active role in participating in 628 upstream discussions when necessary to ensure that the perspectives of such 629 users are taken into account. 630 631c) A kfunc will never have any hard stability guarantees. BPF APIs cannot and 632 will not ever hard-block a change in the kernel purely for stability 633 reasons. That being said, kfuncs are features that are meant to solve 634 problems and provide value to users. The decision of whether to change or 635 remove a kfunc is a multivariate technical decision that is made on a 636 case-by-case basis, and which is informed by data points such as those 637 mentioned above. It is expected that a kfunc being removed or changed with 638 no warning will not be a common occurrence or take place without sound 639 justification, but it is a possibility that must be accepted if one is to 640 use kfuncs. 641 6423.1 kfunc deprecation 643--------------------- 644 645As described above, while sometimes a maintainer may find that a kfunc must be 646changed or removed immediately to accommodate some changes in their subsystem, 647usually kfuncs will be able to accommodate a longer and more measured 648deprecation process. For example, if a new kfunc comes along which provides 649superior functionality to an existing kfunc, the existing kfunc may be 650deprecated for some period of time to allow users to migrate their BPF programs 651to use the new one. Or, if a kfunc has no known users, a decision may be made 652to remove the kfunc (without providing an alternative API) after some 653deprecation period so as to provide users with a window to notify the kfunc 654maintainer if it turns out that the kfunc is actually being used. 655 656It's expected that the common case will be that kfuncs will go through a 657deprecation period rather than being changed or removed without warning. As 658described in :ref:`KF_deprecated_flag`, the kfunc framework provides the 659KF_DEPRECATED flag to kfunc developers to signal to users that a kfunc has been 660deprecated. Once a kfunc has been marked with KF_DEPRECATED, the following 661procedure is followed for removal: 662 6631. Any relevant information for deprecated kfuncs is documented in the kfunc's 664 kernel docs. This documentation will typically include the kfunc's expected 665 remaining lifespan, a recommendation for new functionality that can replace 666 the usage of the deprecated function (or an explanation as to why no such 667 replacement exists), etc. 668 6692. The deprecated kfunc is kept in the kernel for some period of time after it 670 was first marked as deprecated. This time period will be chosen on a 671 case-by-case basis, and will typically depend on how widespread the use of 672 the kfunc is, how long it has been in the kernel, and how hard it is to move 673 to alternatives. This deprecation time period is "best effort", and as 674 described :ref:`above<BPF_kfunc_lifecycle_expectations>`, circumstances may 675 sometimes dictate that the kfunc be removed before the full intended 676 deprecation period has elapsed. 677 6783. After the deprecation period the kfunc will be removed. At this point, BPF 679 programs calling the kfunc will be rejected by the verifier. 680 6814. Core kfuncs 682============== 683 684The BPF subsystem provides a number of "core" kfuncs that are potentially 685applicable to a wide variety of different possible use cases and programs. 686Those kfuncs are documented here. 687 6884.1 struct task_struct * kfuncs 689------------------------------- 690 691There are a number of kfuncs that allow ``struct task_struct *`` objects to be 692used as kptrs: 693 694.. kernel-doc:: kernel/bpf/helpers.c 695 :identifiers: bpf_task_acquire bpf_task_release 696 697These kfuncs are useful when you want to acquire or release a reference to a 698``struct task_struct *`` that was passed as e.g. a tracepoint arg, or a 699struct_ops callback arg. For example: 700 701.. code-block:: c 702 703 /** 704 * A trivial example tracepoint program that shows how to 705 * acquire and release a struct task_struct * pointer. 706 */ 707 SEC("tp_btf/task_newtask") 708 int BPF_PROG(task_acquire_release_example, struct task_struct *task, u64 clone_flags) 709 { 710 struct task_struct *acquired; 711 712 acquired = bpf_task_acquire(task); 713 if (acquired) 714 /* 715 * In a typical program you'd do something like store 716 * the task in a map, and the map will automatically 717 * release it later. Here, we release it manually. 718 */ 719 bpf_task_release(acquired); 720 return 0; 721 } 722 723 724References acquired on ``struct task_struct *`` objects are RCU protected. 725Therefore, when in an RCU read region, you can obtain a pointer to a task 726embedded in a map value without having to acquire a reference: 727 728.. code-block:: c 729 730 #define private(name) SEC(".data." #name) __hidden __attribute__((aligned(8))) 731 private(TASK) static struct task_struct *global; 732 733 /** 734 * A trivial example showing how to access a task stored 735 * in a map using RCU. 736 */ 737 SEC("tp_btf/task_newtask") 738 int BPF_PROG(task_rcu_read_example, struct task_struct *task, u64 clone_flags) 739 { 740 struct task_struct *local_copy; 741 742 bpf_rcu_read_lock(); 743 local_copy = global; 744 if (local_copy) 745 /* 746 * We could also pass local_copy to kfuncs or helper functions here, 747 * as we're guaranteed that local_copy will be valid until we exit 748 * the RCU read region below. 749 */ 750 bpf_printk("Global task %s is valid", local_copy->comm); 751 else 752 bpf_printk("No global task found"); 753 bpf_rcu_read_unlock(); 754 755 /* At this point we can no longer reference local_copy. */ 756 757 return 0; 758 } 759 760---- 761 762A BPF program can also look up a task from a pid. This can be useful if the 763caller doesn't have a trusted pointer to a ``struct task_struct *`` object that 764it can acquire a reference on with bpf_task_acquire(). 765 766.. kernel-doc:: kernel/bpf/helpers.c 767 :identifiers: bpf_task_from_pid 768 769Here is an example of it being used: 770 771.. code-block:: c 772 773 SEC("tp_btf/task_newtask") 774 int BPF_PROG(task_get_pid_example, struct task_struct *task, u64 clone_flags) 775 { 776 struct task_struct *lookup; 777 778 lookup = bpf_task_from_pid(task->pid); 779 if (!lookup) 780 /* A task should always be found, as %task is a tracepoint arg. */ 781 return -ENOENT; 782 783 if (lookup->pid != task->pid) { 784 /* bpf_task_from_pid() looks up the task via its 785 * globally-unique pid from the init_pid_ns. Thus, 786 * the pid of the lookup task should always be the 787 * same as the input task. 788 */ 789 bpf_task_release(lookup); 790 return -EINVAL; 791 } 792 793 /* bpf_task_from_pid() returns an acquired reference, 794 * so it must be dropped before returning from the 795 * tracepoint handler. 796 */ 797 bpf_task_release(lookup); 798 return 0; 799 } 800 8014.2 struct cgroup * kfuncs 802-------------------------- 803 804``struct cgroup *`` objects also have acquire and release functions: 805 806.. kernel-doc:: kernel/bpf/helpers.c 807 :identifiers: bpf_cgroup_acquire bpf_cgroup_release 808 809These kfuncs are used in exactly the same manner as bpf_task_acquire() and 810bpf_task_release() respectively, so we won't provide examples for them. 811 812---- 813 814Other kfuncs available for interacting with ``struct cgroup *`` objects are 815bpf_cgroup_ancestor() and bpf_cgroup_from_id(), allowing callers to access 816the ancestor of a cgroup and find a cgroup by its ID, respectively. Both 817return a cgroup kptr. 818 819.. kernel-doc:: kernel/bpf/helpers.c 820 :identifiers: bpf_cgroup_ancestor 821 822.. kernel-doc:: kernel/bpf/helpers.c 823 :identifiers: bpf_cgroup_from_id 824 825Eventually, BPF should be updated to allow this to happen with a normal memory 826load in the program itself. This is currently not possible without more work in 827the verifier. bpf_cgroup_ancestor() can be used as follows: 828 829.. code-block:: c 830 831 /** 832 * Simple tracepoint example that illustrates how a cgroup's 833 * ancestor can be accessed using bpf_cgroup_ancestor(). 834 */ 835 SEC("tp_btf/cgroup_mkdir") 836 int BPF_PROG(cgrp_ancestor_example, struct cgroup *cgrp, const char *path) 837 { 838 struct cgroup *parent; 839 840 /* The parent cgroup resides at the level before the current cgroup's level. */ 841 parent = bpf_cgroup_ancestor(cgrp, cgrp->level - 1); 842 if (!parent) 843 return -ENOENT; 844 845 bpf_printk("Parent id is %d", parent->self.id); 846 847 /* Return the parent cgroup that was acquired above. */ 848 bpf_cgroup_release(parent); 849 return 0; 850 } 851 8524.3 struct cpumask * kfuncs 853--------------------------- 854 855BPF provides a set of kfuncs that can be used to query, allocate, mutate, and 856destroy struct cpumask * objects. Please refer to :ref:`cpumasks-header-label` 857for more details. 858