1ec8f24b7SThomas Gleixner# SPDX-License-Identifier: GPL-2.0-only 20af92d46SPaul E. McKenney# 30af92d46SPaul E. McKenney# RCU-related configuration options 40af92d46SPaul E. McKenney# 50af92d46SPaul E. McKenney 60af92d46SPaul E. McKenneymenu "RCU Subsystem" 70af92d46SPaul E. McKenney 80af92d46SPaul E. McKenneyconfig TREE_RCU 90af92d46SPaul E. McKenney bool 10b3e627d3SLai Jiangshan default y if SMP 110af92d46SPaul E. McKenney help 120af92d46SPaul E. McKenney This option selects the RCU implementation that is 130af92d46SPaul E. McKenney designed for very large SMP system with hundreds or 140af92d46SPaul E. McKenney thousands of CPUs. It also scales down nicely to 150af92d46SPaul E. McKenney smaller systems. 160af92d46SPaul E. McKenney 170af92d46SPaul E. McKenneyconfig PREEMPT_RCU 180af92d46SPaul E. McKenney bool 1901b1d88bSThomas Gleixner default y if PREEMPTION 20b3e627d3SLai Jiangshan select TREE_RCU 210af92d46SPaul E. McKenney help 220af92d46SPaul E. McKenney This option selects the RCU implementation that is 230af92d46SPaul E. McKenney designed for very large SMP systems with hundreds or 240af92d46SPaul E. McKenney thousands of CPUs, but for which real-time response 250af92d46SPaul E. McKenney is also required. It also scales down nicely to 260af92d46SPaul E. McKenney smaller systems. 270af92d46SPaul E. McKenney 280af92d46SPaul E. McKenney Select this option if you are unsure. 290af92d46SPaul E. McKenney 300af92d46SPaul E. McKenneyconfig TINY_RCU 310af92d46SPaul E. McKenney bool 3201b1d88bSThomas Gleixner default y if !PREEMPTION && !SMP 330af92d46SPaul E. McKenney help 340af92d46SPaul E. McKenney This option selects the RCU implementation that is 350af92d46SPaul E. McKenney designed for UP systems from which real-time response 360af92d46SPaul E. McKenney is not required. This option greatly reduces the 370af92d46SPaul E. McKenney memory footprint of RCU. 380af92d46SPaul E. McKenney 390af92d46SPaul E. McKenneyconfig RCU_EXPERT 400af92d46SPaul E. McKenney bool "Make expert-level adjustments to RCU configuration" 410af92d46SPaul E. McKenney default n 420af92d46SPaul E. McKenney help 430af92d46SPaul E. McKenney This option needs to be enabled if you wish to make 440af92d46SPaul E. McKenney expert-level adjustments to RCU configuration. By default, 450af92d46SPaul E. McKenney no such adjustments can be made, which has the often-beneficial 460af92d46SPaul E. McKenney side-effect of preventing "make oldconfig" from asking you all 470af92d46SPaul E. McKenney sorts of detailed questions about how you would like numerous 480af92d46SPaul E. McKenney obscure RCU options to be set up. 490af92d46SPaul E. McKenney 500af92d46SPaul E. McKenney Say Y if you need to make expert-level adjustments to RCU. 510af92d46SPaul E. McKenney 520af92d46SPaul E. McKenney Say N if you are unsure. 530af92d46SPaul E. McKenney 540af92d46SPaul E. McKenneyconfig SRCU 550af92d46SPaul E. McKenney bool 560af92d46SPaul E. McKenney help 570af92d46SPaul E. McKenney This option selects the sleepable version of RCU. This version 580af92d46SPaul E. McKenney permits arbitrary sleeping or blocking within RCU read-side critical 590af92d46SPaul E. McKenney sections. 600af92d46SPaul E. McKenney 610af92d46SPaul E. McKenneyconfig TINY_SRCU 620af92d46SPaul E. McKenney bool 630af92d46SPaul E. McKenney default y if SRCU && TINY_RCU 640af92d46SPaul E. McKenney help 650af92d46SPaul E. McKenney This option selects the single-CPU non-preemptible version of SRCU. 660af92d46SPaul E. McKenney 670af92d46SPaul E. McKenneyconfig TREE_SRCU 680af92d46SPaul E. McKenney bool 690af92d46SPaul E. McKenney default y if SRCU && !TINY_RCU 700af92d46SPaul E. McKenney help 710af92d46SPaul E. McKenney This option selects the full-fledged version of SRCU. 720af92d46SPaul E. McKenney 735873b8a9SPaul E. McKenneyconfig TASKS_RCU_GENERIC 74d5f177d3SPaul E. McKenney def_bool TASKS_RCU || TASKS_RUDE_RCU || TASKS_TRACE_RCU 755873b8a9SPaul E. McKenney select SRCU 765873b8a9SPaul E. McKenney help 775873b8a9SPaul E. McKenney This option enables generic infrastructure code supporting 785873b8a9SPaul E. McKenney task-based RCU implementations. Not for manual selection. 795873b8a9SPaul E. McKenney 803b6e1dd4SPaul E. McKenneyconfig FORCE_TASKS_RCU 813b6e1dd4SPaul E. McKenney bool "Force selection of TASKS_RCU" 823b6e1dd4SPaul E. McKenney depends on RCU_EXPERT 833b6e1dd4SPaul E. McKenney select TASKS_RCU 843b6e1dd4SPaul E. McKenney default n 850af92d46SPaul E. McKenney help 863b6e1dd4SPaul E. McKenney This option force-enables a task-based RCU implementation 873b6e1dd4SPaul E. McKenney that uses only voluntary context switch (not preemption!), 883b6e1dd4SPaul E. McKenney idle, and user-mode execution as quiescent states. Not for 893b6e1dd4SPaul E. McKenney manual selection in most cases. 903b6e1dd4SPaul E. McKenney 913b6e1dd4SPaul E. McKenneyconfig TASKS_RCU 923b6e1dd4SPaul E. McKenney bool 933b6e1dd4SPaul E. McKenney default n 943b6e1dd4SPaul E. McKenney select IRQ_WORK 950af92d46SPaul E. McKenney 964c3f7b0eSPaul E. McKenneyconfig FORCE_TASKS_RUDE_RCU 974c3f7b0eSPaul E. McKenney bool "Force selection of Tasks Rude RCU" 984c3f7b0eSPaul E. McKenney depends on RCU_EXPERT 994c3f7b0eSPaul E. McKenney select TASKS_RUDE_RCU 1004c3f7b0eSPaul E. McKenney default n 101c84aad76SPaul E. McKenney help 1024c3f7b0eSPaul E. McKenney This option force-enables a task-based RCU implementation 1034c3f7b0eSPaul E. McKenney that uses only context switch (including preemption) and 1044c3f7b0eSPaul E. McKenney user-mode execution as quiescent states. It forces IPIs and 1054c3f7b0eSPaul E. McKenney context switches on all online CPUs, including idle ones, 1064c3f7b0eSPaul E. McKenney so use with caution. Not for manual selection in most cases. 1074c3f7b0eSPaul E. McKenney 1084c3f7b0eSPaul E. McKenneyconfig TASKS_RUDE_RCU 1094c3f7b0eSPaul E. McKenney bool 1104c3f7b0eSPaul E. McKenney default n 1114c3f7b0eSPaul E. McKenney select IRQ_WORK 112c84aad76SPaul E. McKenney 11340c1278aSPaul E. McKenneyconfig FORCE_TASKS_TRACE_RCU 11440c1278aSPaul E. McKenney bool "Force selection of Tasks Trace RCU" 11540c1278aSPaul E. McKenney depends on RCU_EXPERT 11640c1278aSPaul E. McKenney select TASKS_TRACE_RCU 11740c1278aSPaul E. McKenney default n 118d5f177d3SPaul E. McKenney help 119d5f177d3SPaul E. McKenney This option enables a task-based RCU implementation that uses 120d5f177d3SPaul E. McKenney explicit rcu_read_lock_trace() read-side markers, and allows 12140c1278aSPaul E. McKenney these readers to appear in the idle loop as well as on the 12240c1278aSPaul E. McKenney CPU hotplug code paths. It can force IPIs on online CPUs, 12340c1278aSPaul E. McKenney including idle ones, so use with caution. Not for manual 12440c1278aSPaul E. McKenney selection in most cases. 12540c1278aSPaul E. McKenney 12640c1278aSPaul E. McKenneyconfig TASKS_TRACE_RCU 12740c1278aSPaul E. McKenney bool 12840c1278aSPaul E. McKenney default n 12940c1278aSPaul E. McKenney select IRQ_WORK 130d5f177d3SPaul E. McKenney 1310af92d46SPaul E. McKenneyconfig RCU_STALL_COMMON 132b3e627d3SLai Jiangshan def_bool TREE_RCU 1330af92d46SPaul E. McKenney help 1340af92d46SPaul E. McKenney This option enables RCU CPU stall code that is common between 1350af92d46SPaul E. McKenney the TINY and TREE variants of RCU. The purpose is to allow 1360af92d46SPaul E. McKenney the tiny variants to disable RCU CPU stall warnings, while 1370af92d46SPaul E. McKenney making these warnings mandatory for the tree variants. 1380af92d46SPaul E. McKenney 1390af92d46SPaul E. McKenneyconfig RCU_NEED_SEGCBLIST 1409b073de1SPaul E. McKenney def_bool ( TREE_RCU || TREE_SRCU || TASKS_RCU_GENERIC ) 1410af92d46SPaul E. McKenney 1420af92d46SPaul E. McKenneyconfig RCU_FANOUT 1430af92d46SPaul E. McKenney int "Tree-based hierarchical RCU fanout value" 1440af92d46SPaul E. McKenney range 2 64 if 64BIT 1450af92d46SPaul E. McKenney range 2 32 if !64BIT 146b3e627d3SLai Jiangshan depends on TREE_RCU && RCU_EXPERT 1470af92d46SPaul E. McKenney default 64 if 64BIT 1480af92d46SPaul E. McKenney default 32 if !64BIT 1490af92d46SPaul E. McKenney help 1500af92d46SPaul E. McKenney This option controls the fanout of hierarchical implementations 1510af92d46SPaul E. McKenney of RCU, allowing RCU to work efficiently on machines with 1520af92d46SPaul E. McKenney large numbers of CPUs. This value must be at least the fourth 1530af92d46SPaul E. McKenney root of NR_CPUS, which allows NR_CPUS to be insanely large. 1540af92d46SPaul E. McKenney The default value of RCU_FANOUT should be used for production 1550af92d46SPaul E. McKenney systems, but if you are stress-testing the RCU implementation 1560af92d46SPaul E. McKenney itself, small RCU_FANOUT values allow you to test large-system 1570af92d46SPaul E. McKenney code paths on small(er) systems. 1580af92d46SPaul E. McKenney 1590af92d46SPaul E. McKenney Select a specific number if testing RCU itself. 1600af92d46SPaul E. McKenney Take the default if unsure. 1610af92d46SPaul E. McKenney 1620af92d46SPaul E. McKenneyconfig RCU_FANOUT_LEAF 1630af92d46SPaul E. McKenney int "Tree-based hierarchical RCU leaf-level fanout value" 164dc126918SPaul E. McKenney range 2 64 if 64BIT && !RCU_STRICT_GRACE_PERIOD 165dc126918SPaul E. McKenney range 2 32 if !64BIT && !RCU_STRICT_GRACE_PERIOD 166dc126918SPaul E. McKenney range 2 3 if RCU_STRICT_GRACE_PERIOD 167b3e627d3SLai Jiangshan depends on TREE_RCU && RCU_EXPERT 168dc126918SPaul E. McKenney default 16 if !RCU_STRICT_GRACE_PERIOD 169dc126918SPaul E. McKenney default 2 if RCU_STRICT_GRACE_PERIOD 1700af92d46SPaul E. McKenney help 1710af92d46SPaul E. McKenney This option controls the leaf-level fanout of hierarchical 1720af92d46SPaul E. McKenney implementations of RCU, and allows trading off cache misses 1730af92d46SPaul E. McKenney against lock contention. Systems that synchronize their 1740af92d46SPaul E. McKenney scheduling-clock interrupts for energy-efficiency reasons will 1750af92d46SPaul E. McKenney want the default because the smaller leaf-level fanout keeps 1760af92d46SPaul E. McKenney lock contention levels acceptably low. Very large systems 1770af92d46SPaul E. McKenney (hundreds or thousands of CPUs) will instead want to set this 1780af92d46SPaul E. McKenney value to the maximum value possible in order to reduce the 1790af92d46SPaul E. McKenney number of cache misses incurred during RCU's grace-period 1800af92d46SPaul E. McKenney initialization. These systems tend to run CPU-bound, and thus 1810af92d46SPaul E. McKenney are not helped by synchronized interrupts, and thus tend to 1820af92d46SPaul E. McKenney skew them, which reduces lock contention enough that large 1830af92d46SPaul E. McKenney leaf-level fanouts work well. That said, setting leaf-level 1840af92d46SPaul E. McKenney fanout to a large number will likely cause problematic 1850af92d46SPaul E. McKenney lock contention on the leaf-level rcu_node structures unless 1860af92d46SPaul E. McKenney you boot with the skew_tick kernel parameter. 1870af92d46SPaul E. McKenney 1880af92d46SPaul E. McKenney Select a specific number if testing RCU itself. 1890af92d46SPaul E. McKenney 1900af92d46SPaul E. McKenney Select the maximum permissible value for large systems, but 1910af92d46SPaul E. McKenney please understand that you may also need to set the skew_tick 1920af92d46SPaul E. McKenney kernel boot parameter to avoid contention on the rcu_node 1930af92d46SPaul E. McKenney structure's locks. 1940af92d46SPaul E. McKenney 1950af92d46SPaul E. McKenney Take the default if unsure. 1960af92d46SPaul E. McKenney 1970af92d46SPaul E. McKenneyconfig RCU_BOOST 1980af92d46SPaul E. McKenney bool "Enable RCU priority boosting" 1992341bc4aSSebastian Andrzej Siewior depends on (RT_MUTEXES && PREEMPT_RCU && RCU_EXPERT) || PREEMPT_RT 2002341bc4aSSebastian Andrzej Siewior default y if PREEMPT_RT 2010af92d46SPaul E. McKenney help 2020af92d46SPaul E. McKenney This option boosts the priority of preempted RCU readers that 2030af92d46SPaul E. McKenney block the current preemptible RCU grace period for too long. 2040af92d46SPaul E. McKenney This option also prevents heavy loads from blocking RCU 2058c1cf2daSPaul E. McKenney callback invocation. 2060af92d46SPaul E. McKenney 2070af92d46SPaul E. McKenney Say Y here if you are working with real-time apps or heavy loads 2080af92d46SPaul E. McKenney Say N here if you are unsure. 2090af92d46SPaul E. McKenney 2100af92d46SPaul E. McKenneyconfig RCU_BOOST_DELAY 2110af92d46SPaul E. McKenney int "Milliseconds to delay boosting after RCU grace-period start" 2120af92d46SPaul E. McKenney range 0 3000 2130af92d46SPaul E. McKenney depends on RCU_BOOST 2140af92d46SPaul E. McKenney default 500 2150af92d46SPaul E. McKenney help 2160af92d46SPaul E. McKenney This option specifies the time to wait after the beginning of 2170af92d46SPaul E. McKenney a given grace period before priority-boosting preempted RCU 2180af92d46SPaul E. McKenney readers blocking that grace period. Note that any RCU reader 2190af92d46SPaul E. McKenney blocking an expedited RCU grace period is boosted immediately. 2200af92d46SPaul E. McKenney 2210af92d46SPaul E. McKenney Accept the default if unsure. 2220af92d46SPaul E. McKenney 2239621fbeeSKalesh Singhconfig RCU_EXP_KTHREAD 2249621fbeeSKalesh Singh bool "Perform RCU expedited work in a real-time kthread" 2259621fbeeSKalesh Singh depends on RCU_BOOST && RCU_EXPERT 2269621fbeeSKalesh Singh default !PREEMPT_RT && NR_CPUS <= 32 2279621fbeeSKalesh Singh help 2289621fbeeSKalesh Singh Use this option to further reduce the latencies of expedited 2299621fbeeSKalesh Singh grace periods at the expense of being more disruptive. 2309621fbeeSKalesh Singh 2319621fbeeSKalesh Singh This option is disabled by default on PREEMPT_RT=y kernels which 2329621fbeeSKalesh Singh disable expedited grace periods after boot by unconditionally 2339621fbeeSKalesh Singh setting rcupdate.rcu_normal_after_boot=1. 2349621fbeeSKalesh Singh 2359621fbeeSKalesh Singh Accept the default if unsure. 2369621fbeeSKalesh Singh 2370af92d46SPaul E. McKenneyconfig RCU_NOCB_CPU 2380af92d46SPaul E. McKenney bool "Offload RCU callback processing from boot-selected CPUs" 239b3e627d3SLai Jiangshan depends on TREE_RCU 2400af92d46SPaul E. McKenney depends on RCU_EXPERT || NO_HZ_FULL 2410af92d46SPaul E. McKenney default n 2420af92d46SPaul E. McKenney help 2430af92d46SPaul E. McKenney Use this option to reduce OS jitter for aggressive HPC or 2440af92d46SPaul E. McKenney real-time workloads. It can also be used to offload RCU 2450af92d46SPaul E. McKenney callback invocation to energy-efficient CPUs in battery-powered 246a3941517SNeeraj Upadhyay asymmetric multiprocessors. The price of this reduced jitter 247a3941517SNeeraj Upadhyay is that the overhead of call_rcu() increases and that some 248a3941517SNeeraj Upadhyay workloads will incur significant increases in context-switch 249a3941517SNeeraj Upadhyay rates. 2500af92d46SPaul E. McKenney 2518c1cf2daSPaul E. McKenney This option offloads callback invocation from the set of CPUs 2528c1cf2daSPaul E. McKenney specified at boot time by the rcu_nocbs parameter. For each 2538c1cf2daSPaul E. McKenney such CPU, a kthread ("rcuox/N") will be created to invoke 2548c1cf2daSPaul E. McKenney callbacks, where the "N" is the CPU being offloaded, and where 255a3941517SNeeraj Upadhyay the "x" is "p" for RCU-preempt (PREEMPTION kernels) and "s" for 256a3941517SNeeraj Upadhyay RCU-sched (!PREEMPTION kernels). Nothing prevents this kthread 257a3941517SNeeraj Upadhyay from running on the specified CPUs, but (1) the kthreads may be 258a3941517SNeeraj Upadhyay preempted between each callback, and (2) affinity or cgroups can 259a3941517SNeeraj Upadhyay be used to force the kthreads to run on whatever set of CPUs is 260a3941517SNeeraj Upadhyay desired. 2610af92d46SPaul E. McKenney 262a3941517SNeeraj Upadhyay Say Y here if you need reduced OS jitter, despite added overhead. 2630af92d46SPaul E. McKenney Say N here if you are unsure. 2640af92d46SPaul E. McKenney 265b37a667cSJoel Fernandesconfig RCU_NOCB_CPU_DEFAULT_ALL 266b37a667cSJoel Fernandes bool "Offload RCU callback processing from all CPUs by default" 267b37a667cSJoel Fernandes depends on RCU_NOCB_CPU 268b37a667cSJoel Fernandes default n 269b37a667cSJoel Fernandes help 270b37a667cSJoel Fernandes Use this option to offload callback processing from all CPUs 271b37a667cSJoel Fernandes by default, in the absence of the rcu_nocbs or nohz_full boot 272b37a667cSJoel Fernandes parameter. This also avoids the need to use any boot parameters 273b37a667cSJoel Fernandes to achieve the effect of offloading all CPUs on boot. 274b37a667cSJoel Fernandes 275b37a667cSJoel Fernandes Say Y here if you want offload all CPUs by default on boot. 276b37a667cSJoel Fernandes Say N here if you are unsure. 277b37a667cSJoel Fernandes 278*8f489b4dSUladzislau Rezki (Sony)config RCU_NOCB_CPU_CB_BOOST 279*8f489b4dSUladzislau Rezki (Sony) bool "Offload RCU callback from real-time kthread" 280*8f489b4dSUladzislau Rezki (Sony) depends on RCU_NOCB_CPU && RCU_BOOST 281*8f489b4dSUladzislau Rezki (Sony) default y if PREEMPT_RT 282*8f489b4dSUladzislau Rezki (Sony) help 283*8f489b4dSUladzislau Rezki (Sony) Use this option to invoke offloaded callbacks as SCHED_FIFO 284*8f489b4dSUladzislau Rezki (Sony) to avoid starvation by heavy SCHED_OTHER background load. 285*8f489b4dSUladzislau Rezki (Sony) Of course, running as SCHED_FIFO during callback floods will 286*8f489b4dSUladzislau Rezki (Sony) cause the rcuo[ps] kthreads to monopolize the CPU for hundreds 287*8f489b4dSUladzislau Rezki (Sony) of milliseconds or more. Therefore, when enabling this option, 288*8f489b4dSUladzislau Rezki (Sony) it is your responsibility to ensure that latency-sensitive 289*8f489b4dSUladzislau Rezki (Sony) tasks either run with higher priority or run on some other CPU. 290*8f489b4dSUladzislau Rezki (Sony) 291*8f489b4dSUladzislau Rezki (Sony) Say Y here if you want to set RT priority for offloading kthreads. 292*8f489b4dSUladzislau Rezki (Sony) Say N here if you are building a !PREEMPT_RT kernel and are unsure. 293*8f489b4dSUladzislau Rezki (Sony) 2949ae58d7bSPaul E. McKenneyconfig TASKS_TRACE_RCU_READ_MB 2959ae58d7bSPaul E. McKenney bool "Tasks Trace RCU readers use memory barriers in user and idle" 29640c1278aSPaul E. McKenney depends on RCU_EXPERT && TASKS_TRACE_RCU 2979ae58d7bSPaul E. McKenney default PREEMPT_RT || NR_CPUS < 8 2989ae58d7bSPaul E. McKenney help 2999ae58d7bSPaul E. McKenney Use this option to further reduce the number of IPIs sent 3009ae58d7bSPaul E. McKenney to CPUs executing in userspace or idle during tasks trace 3019ae58d7bSPaul E. McKenney RCU grace periods. Given that a reasonable setting of 3029ae58d7bSPaul E. McKenney the rcupdate.rcu_task_ipi_delay kernel boot parameter 3039ae58d7bSPaul E. McKenney eliminates such IPIs for many workloads, proper setting 3049ae58d7bSPaul E. McKenney of this Kconfig option is important mostly for aggressive 3059ae58d7bSPaul E. McKenney real-time installations and for battery-powered devices, 3069ae58d7bSPaul E. McKenney hence the default chosen above. 3079ae58d7bSPaul E. McKenney 3089ae58d7bSPaul E. McKenney Say Y here if you hate IPIs. 3099ae58d7bSPaul E. McKenney Say N here if you hate read-side memory barriers. 3109ae58d7bSPaul E. McKenney Take the default if you are unsure. 3119ae58d7bSPaul E. McKenney 3120af92d46SPaul E. McKenneyendmenu # "RCU Subsystem" 313