| /linux/Documentation/RCU/Design/Memory-Ordering/ |
| H A D | Tree-RCU-Memory-Ordering.rst | 139 | happen, even if CPU 1 is in an RCU extended quiescent state |
164 | the grace period won't expect quiescent states from them. Races |
259 #. `Self-Reported Quiescent States`_
262 #. `Forcing Quiescent States`_
404 Self-Reported Quiescent States
408 quiescent states (or as described in a later section, had quiescent
410 non-idle CPUs report their own quiescent states, as shown in the
415 This is for the last CPU to report a quiescent state, which signals the
416 end of the grace period. Earlier quiescent states would push up the
418 that is waiting for additional quiescent states. However, ordering is
[all …]
|
| /linux/kernel/rcu/ |
| H A D | tree_plugin.h | 267 * Report the quiescent state for the expedited GP. This expedited in rcu_preempt_ctxt_queue()
270 * still in a quiescent state in any case.) in rcu_preempt_ctxt_queue()
282 * Record a preemptible-RCU quiescent state for the specified CPU.
284 * on the CPU is in a quiescent state: Instead, it means that the current
292 * Unlike non-preemptible-RCU, quiescent state reports for expedited
293 * grace periods are handled separately via deferred quiescent states
362 * globally. Either way, we can now note a quiescent state in rcu_note_context_switch()
473 * Report deferred quiescent states. The deferral time can
516 * quiescent state from this CPU. Note that requests from in rcu_preempt_deferred_qs_irqrestore()
558 * we aren't waiting on any CPUs, report the quiescent stat in rcu_preempt_deferred_qs_irqrestore()
[all...] |
| H A D | tree.c | 238 * rcu_softirq_qs - Provide a set of RCU quiescent states in softirq processing
240 * Mark a quiescent state for RCU, Tasks RCU, and Tasks Trace RCU.
274 * newly onlined CPU is no longer in an extended quiescent state.
276 * to the next non-quiescent value.
291 * indicates that RCU is in an extended quiescent state.
306 * extended quiescent state since @snap. Note that this doesn't check if it
329 * CPU remains within a single extended quiescent state.
335 // If not quiescent, force back to earlier extended quiescent state. in rcu_watching_zero_in_eqs()
342 // If still in the same extended quiescent state, we are good! in rcu_watching_zero_in_eqs()
348 * which is a quiescent state. This is called when the need for a
[all …]
|
| H A D | tree.h | 149 * Union to allow "aggregate OR" operation on the need for a quiescent
179 * to report quiescent states at the soonest possible time.
183 * ran and we still haven't reported a quiescent state.
190 /* 1) quiescent-state and grace-period handling : */
194 bool core_needs_qs; /* Core waits for quiescent state. */
222 bool rcu_need_heavy_qs; /* GP old, so heavy quiescent state! */
223 bool rcu_urgent_qs; /* GP old need light quiescent state. */
312 /* quiescent-state forcing. */
443 #define RCU_GP_FLAG_FQS 0x2 /* Need grace-period quiescent-state forcing. */
452 #define RCU_GP_WAIT_FQS 5 /* Wait for force-quiescent-state time. */
[all …]
|
| H A D | tree_exp.h | 224 * Report expedited quiescent state for specified node. This is a
236 * Report expedited quiescent state for multiple CPUs, all covered by the
265 * Report expedited quiescent state for specified rcu_data (CPU).
405 /* IPI the remaining CPUs for expedited quiescent state. */ in __sync_rcu_exp_select_node_cpus()
441 /* Report quiescent states for those that went offline. */ in __sync_rcu_exp_select_node_cpus()
724 /* Request an expedited quiescent state. */
741 * next rcu_read_unlock() record the quiescent state up the
743 * report the quiescent state.
765 * report the quiescent state, otherwise defer. in rcu_exp_handler()
783 * so that the eventual quiescent state will be reported. in rcu_exp_handler()
[all …]
|
| H A D | tasks.h | 907 // Simple variant of RCU whose quiescent states are voluntary context
939 // Scans the holdout list, attempting to identify a quiescent state
940 // for each task on the list. If there is a quiescent state, the
980 /* Check for quiescent states since the pregp's synchronize_rcu() */
1000 * quiescent states. But CPU boot code performed by the idle task in rcu_tasks_is_holdout()
1001 * isn't a quiescent state. in rcu_tasks_is_holdout()
1008 /* Idle tasks on offline CPUs are RCU-tasks quiescent states. */ in rcu_tasks_is_holdout()
1493 // Scans the holdout list, attempting to identify a quiescent state
1494 // for each task on the list. If there is a quiescent state, the
1521 // The number of detections of task quiescent stat
[all...] |
| /linux/Documentation/RCU/Design/Expedited-Grace-Periods/ |
| H A D | Expedited-Grace-Periods.rst | 22 has not yet provided a quiescent state for the current expedited
29 a faster quiescent state where possible, and triggering a report
30 of that quiescent state.
31 As always for RCU, once everything has spent some time in a quiescent
53 in quiescent states.
61 If not, the handler can immediately report a quiescent state.
63 invocation will provide the needed quiescent-state report.
74 The CPU will report a quiescent state just after enqueuing the task because
123 quiescent states. However, because the ``rcu_read_lock_sched()`` and
129 then ``rcu_exp_handler()`` reports the quiescent state.
[all …]
|
| /linux/Documentation/RCU/Design/Data-Structures/ |
| H A D | Data-Structures.rst | 39 such as quiescent states, dyntick-idle transitions,
42 Quiescent states are recorded by the per-CPU ``rcu_data`` structures,
50 has passed through a quiescent state.
104 the last CPU to report a quiescent state into a given ``rcu_node``
112 there are in the system, at most 64 quiescent-state reports per grace
158 grace-period state, and maintains state used to force quiescent
161 quiescent-state information from the leaves to the root, and also
173 #. ``rcu_data``: This per-CPU structure is the focus of quiescent-state
176 more-efficient propagation of quiescent states up the ``rcu_node``
199 and maintains state used to force quiescent states when grace periods
[all …]
|
| /linux/drivers/md/dm-vdo/ |
| H A D | admin-state.h | 20 /* The next state will be quiescent */
22 /* The VDO is quiescent, there should be no I/O */
23 bool quiescent; member
136 return vdo_get_admin_state_code(state)->quiescent; in vdo_is_state_quiescent()
|
| H A D | admin-state.c | 70 .quiescent = true,
98 .quiescent = true,
123 .quiescent = true,
135 .quiescent = true,
331 if (code->quiescent) { in vdo_start_draining()
467 * quiescent.
|
| /linux/drivers/scsi/megaraid/ |
| H A D | mega_common.h | 102 * @quiescent : driver is quiescent for now.
142 * quiescent flag should be set by the driver if it is not accepting more
156 uint8_t quiescent; member
|
| H A D | megaraid_ioctl.h | 258 * @quiescent : flag to indicate if ioctl can be issued to this adp
284 uint32_t quiescent; member
|
| /linux/Documentation/networking/ |
| H A D | ipvs-sysctl.rst | 175 persistent templates when the destination server is quiescent.
177 quiescent by setting its weight to 0 and it is desired that
180 connections are allowed to quiescent destination servers.
184 connection and the destination server is quiescent.
|
| /linux/kernel/time/ |
| H A D | Kconfig | 156 tracking to enter/exit RCU extended quiescent states.
173 userspace extended quiescent state and tickless cputime
|
| /linux/include/linux/ |
| H A D | rcupdate.h | 180 #define TRC_NEED_QS 0x1 // Task needs a quiescent state.
181 #define TRC_NEED_QS_CHECKED 0x2 // Task has been checked for needing quiescent state.
240 * cond_resched_tasks_rcu_qs - Report potential quiescent states to RCU
243 * report potential quiescent states to RCU-tasks even if the cond_resched()
253 * rcu_softirq_qs_periodic - Report RCU and RCU-Tasks quiescent states
260 * provide both RCU and RCU-Tasks quiescent states. Note that this macro
268 * have more chance to invoke schedule() calls and provide necessary quiescent
270 * effect because cond_resched() does not provide RCU-Tasks quiescent states.
887 * and priority-inheritance spinlocks, courtesy of the quiescent-state
|
| /linux/drivers/usb/host/ |
| H A D | uhci-platform.c | 32 /* Reset if the controller isn't already safely quiescent. */ in uhci_platform_init()
164 /* Make sure the controller is quiescent and that we're not using it
|
| H A D | uhci-pci.c | 150 * isn't already safely quiescent. in uhci_pci_init()
156 /* Make sure the controller is quiescent and that we're not using it
|
| /linux/kernel/entry/ |
| H A D | common.c | 96 * Scheduler ticks in the idle task can mark quiescent state and in irqentry_enter()
104 * quiescent state and end grace periods prematurely. in irqentry_enter()
|
| /linux/fs/resctrl/ |
| H A D | Kconfig | 19 controls and monitors are left in a quiescent, permissive state.
|
| /linux/Documentation/devicetree/bindings/regulator/ |
| H A D | sprd,sc2731-regulator.yaml | 15 The SC2731 integrates low-voltage and low quiescent current DCDC/LDO.
|
| H A D | maxim,max77802.yaml | 27 3 - Low Power which reduces the quiescent current down to only 1uA
|
| /linux/Documentation/devicetree/bindings/sound/ |
| H A D | richtek,rt9123.yaml | 14 and performance with ultra-low quiescent current. The digital audio interface
|
| /linux/drivers/bus/ |
| H A D | arm-cci.c | 241 * cause the processor to be put in a quiescent state in cci_port_control()
259 * in the cluster ie all other CPUs are quiescent in a low power state.
286 * other CPUs are quiescent in a low power state or waiting for this CPU
|
| /linux/kernel/sched/ |
| H A D | ext_internal.h | 367 * as it runs on the CPU, and eventually becomes ->quiescent() when it's
418 * !@runnable, ->quiescent() will be invoked after this operation
424 * @quiescent: A task is becoming not runnable on its associated CPU
430 * @p is becoming quiescent on the CPU because it's
441 void (*quiescent)(struct task_struct *p, u64 deq_flags); member
|
| /linux/drivers/crypto/marvell/octeontx2/ |
| H A D | otx2_cpt_hw_types.h | 357 * When the queue is not execution-quiescent (see CPT_LF_INPROG[EENA,INFLIGHT]),
465 * when the queue is execution-quiescent (see CPT_LF_INPROG[INFLIGHT]).
|