Lines Matching full:quiescent

238  * rcu_softirq_qs - Provide a set of RCU quiescent states in softirq processing
240 * Mark a quiescent state for RCU, Tasks RCU, and Tasks Trace RCU.
274 * newly onlined CPU is no longer in an extended quiescent state.
276 * to the next non-quiescent value.
291 * indicates that RCU is in an extended quiescent state.
306 * extended quiescent state since @snap. Note that this doesn't check if it
329 * CPU remains within a single extended quiescent state.
335 // If not quiescent, force back to earlier extended quiescent state. in rcu_watching_zero_in_eqs()
342 // If still in the same extended quiescent state, we are good! in rcu_watching_zero_in_eqs()
348 * which is a quiescent state. This is called when the need for a
349 * quiescent state is urgent, so we burn an atomic operation and full
445 * quiescent-state help from rcu_note_context_switch().
454 * idle CPUs before taking active measures to force quiescent states.
630 "RCU in extended quiescent state!"); in rcu_irq_exit_check_preempt()
640 * execution is an RCU quiescent state and the time executing in the kernel
646 * Therefore, if a nohz_full CPU fails to report a quiescent state
650 * tick, which will enable RCU to detect that CPU's quiescent states,
652 * The tick will be disabled once a quiescent state is reported for
670 "Illegal rcu_irq_enter_check_tick() from extended quiescent state"); in __rcu_irq_enter_check_tick()
680 // We get here only when not in an extended quiescent state and in __rcu_irq_enter_check_tick()
689 // quiescent state. Turn on the tick! in __rcu_irq_enter_check_tick()
718 * to get to a quiescent state, disable it.
758 * If a holdout task is actually running, request an urgent quiescent
795 * When trying to report a quiescent state on behalf of some other CPU,
815 * credit them with an implicit quiescent state. Return 1 if this CPU
816 * is in dynticks idle mode, which is an extended quiescent state.
845 * Returns positive if the specified CPU has passed through a quiescent state
863 * already acknowledged the request to pass through a quiescent in rcu_watching_snap_recheck()
876 * perspective has not yet reported a quiescent state. After all, in rcu_watching_snap_recheck()
877 * the offline CPU should have reported a quiescent state during in rcu_watching_snap_recheck()
915 * CPU failed to pass through a quiescent state. This code in rcu_watching_snap_recheck()
1255 * quiescent state. This is intended to be invoked when the CPU notices
1302 * set up to detect a quiescent state, otherwise don't in __note_gp_changes()
1890 * Concurrent Quiescent State Reporting for Offline CPUs. in rcu_gp_init()
1941 * Set the quiescent-state-needed bits in all the rcu_node in rcu_gp_init()
1967 * Quiescent states for tasks on any now-offline CPUs. Since we in rcu_gp_init()
1990 * Helper function for swait_event_idle_exclusive() wakeup at force-quiescent-state
2001 // Someone like call_rcu() requested a force-quiescent-state scan. in rcu_gp_fqs_check_wake()
2014 * Do one round of quiescent-state forcing.
2050 * Loop doing repeated quiescent-state forcing until the grace period ends.
2095 * the corresponding leaf nodes have passed through their quiescent state. in rcu_gp_fqs_loop()
2100 /* If time for quiescent-state forcing, do it. */ in rcu_gp_fqs_loop()
2284 /* Handle quiescent-state forcing. */ in rcu_gp_kthread()
2295 * Report a full set of quiescent states to the rcu_state data structure.
2298 * kthread or it awakens itself for the next round of quiescent-state
2315 * Allows quiescent states for a group of CPUs to be reported at one go
2319 * is the grace-period snapshot, which means that the quiescent states
2324 * disabled. This allows propagating quiescent state due to resumed tasks
2377 * Get here if we are the last CPU to pass through a quiescent in rcu_report_qs_rnp()
2385 * Record a quiescent state for all tasks that were previously queued
2404 return; /* Still need more quiescent states! */ in rcu_report_unblock_qs_rnp()
2427 * Record a quiescent state for the specified CPU to that CPU's rcu_data
2444 * The grace period in which this quiescent state was in rcu_report_qs_rdp()
2446 * We will instead need a new quiescent state that lies in rcu_report_qs_rdp()
2483 * quiescent state for this grace period, and record that fact if so.
2499 * Was there a quiescent state since the beginning of the grace in rcu_check_quiescent_state()
2629 // But rcuc kthreads can delay quiescent-state in rcu_do_batch()
2678 * and checks to see if this CPU is in a non-context-switch quiescent
2682 * purpose of providing the needed quiescent state.
2698 /* Idle and userspace execution already are quiescent states. */ in rcu_sched_clock_irq()
2717 * CPUs have reported a quiescent state and on which there are tasks
2720 * each CPU that has not yet reported a quiescent state.
2778 * Force quiescent states on reluctant CPUs, and also detect which
2836 /* Report any deferred quiescent states if preemption enabled. */ in rcu_core()
2844 /* Update RCU state based on any recent quiescent states. */ in rcu_core()
3006 * If called from an extended quiescent state, invoke the RCU in call_rcu_core()
3686 /* Is the RCU core waiting for a quiescent state from this CPU? */ in rcu_pending()
4421 /* Report quiescent state -before- changing ->qsmaskinitnext! */ in rcutree_report_cpu_dead()