Lines Matching full:period

18  * Record the start of an expedited grace period.
27  * Return the value that the expedited-grace-period counter will have
28  * at the end of the current grace period.
36  * Record the end of an expedited grace period.
46  * Take a snapshot of the expedited-grace-period counter, which is the
47  * earliest value that will indicate that a full grace period has
62  * if a full expedited grace period has elapsed since that snapshot
132  * a new expedited grace period.
156  * Return non-zero if there is no RCU expedited grace period in progress
159  * for the current expedited grace period.
187  * grace period.  This event is reported either to the rcu_node structure on
296  * if some other task completed an expedited grace period that this task
299  * expedited grace period.
356  * expedited grace period needs to wait for.
391 			 * post grace period updater's accesses is enforced by the  in __sync_rcu_exp_select_node_cpus()
485  * Work-queue handler to drive an expedited grace period forward.
502  * Select the nodes that the upcoming expedited grace period needs
536  * Wait for the expedited grace period to elapse, within time limit.
537  * If the time limit is exceeded without the grace period elapsing,
594 		// This is invoked from the grace-period worker, so  in synchronize_rcu_expedited_stall()
595 		// a new grace period cannot have started.  And if this  in synchronize_rcu_expedited_stall()
623  * Wait for the expedited grace period to elapse, issuing any needed
686  * Wait for the current expedited grace period to complete, and then
688  * grace period.  Also update all the ->exp_seq_rq counters as needed
698 	// End the previous grace period only after acquiring the mutex  in rcu_exp_wait_wake()
722  * Common code to drive an expedited grace period forward, used by
791 	 * grace period is still waiting on this CPU, set ->deferred_qs  in rcu_exp_handler()
814  * expedited grace period.
840  * expedited grace period.
891  * blocking the current expedited grace period.
901  * the current expedited grace period.
910  * synchronize_rcu_expedited - Brute-force RCU grace period
912  * Wait for an RCU grace period, but expedite it.  The basic idea is to
941 	/* Is the state is such that the call is a grace period? */  in synchronize_rcu_expedited()
974 		/* Marshall arguments & schedule the expedited grace period. */  in synchronize_rcu_expedited()
979 	/* Wait for expedited grace period to complete. */  in synchronize_rcu_expedited()
984 	/* Let the next expedited grace period start. */  in synchronize_rcu_expedited()
1020 … start_poll_synchronize_rcu_expedited - Snapshot current RCU state and start expedited grace period
1024  * allowing them to determine whether or not any sort of grace period has
1025  * elapsed in the meantime.  If the needed expedited grace period is not
1026  * already slated to start, initiates that grace period.
1054  * start_poll_synchronize_rcu_expedited_full - Take a full snapshot and start expedited grace period
1055  * @gsp: Place to put snapshot of grace-period state
1057  * Places the normal and expedited grace-period states in gsp.  This
1060  * grace period (whether normal or expedited) has elapsed in the meantime.
1061  * If the needed expedited grace period is not already slated to start,
1062  * initiates that grace period.
1072  * cond_synchronize_rcu_expedited - Conditionally wait for an expedited RCU grace period
1076  * If any type of full RCU grace period has elapsed since the earlier
1079  * invoke synchronize_rcu_expedited() to wait for a full grace period.
1099  * cond_synchronize_rcu_expedited_full - Conditionally wait for an expedited RCU grace period
1102  * If a full RCU grace period has elapsed since the call to
1106  * to wait for a full grace period.