OSDN Git Service

rcu: Force nohz_full tick on upon irq enter instead of exit
authorPaul E. McKenney <paulmck@kernel.org>
Thu, 15 Aug 2019 20:24:49 +0000 (13:24 -0700)
committerPaul E. McKenney <paulmck@kernel.org>
Mon, 28 Oct 2019 14:02:21 +0000 (07:02 -0700)
commitb200a0489517d9e5a52e983183e890f573454ebd
tree915a0acac938aaa4252741550c7fa380efdf67dc
parent66e4c33b51bc515ca803c0948cf1525b53ffd631
rcu: Force nohz_full tick on upon irq enter instead of exit

There is interrupt-exit code that forces on the tick for nohz_full CPUs
failing to respond to the current grace period in a timely fashion.
However, this code must compare ->dynticks_nmi_nesting to the value 2
in the interrupt-exit fastpath.  This commit therefore moves this code
to the interrupt-entry fastpath, where a lighter-weight comparison to
zero may be used.

Reported-by: Joel Fernandes <joel@joelfernandes.org>
[ paulmck: Apply Joel Fernandes TICK_DEP_MASK_RCU->TICK_DEP_BIT_RCU fix. ]
Signed-off-by: Paul E. McKenney <paulmck@kernel.org>
kernel/rcu/tree.c