aboutsummaryrefslogtreecommitdiffstats
path: root/kernel/rcu/tree_exp.h
AgeCommit message (Expand)AuthorFilesLines
2024-04-15rcu: Reduce synchronize_rcu() latencyUladzislau Rezki (Sony)1-1/+1
2024-02-14rcu/exp: Remove rcu_par_gp_wqFrederic Weisbecker1-72/+1
2024-02-14rcu/exp: Make parallel exp gp kworker per rcu nodeFrederic Weisbecker1-5/+5
2024-02-14rcu/exp: Handle RCU expedited grace period kworker allocation failureFrederic Weisbecker1-6/+19
2024-02-14rcu/exp: Remove full barrier upon main thread wakeupFrederic Weisbecker1-3/+2
2024-01-24rcu: Defer RCU kthreads wakeup when CPU is dyingFrederic Weisbecker1-2/+1
2023-09-11rcu: Add RCU CPU stall notifierPaul E. McKenney1-1/+5
2023-05-11rcu: Mark additional concurrent load from ->cpu_no_qs.b.expPaul E. McKenney1-1/+1
2023-04-05rcu: Protect rcu_print_task_exp_stall() ->exp_tasks accessZqiang1-2/+4
2023-04-05rcu: Permit start_poll_synchronize_rcu_expedited() to be invoked earlyZqiang1-2/+3
2023-04-05rcu: Fix set/clear TICK_DEP_BIT_RCU_EXP bitmask raceZqiang1-2/+3
2023-01-03rcu: Allow expedited RCU CPU stall warnings to dump task stacksPaul E. McKenney1-0/+41
2023-01-03rcu: Suppress smp_processor_id() complaint in synchronize_rcu_expedited_wait()Paul E. McKenney1-0/+2
2022-11-29rcu: Make call_rcu() lazy to save powerJoel Fernandes (Google)1-1/+1
2022-09-01Merge branches 'doc.2022.08.31b', 'fixes.2022.08.31b', 'kvfree.2022.08.31b', ...Paul E. McKenney1-3/+54
2022-08-31rcu: Make synchronize_rcu_expedited() fast path update .expedited_sequencePaul E. McKenney1-0/+6
2022-08-31rcu: Remove expedited grace-period fast-path forward-progress helperPaul E. McKenney1-2/+0
2022-08-31rcu: Add full-sized polling for cond_sync_exp_full()Paul E. McKenney1-0/+27
2022-08-31rcu: Add full-sized polling for start_poll_expedited()Paul E. McKenney1-0/+18
2022-08-31rcu: Add QS check in rcu_exp_handler() for non-preemptible kernelsZqiang1-1/+3
2022-07-21Merge branch 'ctxt.2022.07.05a' into HEADPaul E. McKenney1-1/+1
2022-07-21rcu: Add irqs-disabled indicator to expedited RCU CPU stall warningsZqiang1-2/+3
2022-07-21rcu: Diagnose extended sync_rcu_do_polled_gp() loopsPaul E. McKenney1-1/+6
2022-07-21rcu: Put panic_on_rcu_stall() after expedited RCU CPU stall warningsZqiang1-1/+1
2022-07-21rcu: Add polled expedited grace-period primitivesPaul E. McKenney1-0/+85
2022-07-21rcu: Make polled grace-period API account for expedited grace periodsPaul E. McKenney1-2/+14
2022-07-05rcu/context_tracking: Move dynticks counter to context trackingFrederic Weisbecker1-1/+1
2022-05-11rcu: Move expedited grace period (GP) work to RT kthread_workerKalesh Singh1-31/+116
2022-05-11rcu: Introduce CONFIG_RCU_EXP_CPU_STALL_TIMEOUTUladzislau Rezki1-2/+2
2022-02-01rcu: Mark ->expmask access in synchronize_rcu_expedited_wait()Paul E. McKenney1-1/+2
2022-02-01rcu/exp: Fix check for idle context in rcu_exp_handlerNeeraj Upadhyay1-1/+1
2021-12-07rcu/exp: Mark current CPU as exp-QS in IPI loop second passFrederic Weisbecker1-0/+1
2021-12-07rcu: Prevent expedited GP from enabling tick on offline CPUPaul E. McKenney1-1/+4
2021-12-07rcu: Mark sync_sched_exp_online_cleanup() ->cpu_no_qs.b.exp loadPaul E. McKenney1-1/+1
2021-12-07rcu: Remove rcu_data.exp_deferred_qs and convert to rcu_data.cpu no_qs.b.expFrederic Weisbecker1-3/+2
2021-12-07rcu: Move rcu_data.cpu_no_qs.b.exp reset to rcu_export_exp_rdp()Frederic Weisbecker1-0/+1
2021-09-13rcu: Fix existing exp request check in sync_sched_exp_online_cleanup()Neeraj Upadhyay1-1/+1
2021-09-13rcu: Make rcu_normal_after_boot writable againJuri Lelli1-1/+0
2021-03-15rcu/tree: Add a trace event for RCU CPU stall warningsSangmoon Kim1-0/+1
2021-01-04rcu: Mark obtuse portion of stall warning as internal debugPaul E. McKenney1-1/+1
2020-08-24rcu: Initialize at declaration time in rcu_exp_handler()Paul E. McKenney1-4/+2
2020-06-29rcu: Expedited grace-period sleeps to idle priorityPaul E. McKenney1-1/+1
2020-05-07Merge branches 'fixes.2020.04.27a', 'kfree_rcu.2020.04.27a', 'rcu-tasks.2020....Paul E. McKenney1-26/+5
2020-04-27rcu: Use data_race() for RCU expedited CPU stall-warning printsPaul E. McKenney1-4/+4
2020-04-27rcu: Don't use negative nesting depth in __rcu_read_unlock()Lai Jiangshan1-26/+5
2020-04-27rcu: Add *_ONCE() and data_race() to rcu_node ->exp_tasks plus lockingPaul E. McKenney1-8/+11
2020-03-21Merge branches 'doc.2020.02.27a', 'fixes.2020.03.21a', 'kfree_rcu.2020.02.20a...Paul E. McKenney1-4/+9
2020-02-20rcutorture: Allow boottime stall warnings to be suppressedPaul E. McKenney1-1/+1
2020-02-20rcutorture: Suppress forward-progress complaints during early bootPaul E. McKenney1-1/+6
2020-02-20rcu: Add WRITE_ONCE to rcu_node ->exp_seq_rq storePaul E. McKenney1-1/+1
2020-02-20rcu: Fix exp_funnel_lock()/rcu_exp_wait_wake() dataracePaul E. McKenney1-1/+1
2020-01-25rcu: Forgive slow expedited grace periods at boot timePaul E. McKenney1-1/+0
2020-01-24Merge branches 'doc.2019.12.10a', 'exp.2019.12.09a', 'fixes.2020.01.24a', 'kf...Paul E. McKenney1-56/+91
2020-01-24rcu: Provide wrappers for uses of ->rcu_read_lock_nestingLai Jiangshan1-2/+2
2019-12-09rcu: Use CONFIG_PREEMPTION where appropriateSebastian Andrzej Siewior1-1/+1
2019-12-09rcu: Enable tick for nohz_full CPUs slow to provide expedited QSPaul E. McKenney1-7/+45
2019-12-09rcu: Replace synchronize_sched_expedited_wait() "_sched" with "_rcu"Paul E. McKenney1-2/+2
2019-12-09rcu: Update tree_exp.h function-header commentsPaul E. McKenney1-12/+13
2019-12-09rcu: Rename sync_rcu_preempt_exp_done() to sync_rcu_exp_done()Paul E. McKenney1-10/+9
2019-12-09rcu: Allow only one expedited GP to run concurrently with wakeupsNeeraj Upadhyay1-6/+5
2019-12-09rcu: Fix missed wakeup of exp_wq waitersNeeraj Upadhyay1-1/+1
2019-12-09rcu: Substitute lookup for bit-twiddling in sync_rcu_exp_select_node_cpus()Paul E. McKenney1-2/+2
2019-12-09rcu: Avoid modifying mask_ofl_ipi in sync_rcu_exp_select_node_cpus()Boqun Feng1-7/+6
2019-12-09rcu: Use *_ONCE() to protect lockless ->expmask accessesPaul E. McKenney1-10/+9
2019-08-12rcu: Fix spelling mistake "greate"->"great"Mukesh Ojha1-1/+1
2019-08-01rcu: Add destroy_work_on_stack() to match INIT_WORK_ONSTACK()Paul E. McKenney1-1/+5
2019-06-19Merge branches 'consolidate.2019.05.28a', 'doc.2019.05.28a', 'fixes.2019.06.1...Paul E. McKenney1-2/+1
2019-06-13rcu: Upgrade sync_exp_work_done() to smp_mb()Paul E. McKenney1-2/+1
2019-05-28rcu: Remove unused rdp local from synchronize_rcu_expedited()Jiang Biao1-2/+0
2019-05-28rcu: Rename rcu_data's ->deferred_qs to ->exp_deferred_qsPaul E. McKenney1-4/+4
2019-05-25rcu: Avoid self-IPI in sync_sched_exp_online_cleanup()Paul E. McKenney1-6/+29
2019-05-25rcu: Avoid self-IPI in sync_rcu_exp_select_node_cpus()Paul E. McKenney1-0/+5
2019-04-09Merge branches 'consolidate.2019.04.09a', 'doc.2019.03.26b', 'fixes.2019.03.2...Paul E. McKenney1-2/+34
2019-03-26rcu: Move rcu_print_task_exp_stall() to tree_exp.hPaul E. McKenney1-0/+32
2019-03-26rcu: Correct READ_ONCE()/WRITE_ONCE() for ->rcu_read_unlock_specialPaul E. McKenney1-1/+1
2019-03-26rcu: Fix typo in tree_exp.h commentPaul E. McKenney1-1/+1
2019-02-09Merge branches 'doc.2019.01.26a', 'fixes.2019.01.26a', 'sil.2019.01.26a', 'sp...Paul E. McKenney1-17/+2
2019-02-09rcu/tree: Convert to SPDX license identifierPaul E. McKenney1-15/+2
2019-01-25rcu: Remove preemption disabling from expedited CPU selectionPaul E. McKenney1-2/+0
2019-01-25rcu: Inline _synchronize_rcu_expedited() into synchronize_rcu_expedited()Paul E. McKenney1-45/+36
2019-01-25rcu: Consolidate PREEMPT and !PREEMPT synchronize_rcu()Paul E. McKenney1-27/+0
2019-01-25rcu: Consolidate PREEMPT and !PREEMPT synchronize_rcu_expedited()Paul E. McKenney1-56/+49
2019-01-25rcu: Determine expedited-GP IPI handler at build timePaul E. McKenney1-16/+14
2019-01-25rcu: Make expedited IPI handler return after handling critical sectionPaul E. McKenney1-0/+1
2018-11-12rcu: Speed up expedited GPs when interrupting RCU readerPaul E. McKenney1-1/+3
2018-11-11rcu: Stop expedited grace periods from relying on stop-machinePaul E. McKenney1-2/+4
2018-08-30rcu: Switch ->dynticks to rcu_data structure, remove rcu_dynticksPaul E. McKenney1-4/+2
2018-08-30rcu: Switch urgent quiescent-state requests to rcu_data structurePaul E. McKenney1-1/+1
2018-08-30rcu: Avoid resched_cpu() when rescheduling the current CPUPaul E. McKenney1-7/+10
2018-08-30rcu: Clean up flavor-related definitions and comments in tree_exp.hPaul E. McKenney1-11/+11
2018-08-30rcu: Remove rsp parameter from rcu_node tree accessor macrosPaul E. McKenney1-9/+9
2018-08-30rcu: Remove rsp parameter from expedited grace-period functionsPaul E. McKenney1-99/+86
2018-08-30rcu: Remove rsp parameter from rcu_get_root()Paul E. McKenney1-3/+3
2018-08-30rcu: Remove rcu_state_p pointer to default rcu_state structurePaul E. McKenney1-1/+1
2018-08-30rcu: Remove rcu_state structure's ->rda fieldPaul E. McKenney1-10/+9
2018-08-30rcu: Eliminate rcu_state structure's ->call fieldPaul E. McKenney1-1/+1
2018-08-30rcu: Define RCU-sched API in terms of RCU for Tree RCU PREEMPT buildsPaul E. McKenney1-76/+77
2018-08-30rcu: Drop "wake" parameter from rcu_report_exp_rdp()Paul E. McKenney1-5/+4
2018-08-30rcu: Defer reporting RCU-preempt quiescent states when disabledPaul E. McKenney1-16/+55
2018-08-13Merge branch 'sched-core-for-linus' of git://git.kernel.org/pub/scm/linux/ker...Linus Torvalds1-2/+2
2018-07-12rcu: Make expedited GPs handle CPU 0 being offlineBoqun Feng1-1/+8
2018-06-25rcu: Make expedited grace period use direct call on last leafPaul E. McKenney1-2/+3
2018-06-20sched/swait: Rename to exclusivePeter Zijlstra1-2/+2
2018-05-15Merge branches 'exp.2018.05.15a', 'fixes.2018.05.15a', 'lock.2018.05.15a' and...Paul E. McKenney1-8/+5
2018-05-15rcu: Remove deprecated RCU debugfs tracing codeByungchul Park1-8/+5
2018-05-15rcu: exp: Protect all sync_rcu_preempt_exp_done() with rcu_node lockBoqun Feng1-3/+25
2018-05-15rcu: exp: Fix "must hold exp_mutex" comments for QS reporting functionsBoqun Feng1-7/+3
2018-05-15rcu: Parallelize expedited grace-period initializationPaul E. McKenney1-78/+106
2018-02-23rcu: Create RCU-specific workqueues with rescuersPaul E. McKenney1-1/+1
2018-02-20rcu: Make expedited RCU CPU selection avoid unnecessary storesPaul E. McKenney1-7/+14
2018-02-20rcu: Trace expedited GP delays due to transitioning CPUsPaul E. McKenney1-1/+2
2018-02-20rcu: Add more tracing of expedited grace periodsPaul E. McKenney1-0/+12
2017-07-25rcu: Make expedited GPs correctly handle hardware CPU insertionPaul E. McKenney1-1/+1
2017-06-08rcu: Make sync_rcu_preempt_exp_done() return boolPaul E. McKenney1-1/+1
2017-04-18srcu: Improve rcu_seq grace-period-counter abstractionPaul E. McKenney1-5/+4
2017-04-18rcu: Expedited wakeups need to be fully orderedPaul E. McKenney1-0/+2
2017-04-18srcu: Allow SRCU to access rcu_scheduler_activePaul E. McKenney1-12/+0
2017-04-18rcu: Place guard on rcu_all_qs() and rcu_note_context_switch() actionsPaul E. McKenney1-0/+2
2017-01-25Merge branches 'doc.2017.01.15b', 'dyntick.2017.01.23a', 'fixes.2017.01.23a',...Paul E. McKenney1-7/+31
2017-01-23rcu: Abstract extended quiescent state determinationPaul E. McKenney1-3/+3
2017-01-23rcu: Add lockdep checks to synchronous expedited primitivesPaul E. McKenney1-0/+10
2017-01-23rcu: Add comment headers to expedited-grace-period counter functionsPaul E. McKenney1-1/+17
2017-01-16rcu: Abstract the dynticks snapshot operationPaul E. McKenney1-4/+2
2017-01-14rcu: Narrow early boot window of illegal synchronous grace periodsPaul E. McKenney1-11/+41
2016-11-14rcu: Make expedited grace periods recheck dyntick idle statePaul E. McKenney1-1/+11
2016-08-22rcu: Use RCU's online-CPU state for expedited IPI retryPaul E. McKenney1-6/+5
2016-08-22rcu: Exclude RCU-offline CPUs from expedited grace periodsPaul E. McKenney1-1/+2
2016-08-22rcu: Make expedited RCU CPU stall warnings respond to controlsPaul E. McKenney1-0/+3
2016-08-22rcu: Stop disabling expedited RCU CPU stall warningsPaul E. McKenney1-6/+1
2016-08-22rcu: Drive expedited grace periods from workqueuePaul E. McKenney1-6/+42
2016-08-22rcu: Consolidate expedited grace period machineryPaul E. McKenney1-33/+29
2016-07-25Merge branch 'locking-core-for-linus' of git://git.kernel.org/pub/scm/linux/k...Linus Torvalds1-1/+0
2016-06-15rcu: Correctly handle sparse possible cpusMark Rutland1-9/+7
2016-06-14rcu: Move expedited code from tree_plugin.h to tree_exp.hPaul E. McKenney1-0/+94
2016-06-14rcu: Move expedited code from tree.c to tree_exp.hPaul E. McKenney1-0/+564
generated by cgit 1.2.3-korg (git 2.39.0) at 2024-05-19 18:00:26 +0000