aboutsummaryrefslogtreecommitdiffstats
path: root/kernel/rcu/tasks.h
AgeCommit message (Expand)AuthorFilesLines
2024-05-01Merge branches 'fixes.2024.04.15a', 'misc.2024.04.12a', 'rcu-sync-normal-impr...Uladzislau Rezki (Sony)1-5/+29
2024-04-16rcutorture: Make rcutorture support print rcu-tasks gp stateZqiang1-0/+21
2024-04-15rcu-tasks: Fix show_rcu_tasks_trace_gp_kthread buffer overflowNikita Kiryushin1-1/+1
2024-04-15rcu-tasks: Fix the comments for tasks_rcu_exit_srcu_stall_timerZqiang1-1/+1
2024-04-15rcu-tasks: Replace exit_tasks_rcu_start() initialization with WARN_ON_ONCE()Paul E. McKenney1-2/+1
2024-04-15rcu: Inform KCSAN of one-byte cmpxchg() in rcu_trc_cmpxchg_need_qs()Paul E. McKenney1-1/+9
2024-04-09rcu-tasks: Make Tasks RCU wait idly for grace-period delaysPaul E. McKenney1-1/+5
2024-02-25rcu-tasks: Maintain real-time response in rcu_tasks_postscan()Paul E. McKenney1-1/+21
2024-02-25rcu-tasks: Eliminate deadlocks involving do_exit() and RCU tasksPaul E. McKenney1-16/+28
2024-02-25rcu-tasks: Maintain lists to eliminate RCU-tasks/do_exit() deadlocksPaul E. McKenney1-10/+33
2024-02-25rcu-tasks: Initialize data to eliminate RCU-tasks/do_exit() deadlocksPaul E. McKenney1-0/+2
2024-02-25rcu-tasks: Initialize callback lists at rcu_init() timePaul E. McKenney1-6/+18
2024-02-25rcu-tasks: Add data to eliminate RCU-tasks/do_exit() deadlocksPaul E. McKenney1-0/+2
2023-12-12rcu-tasks: Mark RCU Tasks accesses to current->rcu_tasks_idle_cpuPaul E. McKenney1-2/+2
2023-11-01rcu/tasks-trace: Handle new PF_IDLE semanticsFrederic Weisbecker1-1/+1
2023-11-01rcu/tasks: Handle new PF_IDLE semanticsFrederic Weisbecker1-2/+28
2023-10-23Merge branches 'rcu/torture', 'rcu/fixes', 'rcu/docs', 'rcu/refscale', 'rcu/t...Frederic Weisbecker1-3/+8
2023-09-13rcu: Dump memory object info if callback function is invalidZhen Lei1-0/+1
2023-09-11rcu-tasks: Make rcu_tasks_lazy_ms staticJiapeng Chong1-1/+1
2023-09-11rcu-tasks: Pull sampling of ->percpu_dequeue_lim out of loopPaul E. McKenney1-1/+3
2023-09-11rcu-tasks: Add printk()s to localize boot-time self-test hangPaul E. McKenney1-1/+3
2023-08-16Merge branches 'doc.2023.07.14b', 'fixes.2023.08.16a', 'rcu-tasks.2023.07.24a...Paul E. McKenney1-19/+117
2023-08-14rcu-tasks: Fix boot-time RCU tasks debug-only deadlockPaul E. McKenney1-0/+2
2023-07-31rcu-tasks: Permit use of debug-objects with RCU Tasks flavorsPaul E. McKenney1-10/+6
2023-07-14rcuscale: Add RCU Tasks Rude testingPaul E. McKenney1-0/+7
2023-07-14rcuscale: Measure RCU Tasks Trace grace-period kthread CPU timePaul E. McKenney1-0/+6
2023-07-14rcuscale: Measure grace-period kthread CPU timePaul E. McKenney1-0/+6
2023-07-14rcu-tasks: Cancel callback laziness if too many callbacksPaul E. McKenney1-2/+5
2023-07-14rcu-tasks: Add kernel boot parameters for callback lazinessPaul E. McKenney1-0/+15
2023-07-14rcu-tasks: Remove redundant #ifdef CONFIG_TASKS_RCUPaul E. McKenney1-2/+0
2023-07-14rcu-tasks: Treat only synchronous grace periods urgentlyPaul E. McKenney1-8/+73
2023-06-07Merge branches 'doc.2023.05.10a', 'fixes.2023.05.11a', 'kvfree.2023.05.10a', ...Paul E. McKenney1-4/+8
2023-05-11rcu-tasks: Stop rcu_tasks_invoke_cbs() from using never-onlined CPUsPaul E. McKenney1-2/+5
2023-05-09rcu-tasks: Clarify the cblist_init_generic() function's pr_info() outputZqiang1-4/+2
2023-05-09rcu-tasks: Avoid pr_info() with spin lock in cblist_init_generic()Shigeru Yoshida1-1/+4
2023-04-05Merge branches 'rcu/staging-core', 'rcu/staging-docs' and 'rcu/staging-kfree'...Joel Fernandes (Google)1-0/+2
2023-04-05rcu-tasks: Report stalls during synchronize_srcu() in rcu_tasks_postscan()Neeraj Upadhyay1-0/+31
2023-04-04rcu-tasks: Fix warning for unused tasks_rcu_exit_srcuPaul E. McKenney1-0/+2
2023-01-03rcu-tasks: Handle queue-shrink/callback-enqueue race conditionZqiang1-5/+8
2023-01-03rcu-tasks: Make rude RCU-Tasks work well with CPU hotplugZqiang1-5/+3
2023-01-03rcu-tasks: Fix synchronize_rcu_tasks() VS zap_pid_ns_processes()Frederic Weisbecker1-2/+13
2023-01-03rcu-tasks: Remove preemption disablement around srcu_read_[un]lock() callsFrederic Weisbecker1-4/+0
2023-01-03rcu-tasks: Improve comments explaining tasks_rcu_exit_srcu purposeFrederic Weisbecker1-8/+29
2023-01-03rcu-tasks: Use accurate runstart time for RCU Tasks boot-time testingZqiang1-5/+3
2022-12-13Merge tag 'net-next-6.2' of git://git.kernel.org/pub/scm/linux/kernel/git/net...Linus Torvalds1-0/+2
2022-10-21rcu-tasks: Make grace-period-age message human-readablePaul E. McKenney1-1/+1
2022-10-18rcu-tasks: Provide rcu_trace_implies_rcu_gp()Paul E. McKenney1-0/+2
2022-08-31rcu-tasks: Ensure RCU Tasks Trace loops have quiescent statesPaul E. McKenney1-0/+3
2022-08-31rcu-tasks: Convert RCU_LOCKDEP_WARN() to WARN_ONCE()Zqiang1-1/+1
2022-06-21rcu-tasks: Use delayed_work to delay rcu_tasks_verify_self_tests()Waiman Long1-5/+32
2022-06-21rcu-tasks: Be more patient for RCU Tasks boot-time testingPaul E. McKenney1-7/+21
2022-06-21rcu-tasks: Update commentsPaul E. McKenney1-38/+33
2022-06-21rcu-tasks: Disable and enable CPU hotplug in same functionPaul E. McKenney1-3/+3
2022-06-21rcu-tasks: Eliminate RCU Tasks Trace IPIs to online CPUsPaul E. McKenney1-17/+7
2022-06-21rcu-tasks: Maintain a count of tasks blocking RCU Tasks Trace grace periodPaul E. McKenney1-1/+5
2022-06-21rcu-tasks: Stop RCU Tasks Trace from scanning full tasks listPaul E. McKenney1-5/+6
2022-06-20rcu-tasks: Stop RCU Tasks Trace from scanning idle tasksPaul E. McKenney1-7/+1
2022-06-20rcu-tasks: Pull in tasks blocked within RCU Tasks Trace readersPaul E. McKenney1-0/+24
2022-06-20rcu-tasks: Scan running tasks for RCU Tasks Trace readersPaul E. McKenney1-11/+40
2022-06-20rcu-tasks: Avoid rcu_tasks_trace_pertask() duplicate list additionsPaul E. McKenney1-3/+4
2022-06-20rcu-tasks: Move rcu_tasks_trace_pertask() before rcu_tasks_trace_pregp_step()Paul E. McKenney1-14/+14
2022-06-20rcu-tasks: Add blocked-task indicator to RCU Tasks Trace stall warningsPaul E. McKenney1-1/+2
2022-06-20rcu-tasks: Untrack blocked RCU Tasks Trace at reader endPaul E. McKenney1-6/+18
2022-06-20rcu-tasks: Track blocked RCU Tasks Trace readersPaul E. McKenney1-1/+21
2022-06-20rcu-tasks: Add data structures for lightweight grace periodsPaul E. McKenney1-0/+4
2022-06-20rcu-tasks: Make RCU Tasks Trace stall warning handle idle offline tasksPaul E. McKenney1-1/+1
2022-06-20rcu-tasks: Make RCU Tasks Trace stall warnings print full .b.need_qs fieldPaul E. McKenney1-2/+3
2022-06-20rcu-tasks: Flag offline CPUs in RCU Tasks Trace stall warningsPaul E. McKenney1-2/+2
2022-06-20rcu-tasks: Add slow-IPI indicator to RCU Tasks Trace stall warningsPaul E. McKenney1-1/+2
2022-06-20rcu-tasks: Simplify trc_inspect_reader() QS logicPaul E. McKenney1-6/+7
2022-06-20rcu-tasks: RCU Tasks Trace grace-period kthread has implicit QSPaul E. McKenney1-2/+3
2022-06-20rcu-tasks: Handle idle tasks for recently offlined CPUsPaul E. McKenney1-8/+7
2022-06-20rcu-tasks: Idle tasks on offline CPUs are in quiescent statesPaul E. McKenney1-1/+1
2022-06-20rcu-tasks: Make trc_read_check_handler() fetch ->trc_reader_nesting only oncePaul E. McKenney1-2/+4
2022-06-20rcu-tasks: Remove rcu_tasks_trace_postgp() wait for counterPaul E. McKenney1-59/+3
2022-06-20rcu-tasks: Merge state into .b.need_qs and atomically updatePaul E. McKenney1-32/+71
2022-06-20rcu-tasks: Drive synchronous grace periods from calling taskPaul E. McKenney1-8/+16
2022-06-20rcu-tasks: Move synchronize_rcu_tasks_generic() downPaul E. McKenney1-11/+11
2022-06-20rcu-tasks: Split rcu_tasks_one_gp() from rcu_tasks_kthread()Paul E. McKenney1-22/+36
2022-06-20rcu-tasks: Check for abandoned callbacksPaul E. McKenney1-0/+5
2022-04-11rcu-tasks: Handle sparse cpu_possible_mask in rcu_tasks_invoke_cbs()Paul E. McKenney1-1/+1
2022-04-11rcu-tasks: Handle sparse cpu_possible_maskEric Dumazet1-2/+5
2022-04-11rcu-tasks: Make show_rcu_tasks_generic_gp_kthread() check all CPUsPaul E. McKenney1-2/+12
2022-04-11rcu-tasks: Restore use of timers for non-RT kernelsPaul E. McKenney1-3/+7
2022-04-11rcu-tasks: Use schedule_hrtimeout_range() to wait for grace periodsSebastian Andrzej Siewior1-1/+4
2022-04-11rcu-tasks: Use rcuwait for the rcu_tasks_kthread()Sebastian Andrzej Siewior1-6/+8
2022-04-11rcu-tasks: Print pre-stall-warning informational messagesPaul E. McKenney1-5/+35
2022-04-11rcu-tasks: Fix race in schedule and flush workPadmanabha Srinivasaiah1-0/+3
2022-03-22Merge tag 'sched-core-2022-03-22' of git://git.kernel.org/pub/scm/linux/kerne...Linus Torvalds1-1/+1
2022-02-21Merge tag 'v5.17-rc5' into sched/core, to resolve conflictsIngo Molnar1-4/+8
2022-02-16sched/isolation: Use single feature type while referring to housekeeping cpumaskFrederic Weisbecker1-1/+1
2022-02-08rcu-tasks: Set ->percpu_enqueue_shift to zero upon contentionPaul E. McKenney1-1/+1
2022-02-08rcu-tasks: Use order_base_2() instead of ilog2()Paul E. McKenney1-3/+3
2022-01-26rcu-tasks: Fix computation of CPU-to-list shift countsPaul E. McKenney1-4/+8
2021-12-09rcu-tasks: Use fewer callbacks queues if callback flood endsPaul E. McKenney1-2/+46
2021-12-09rcu-tasks: Use separate ->percpu_dequeue_lim for callback dequeueingPaul E. McKenney1-5/+10
2021-12-09rcu-tasks: Use more callback queues if contention encounteredPaul E. McKenney1-4/+23
2021-12-09rcu-tasks: Avoid raw-spinlocked wakeups from call_rcu_tasks_generic()Paul E. McKenney1-1/+16
2021-12-09rcu-tasks: Count trylocks to estimate call_rcu_tasks() contentionPaul E. McKenney1-1/+14
2021-12-09rcu-tasks: Add rcupdate.rcu_task_enqueue_lim to set initial queueingPaul E. McKenney1-6/+18
2021-12-09rcu-tasks: Make rcu_barrier_tasks*() handle multiple callback queuesPaul E. McKenney1-6/+64
2021-12-09rcu-tasks: Use workqueues for multiple rcu_tasks_invoke_cbs() invocationsPaul E. McKenney1-23/+52
2021-12-09rcu-tasks: Abstract invocations of callbacksPaul E. McKenney1-22/+34
2021-12-09rcu-tasks: Abstract checking of callback listsPaul E. McKenney1-23/+38
2021-12-09rcu-tasks: Add a ->percpu_enqueue_lim to the rcu_tasks structurePaul E. McKenney1-0/+4
2021-12-09rcu-tasks: Inspect stalled task's trc state in locked stateNeeraj Upadhyay1-9/+34
2021-12-09rcu-tasks: Use spin_lock_rcu_node() and friendsPaul E. McKenney1-22/+20
2021-12-07rcu_tasks: Convert bespoke callback list to rcu_segcblist structurePaul E. McKenney1-23/+29
2021-12-07rcu-tasks: Convert grace-period counter to grace-period sequence numberPaul E. McKenney1-4/+5
2021-12-07rcu-tasks: Introduce ->percpu_enqueue_shift for dynamic queue selectionPaul E. McKenney1-1/+6
2021-12-07rcu-tasks: Create per-CPU callback listsPaul E. McKenney1-28/+78
2021-11-30rcu-tasks: Don't remove tasks with pending IPIs from holdout listPaul E. McKenney1-2/+3
2021-11-01Merge tag 'rcu.2021.11.01a' of git://git.kernel.org/pub/scm/linux/kernel/git/...Linus Torvalds1-56/+53
2021-10-07sched,rcu: Rework try_invoke_on_locked_down_task()Peter Zijlstra1-6/+6
2021-09-15rcu-tasks: Update comments to cond_resched_tasks_rcu_qs()Paul E. McKenney1-3/+3
2021-09-15rcu-tasks: Fix IPI failure handling in trc_wait_for_one_readerNeeraj Upadhyay1-1/+3
2021-09-15rcu-tasks: Fix read-side primitives comment for call_rcu_tasks_traceNeeraj Upadhyay1-10/+6
2021-09-15rcu-tasks: Clarify read side section info for rcu_tasks_rude GP primitivesNeeraj Upadhyay1-7/+7
2021-09-15rcu-tasks: Correct comparisons for CPU numbers in show_stalled_task_traceNeeraj Upadhyay1-2/+2
2021-09-15rcu-tasks: Correct firstreport usage in check_all_holdout_tasks_traceNeeraj Upadhyay1-1/+1
2021-09-15rcu-tasks: Fix s/rcu_add_holdout/trc_add_holdout/ typo in commentNeeraj Upadhyay1-1/+1
2021-09-15rcu-tasks: Move RTGS_WAIT_CBS to beginning of rcu_tasks_kthread() loopPaul E. McKenney1-2/+1
2021-09-15rcu-tasks: Fix s/instruction/instructions/ typo in commentPaul E. McKenney1-1/+1
2021-09-15rcu-tasks: Remove second argument of rcu_read_unlock_trace_special()Paul E. McKenney1-3/+3
2021-09-15rcu-tasks: Add trc_inspect_reader() checks for exiting critical sectionPaul E. McKenney1-9/+9
2021-09-15rcu-tasks: Simplify trc_read_check_handler() atomic operationsPaul E. McKenney1-17/+3
2021-09-13rcu-tasks: Wait for trc_read_check_handler() IPIsPaul E. McKenney1-0/+14
2021-08-10Merge branches 'doc.2021.07.20c', 'fixes.2021.08.06a', 'nocb.2021.07.20c', 'n...Paul E. McKenney1-13/+23
2021-08-06rcu: Use per_cpu_ptr to get the pointer of per_cpu variableLiu Song1-1/+1
2021-07-20rcu-tasks: Fix synchronize_rcu_rude() typo in commentPaul E. McKenney1-2/+2
2021-07-20rcu-tasks: Mark ->trc_reader_special.b.need_qs data racesPaul E. McKenney1-4/+4
2021-07-20rcu-tasks: Mark ->trc_reader_nesting data racesPaul E. McKenney1-5/+6
2021-07-20rcu-tasks: Add comments explaining task_struct strategyPaul E. McKenney1-1/+10
2021-07-06rcu-tasks: Don't delete holdouts within trc_wait_for_one_reader()Paul E. McKenney1-1/+0
2021-07-06rcu-tasks: Don't delete holdouts within trc_inspect_reader()Paul E. McKenney1-3/+2
2021-05-18Merge branches 'bitmaprange.2021.05.10c', 'doc.2021.05.10c', 'fixes.2021.05.1...Paul E. McKenney1-7/+51
2021-05-18tasks-rcu: Make show_rcu_tasks_gp_kthreads() be static inlinePaul E. McKenney1-1/+0
2021-05-12rcu: Fix various typos in commentsIngo Molnar1-4/+4
2021-05-10rcu-tasks: Add block comment laying out RCU Rude designPaul E. McKenney1-2/+7
2021-05-10rcu-tasks: Add block comment laying out RCU Tasks designPaul E. McKenney1-0/+40
2021-03-08rcu-tasks: Add block comment laying out RCU Tasks Trace designPaul E. McKenney1-0/+36
2021-03-08rcu-tasks: Rectify kernel-doc for struct rcu_tasksLukas Bulwahn1-2/+2
2021-01-22Merge branches 'doc.2021.01.06a', 'fixes.2021.01.04b', 'kfree_rcu.2021.01.04a...Paul E. McKenney1-4/+100
2021-01-04rcu-tasks: Add RCU-tasks self testsUladzislau Rezki (Sony)1-0/+79
2020-12-14rcu-tasks: Move RCU-tasks initialization to before early_initcall()Uladzislau Rezki (Sony)1-4/+21
2020-11-06rcu-tasks: Make the units of ->init_fract be jiffiesPaul E. McKenney1-8/+6
2020-11-02rcutorture: Make grace-period kthread report match RCU flavor being testedPaul E. McKenney1-16/+14
2020-11-02rcu-tasks: Convert rcu_tasks_wait_gp() for-loop to while-loopPaul E. McKenney1-4/+1
2020-09-16rcu-tasks: Enclose task-list scan in rcu_read_lock()Paul E. McKenney1-0/+2
2020-09-16rcu-tasks: Fix low-probability task_struct leakPaul E. McKenney1-4/+4
2020-09-16rcu-tasks: Fix grace-period/unlock race in RCU Tasks TracePaul E. McKenney1-0/+6
2020-09-16rcu-tasks: Shorten per-grace-period sleep for RCU Tasks TracePaul E. McKenney1-1/+9
2020-09-16rcu-tasks: Selectively enable more RCU Tasks Trace IPIsPaul E. McKenney1-2/+3
2020-09-16rcu-tasks: Use more aggressive polling for RCU Tasks TracePaul E. McKenney1-2/+14
2020-09-16rcu-tasks: Mark variables staticPaul E. McKenney1-3/+3
2020-09-16rcu-tasks: Prevent complaints of unused show_rcu_tasks_classic_gp_kthread()Paul E. McKenney1-1/+1
2020-06-29Merge branches 'doc.2020.06.29a', 'fixes.2020.06.29a', 'kfree_rcu.2020.06.29a...Paul E. McKenney1-12/+25
2020-06-29rcu-tasks: Fix synchronize_rcu_tasks_trace() header commentPaul E. McKenney1-5/+4
2020-06-29rcu-tasks: Fix code-style issuesPaul E. McKenney1-3/+3
2020-06-29rcu-tasks: Conditionally compile show_rcu_tasks_gp_kthreads()Paul E. McKenney1-0/+14
2020-06-29rcu-tasks: Make rcu_tasks_postscan() be staticPaul E. McKenney1-1/+1
2020-06-29rcu-tasks: Convert sleeps to idle priorityPaul E. McKenney1-3/+3
2020-04-27rcu-tasks: Allow standalone use of TASKS_{TRACE_,}RCUPaul E. McKenney1-24/+30
2020-04-27rcu-tasks: Add IPI failure count to statisticsPaul E. McKenney1-4/+7
2020-04-27rcu-tasks: Add count for idle tasks on offline CPUsPaul E. McKenney1-1/+5
2020-04-27rcu-tasks: Add rcu_dynticks_zero_in_eqs() effectiveness statisticsPaul E. McKenney1-2/+11
2020-04-27rcu-tasks: Make RCU tasks trace also wait for idle tasksPaul E. McKenney1-5/+13
2020-04-27rcu-tasks: Handle the running-offline idle-task special casePaul E. McKenney1-2/+6
2020-04-27rcu-tasks: Disable CPU hotplug across RCU tasks trace scansPaul E. McKenney1-4/+14
2020-04-27rcu-tasks: Allow rcu_read_unlock_trace() under scheduler locksPaul E. McKenney1-1/+11
2020-04-27rcu-tasks: Avoid IPIing userspace/idle tasks if kernel is so builtPaul E. McKenney1-10/+26
2020-04-27rcu-tasks: Add Kconfig option to mediate smp_mb() vs. IPIPaul E. McKenney1-1/+2
2020-04-27rcu-tasks: Add grace-period and IPI counts to statisticsPaul E. McKenney1-1/+9
2020-04-27rcu-tasks: Split ->trc_reader_need_endPaul E. McKenney1-13/+20
2020-04-27rcu-tasks: Provide boot parameter to delay IPIs until late in grace periodPaul E. McKenney1-4/+9
2020-04-27rcu-tasks: Add a grace-period start time for throttling and debugPaul E. McKenney1-0/+2
2020-04-27rcu-tasks: Make RCU Tasks Trace make use of RCU scheduler hooksPaul E. McKenney1-2/+3
2020-04-27rcu-tasks: Make rcutorture writer stall output include GP statePaul E. McKenney1-5/+72
2020-04-27rcu-tasks: Add RCU tasks to rcutorture writer stall outputPaul E. McKenney1-2/+43
2020-04-27rcu-tasks: Move #ifdef into tasks.hPaul E. McKenney1-0/+5
2020-04-27rcu-tasks: Add stall warnings for RCU Tasks TracePaul E. McKenney1-4/+66
2020-04-27rcu-tasks: Add an RCU Tasks Trace to simplify protection of tracing hooksPaul E. McKenney1-4/+357
2020-04-27rcu-tasks: Code movement to allow more Tasks RCU variantsPaul E. McKenney1-59/+63
2020-04-27rcu-tasks: Further refactor RCU-tasks to allow adding more variantsPaul E. McKenney1-58/+108
2020-04-27rcu-tasks: Use unique names for RCU-Tasks kthreads and messagesPaul E. McKenney1-9/+16
2020-04-27rcu-tasks: Add an RCU-tasks rude variantPaul E. McKenney1-0/+98
2020-04-27rcu-tasks: Refactor RCU-tasks to allow variants to be addedPaul E. McKenney1-234/+257
2020-04-27rcu-tasks: Create struct to hold state informationPaul E. McKenney1-27/+46
2020-04-27rcu-tasks: Move Tasks RCU to its own filePaul E. McKenney1-0/+370
generated by cgit 1.2.3-korg (git 2.39.0) at 2024-05-19 19:05:16 +0000