aboutsummaryrefslogtreecommitdiffstats
path: root/kernel/rcu
AgeCommit message (Expand)AuthorFilesLines
2024-02-26Merge branches 'rcu-doc.2024.02.14a', 'rcu-nocb.2024.02.14a', 'rcu-exp.2024.0...Boqun Feng13-305/+383
2024-02-25rcu-tasks: Maintain real-time response in rcu_tasks_postscan()Paul E. McKenney1-1/+21
2024-02-25rcu-tasks: Eliminate deadlocks involving do_exit() and RCU tasksPaul E. McKenney1-16/+28
2024-02-25rcu-tasks: Maintain lists to eliminate RCU-tasks/do_exit() deadlocksPaul E. McKenney1-10/+33
2024-02-25rcu-tasks: Initialize data to eliminate RCU-tasks/do_exit() deadlocksPaul E. McKenney1-0/+2
2024-02-25rcu-tasks: Initialize callback lists at rcu_init() timePaul E. McKenney4-6/+27
2024-02-25rcu-tasks: Add data to eliminate RCU-tasks/do_exit() deadlocksPaul E. McKenney1-0/+2
2024-02-14rcu/sync: remove un-used rcu_sync_enter_start functionOnkarnath1-16/+0
2024-02-14rcutorture: Suppress rtort_pipe_count warnings until after stallsPaul E. McKenney1-4/+9
2024-02-14srcu: Improve comments about acceleration leakJoel Fernandes (Google)1-4/+20
2024-02-14rcu: Provide a boot time parameter to control lazy RCUQais Yousef2-1/+19
2024-02-14rcu: Rename jiffies_till_flush to jiffies_lazy_flushFrederic Weisbecker3-18/+18
2024-02-14rcu/exp: Remove rcu_par_gp_wqFrederic Weisbecker4-115/+8
2024-02-14rcu/exp: Handle parallel exp gp kworkers affinityFrederic Weisbecker2-43/+78
2024-02-14rcu/exp: Make parallel exp gp kworker per rcu nodeFrederic Weisbecker5-33/+52
2024-02-14rcu/exp: Move expedited kthread worker creation functions above rcutree_prepa...Frederic Weisbecker1-48/+48
2024-02-14rcu: s/boost_kthread_mutex/kthread_mutexFrederic Weisbecker3-7/+7
2024-02-14rcu/exp: Handle RCU expedited grace period kworker allocation failureFrederic Weisbecker2-6/+21
2024-02-14rcu/exp: Fix RCU expedited parallel grace period kworker allocation failure r...Frederic Weisbecker1-0/+1
2024-02-14rcu/exp: Remove full barrier upon main thread wakeupFrederic Weisbecker1-3/+2
2024-02-14rcu/nocb: Check rdp_gp->nocb_timer in __call_rcu_nocb_wake()Zqiang1-1/+2
2024-02-14rcu/nocb: Fix WARN_ON_ONCE() in the rcu_nocb_bypass_lock()Zqiang1-1/+1
2024-02-14rcu/nocb: Re-arrange call_rcu() NOCB specific codeFrederic Weisbecker3-32/+39
2024-02-14rcu/nocb: Make IRQs disablement symmetricFrederic Weisbecker2-14/+15
2024-02-14rcu/nocb: Remove needless full barrier after callback advancingFrederic Weisbecker2-1/+6
2024-02-14rcu/nocb: Remove needless LOAD-ACQUIREFrederic Weisbecker1-2/+1
2024-01-24rcu: Defer RCU kthreads wakeup when CPU is dyingFrederic Weisbecker2-3/+34
2023-12-14Merge branches 'doc.2023.12.13a', 'torture.2023.11.23a', 'fixes.2023.12.13a',...Neeraj Upadhyay (AMD)8-25/+71
2023-12-14rcu: Force quiescent states only for ongoing grace periodZqiang1-0/+2
2023-12-12srcu: Explain why callbacks invocations can't run concurrentlyFrederic Weisbecker1-0/+6
2023-12-12srcu: No need to advance/accelerate if no callback enqueuedFrederic Weisbecker1-3/+5
2023-12-12srcu: Remove superfluous callbacks advancing from srcu_gp_start()Frederic Weisbecker1-10/+0
2023-12-12rcu: Restrict access to RCU CPU stall notifiersPaul E. McKenney5-9/+53
2023-12-12rcu-tasks: Mark RCU Tasks accesses to current->rcu_tasks_idle_cpuPaul E. McKenney1-2/+2
2023-11-23rcutorture: Add fqs_holdoff check before fqs_task is createdZqiang1-1/+3
2023-11-08Merge tag 'rcu-fixes-v6.7' of git://git.kernel.org/pub/scm/linux/kernel/git/f...Linus Torvalds3-14/+63
2023-11-02Merge tag 'mm-stable-2023-11-01-14-33' of git://git.kernel.org/pub/scm/linux/...Linus Torvalds2-18/+22
2023-11-01rcu/tasks-trace: Handle new PF_IDLE semanticsFrederic Weisbecker1-1/+1
2023-11-01rcu/tasks: Handle new PF_IDLE semanticsFrederic Weisbecker1-2/+28
2023-11-01rcu: Introduce rcu_cpu_online()Frederic Weisbecker2-0/+9
2023-11-01rcu: Break rcu_node_0 --> &rq->__lock orderPeter Zijlstra1-11/+25
2023-10-23Merge branches 'rcu/torture', 'rcu/fixes', 'rcu/docs', 'rcu/refscale', 'rcu/t...Frederic Weisbecker12-141/+377
2023-10-13srcu: Only accelerate on enqueue timeFrederic Weisbecker1-4/+2
2023-10-10srcu: Fix callbacks acceleration mishandlingFrederic Weisbecker1-2/+29
2023-10-04rcu: Standardize explicit CPU-hotplug callsFrederic Weisbecker1-4/+8
2023-10-04rcu: Conditionally build CPU-hotplug teardown callbacksFrederic Weisbecker1-60/+54
2023-10-04rcu: dynamically allocate the rcu-kfree shrinkerQi Zheng1-9/+12
2023-10-04rcu: dynamically allocate the rcu-lazy shrinkerQi Zheng1-9/+10
2023-10-04rcu: Assume rcu_report_dead() is always called locallyFrederic Weisbecker1-2/+2
2023-10-04rcu: Assume IRQS disabled from rcu_report_dead()Frederic Weisbecker1-4/+6
2023-10-04rcu: Use rcu_segcblist_segempty() instead of open coding itFrederic Weisbecker1-2/+2
2023-10-04rcu: kmemleak: Ignore kmemleak false positives when RCU-freeing objectsCatalin Marinas1-0/+9
2023-09-26srcu: Fix srcu_struct node grpmask overflow on 64-bit systemsDenis Arefev1-2/+2
2023-09-24rcutorture: Traverse possible cpu to set maxcpu in rcu_nocb_toggle()Zqiang1-1/+1
2023-09-24rcutorture: Replace schedule_timeout*() 1-jiffy waits with HZ/20Joel Fernandes (Google)1-6/+6
2023-09-24torture: Move rcutorture_sched_setaffinity() out of rcutorturePaul E. McKenney3-9/+5
2023-09-24rcu: Include torture_sched_setaffinity() declarationArnd Bergmann1-0/+1
2023-09-13rcu: Eliminate rcu_gp_slow_unregister() false positivePaul E. McKenney1-1/+1
2023-09-13rcu: Dump memory object info if callback function is invalidZhen Lei6-0/+12
2023-09-13rcu: Add sysfs to provide throttled access to rcu_barrier()Paul E. McKenney1-0/+76
2023-09-13rcu/tree: Remove superfluous return from void call_rcu* functionsJoel Fernandes (Google)1-2/+2
2023-09-13srcu: Fix error handling in init_srcu_struct_fields()Joel Fernandes (Google)1-15/+17
2023-09-11refscale: Print out additional module parametersPaul E. McKenney1-2/+2
2023-09-11refscale: Fix misplaced data re-readPaul E. McKenney1-1/+1
2023-09-11rcu-tasks: Make rcu_tasks_lazy_ms staticJiapeng Chong1-1/+1
2023-09-11rcu-tasks: Pull sampling of ->percpu_dequeue_lim out of loopPaul E. McKenney1-1/+3
2023-09-11rcu-tasks: Add printk()s to localize boot-time self-test hangPaul E. McKenney1-1/+3
2023-09-11rcu/tree: Defer setting of jiffies during stall resetJoel Fernandes (Google)3-2/+34
2023-09-11rcutorture: Add test of RCU CPU stall notifiersPaul E. McKenney1-0/+21
2023-09-11rcu: Add RCU CPU stall notifierPaul E. McKenney3-2/+69
2023-09-11rcu: Eliminate check_cpu_stall() duplicate codeZhen Lei1-27/+15
2023-09-11rcu: Don't redump the stalled CPU where RCU GP kthread last ranZhen Lei1-1/+3
2023-09-11rcu: Delete a redundant check in rcu_check_gp_kthread_starvation()Zhen Lei1-7/+5
2023-09-01Merge tag 'tty-6.6-rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/greg...Linus Torvalds1-1/+1
2023-08-29Merge tag 'net-next-6.6' of git://git.kernel.org/pub/scm/linux/kernel/git/net...Linus Torvalds1-2/+0
2023-08-16Merge branches 'doc.2023.07.14b', 'fixes.2023.08.16a', 'rcu-tasks.2023.07.24a...Paul E. McKenney7-39/+252
2023-08-16rcu: Make the rcu_nocb_poll boot parameter usable via boot configPaul E. McKenney1-2/+2
2023-08-16rcu: Mark __rcu_irq_enter_check_tick() ->rcu_urgent_qs loadPaul E. McKenney1-1/+1
2023-08-14rcutorture: Stop right-shifting torture_random() return valuesPaul E. McKenney1-3/+3
2023-08-14rcu-tasks: Fix boot-time RCU tasks debug-only deadlockPaul E. McKenney1-0/+2
2023-07-31rcu-tasks: Permit use of debug-objects with RCU Tasks flavorsPaul E. McKenney1-10/+6
2023-07-25tty: sysrq: switch sysrq handlers from int to u8Jiri Slaby1-1/+1
2023-07-19rcu: Clarify rcu_is_watching() kernel-doc commentPaul E. McKenney1-5/+9
2023-07-14rcutorture: Dump grace-period state upon rtort_pipe_count incidentsPaul E. McKenney1-0/+1
2023-07-14rcuscale: Move rcu_scale_writer() schedule_timeout_uninterruptible() to _idle()Zqiang1-1/+1
2023-07-14rcuscale: fix building with RCU_TINYArnd Bergmann2-8/+19
2023-07-14rcuscale: Add RCU Tasks Rude testingPaul E. McKenney3-1/+40
2023-07-14rcuscale: Measure RCU Tasks Trace grace-period kthread CPU timePaul E. McKenney3-0/+10
2023-07-14rcuscale: Measure grace-period kthread CPU timePaul E. McKenney2-0/+27
2023-07-14rcuscale: Print out full set of kfree_rcu parametersPaul E. McKenney1-0/+4
2023-07-14rcuscale: Print out full set of module parametersPaul E. McKenney1-2/+2
2023-07-14rcuscale: Add minruntime module parameterPaul E. McKenney1-1/+4
2023-07-14rcuscale: Fix gp_async_max typo: s/reader/writer/Paul E. McKenney1-1/+1
2023-07-14rcuscale: Permit blocking delays between writersPaul E. McKenney1-0/+4
2023-07-14refscale: Add a "jiffies" testPaul E. McKenney1-1/+33
2023-07-14refscale: Fix uninitalized use of wait_queue_head_tWaiman Long1-2/+1
2023-07-14rcu-tasks: Cancel callback laziness if too many callbacksPaul E. McKenney1-2/+5
2023-07-14rcu-tasks: Add kernel boot parameters for callback lazinessPaul E. McKenney1-0/+15
2023-07-14rcu-tasks: Remove redundant #ifdef CONFIG_TASKS_RCUPaul E. McKenney1-2/+0
2023-07-14rcu-tasks: Treat only synchronous grace periods urgentlyPaul E. McKenney1-8/+73
2023-07-12rcu: Export rcu_request_urgent_qs_task()Paul E. McKenney1-2/+0
2023-06-07Merge branches 'doc.2023.05.10a', 'fixes.2023.05.11a', 'kvfree.2023.05.10a', ...Paul E. McKenney8-151/+273
2023-05-11rcu/rcuscale: Stop kfree_scale_thread thread(s) after unloading rcuscaleQiuxu Zhuo1-0/+5
2023-05-11rcu/rcuscale: Move rcu_scale_*() after kfree_scale_cleanup()Qiuxu Zhuo1-97/+97
2023-05-11rcu/nocb: Make shrinker iterate only over NOCB CPUsFrederic Weisbecker1-3/+14
2023-05-11rcu-tasks: Stop rcu_tasks_invoke_cbs() from using never-onlined CPUsPaul E. McKenney3-3/+22
2023-05-11rcu: Make rcu_cpu_starting() rely on interrupts being disabledPaul E. McKenney1-6/+5
2023-05-11rcu: Mark rcu_cpu_kthread() accesses to ->rcu_cpu_has_workPaul E. McKenney1-2/+2
2023-05-11rcu: Mark additional concurrent load from ->cpu_no_qs.b.expPaul E. McKenney2-2/+4
2023-05-11rcu: Employ jiffies-based backstop to callback time limitPaul E. McKenney2-8/+38
2023-05-11rcu: Check callback-invocation time limit for rcuc kthreadsPaul E. McKenney1-9/+19
2023-05-09rcu-tasks: Clarify the cblist_init_generic() function's pr_info() outputZqiang1-4/+2
2023-05-09rcu-tasks: Avoid pr_info() with spin lock in cblist_init_generic()Shigeru Yoshida1-1/+4
2023-05-09rcu/nocb: Recheck lazy callbacks under the ->nocb_lock from shrinkerFrederic Weisbecker1-3/+11
2023-05-09rcu/nocb: Fix shrinker race against callback enqueuerFrederic Weisbecker1-1/+1
2023-05-09rcu/nocb: Protect lazy shrinker against concurrent (de-)offloadingFrederic Weisbecker1-1/+24
2023-05-09rcu/kvfree: Make drain_page_cache() take early return if cache is disabledZqiang1-0/+3
2023-05-09rcu/kvfree: Make fill page cache start from krcp->nr_bkv_objsZqiang1-1/+1
2023-05-09rcu/kvfree: Do not run a page work if a cache is disabledUladzislau Rezki (Sony)1-0/+4
2023-05-09rcu/kvfree: Use consistent krcp when growing kfree_rcu() page cacheZqiang1-1/+1
2023-05-09rcu/kvfree: Invoke debug_rcu_bhead_unqueue() after checking bnode->gp_snapZqiang1-1/+1
2023-05-09rcu/kvfree: Add debug check for GP complete for kfree_rcu_cpu listUladzislau Rezki (Sony)1-1/+7
2023-05-09rcu/kvfree: Add debug to check grace periodsPaul E. McKenney1-18/+19
2023-04-24Merge tag 'rcu.6.4.april5.2023.3' of git://git.kernel.org/pub/scm/linux/kerne...Linus Torvalds11-229/+573
2023-04-06rcu/kvfree: Avoid freeing new kfree_rcu() memory after old grace periodZiwei Dai1-8/+19
2023-04-05Merge branches 'rcu/staging-core', 'rcu/staging-docs' and 'rcu/staging-kfree'...Joel Fernandes (Google)8-213/+519
2023-04-05rcuscale: Rename kfree_rcu() to kfree_rcu_mightsleep()Uladzislau Rezki (Sony)1-1/+1
2023-04-05rcu: Protect rcu_print_task_exp_stall() ->exp_tasks accessZqiang1-2/+4
2023-04-05rcu: Avoid stack overflow due to __rcu_irq_enter_check_tick() being kprobe-edZheng Yejian1-0/+1
2023-04-05rcu-tasks: Report stalls during synchronize_srcu() in rcu_tasks_postscan()Neeraj Upadhyay1-0/+31
2023-04-05rcu: Permit start_poll_synchronize_rcu_expedited() to be invoked earlyZqiang2-5/+5
2023-04-05rcu: Remove never-set needwake assignment from rcu_report_qs_rdp()Zqiang1-4/+6
2023-04-05rcu: Register rcu-lazy shrinker only for CONFIG_RCU_LAZY=y kernelsZqiang1-0/+4
2023-04-05rcu: Fix set/clear TICK_DEP_BIT_RCU_EXP bitmask raceZqiang1-2/+3
2023-04-05rcu: Remove CONFIG_SRCUPaul E. McKenney1-3/+0
2023-04-05rcu: Add comment to rcu_do_batch() identifying rcuoc code pathPaul E. McKenney1-0/+2
2023-04-05srcu: Clarify comments on memory barrier "E"Joel Fernandes (Google)1-7/+27
2023-04-05rcu: Further comment and explain the state space of GP sequencesFrederic Weisbecker1-0/+37
2023-04-04srcu: Fix long lines in srcu_funnel_gp_start()Paul E. McKenney1-13/+14
2023-04-04srcu: Fix long lines in srcu_gp_end()Paul E. McKenney1-20/+21
2023-04-04srcu: Fix long lines in cleanup_srcu_struct()Paul E. McKenney1-10/+11
2023-04-04srcu: Fix long lines in srcu_get_delay()Paul E. McKenney1-5/+6
2023-04-04srcu: Check for readers at module-exit timePaul E. McKenney1-1/+2
2023-04-04srcu: Move work-scheduling fields from srcu_struct to srcu_usagePaul E. McKenney1-19/+22
2023-04-04srcu: Move srcu_barrier() fields from srcu_struct to srcu_usagePaul E. McKenney1-19/+19
2023-04-04srcu: Move ->sda_is_static from srcu_struct to srcu_usagePaul E. McKenney1-4/+4
2023-04-04srcu: Move heuristics fields from srcu_struct to srcu_usagePaul E. McKenney1-9/+9
2023-04-04srcu: Move grace-period fields from srcu_struct to srcu_usagePaul E. McKenney1-64/+64
2023-04-04srcu: Move ->srcu_gp_mutex from srcu_struct to srcu_usagePaul E. McKenney1-7/+7
2023-04-04srcu: Move ->lock from srcu_struct to srcu_usagePaul E. McKenney1-28/+28
2023-04-04srcu: Move ->lock initialization after srcu_usage allocationPaul E. McKenney1-2/+2
2023-04-04srcu: Move ->srcu_cb_mutex from srcu_struct to srcu_usagePaul E. McKenney1-3/+3
2023-04-04srcu: Move ->srcu_size_state from srcu_struct to srcu_usagePaul E. McKenney1-18/+19
2023-04-04srcu: Move ->level from srcu_struct to srcu_usagePaul E. McKenney1-7/+7
2023-04-04srcu: Begin offloading srcu_struct fields to srcu_updatePaul E. McKenney2-11/+23
2023-04-04srcu: Use static init for statically allocated in-module srcu_structPaul E. McKenney1-6/+13
2023-04-04rcu-tasks: Fix warning for unused tasks_rcu_exit_srcuPaul E. McKenney1-0/+2
2023-03-27rcutorture: Add RCU Tasks Trace and SRCU deadlock scenariosPaul E. McKenney1-1/+35
2023-03-27rcutorture: Add SRCU deadlock scenariosPaul E. McKenney1-0/+151
2023-03-27rcu: Annotate SRCU's update-side lockdep dependenciesBoqun Feng2-0/+4
2023-03-20refscale: Move shutdown from wait_event() to wait_event_idle()Paul E. McKenney1-1/+1
2023-03-20rcuscale: Move shutdown from wait_event() to wait_event_idle()Paul E. McKenney1-4/+3
2023-03-20rcutorture: Create nocb kthreads only when testing rcu in CONFIG_RCU_NOCB_CPU...Zqiang1-0/+6
2023-03-11rcutorture: Eliminate variable n_rcu_torture_boost_rterrorYue Hu1-8/+3
2023-03-11rcutorture: Add test_nmis module parameterPaul E. McKenney1-2/+30
2023-02-02Merge branch 'stall.2023.01.09a' into HEADPaul E. McKenney6-4/+88
2023-02-02Merge branches 'doc.2023.01.05a', 'fixes.2023.01.23a', 'kvfree.2023.01.03a', ...Paul E. McKenney11-352/+842
2023-01-23rcu: Disable laziness if lazy-tracking says soJoel Fernandes (Google)1-1/+3
2023-01-17rcu: Track laziness during boot and suspendJoel Fernandes (Google)3-1/+47
2023-01-12rcu: Remove redundant call to rcu_boost_kthread_setaffinity()Zqiang1-5/+0
2023-01-09rcu: Allow up to five minutes expedited RCU CPU stall-warning timeoutsPaul E. McKenney2-2/+2
2023-01-05rcu: Align the output of RCU CPU stall warning messagesZhen Lei1-2/+2
2023-01-05rcu: Add RCU stall diagnosis informationZhen Lei6-0/+84
2023-01-05rcutorture: Drop sparse lock-acquisition annotationsPaul E. McKenney1-6/+6
2023-01-05refscale: Add tests using SLAB_TYPESAFE_BY_RCUPaul E. McKenney1-0/+234
2023-01-03refscale: Provide for initialization failurePaul E. McKenney1-5/+11
2023-01-03rcu-tasks: Handle queue-shrink/callback-enqueue race conditionZqiang1-5/+8
2023-01-03rcu-tasks: Make rude RCU-Tasks work well with CPU hotplugZqiang1-5/+3
2023-01-03rcu-tasks: Fix synchronize_rcu_tasks() VS zap_pid_ns_processes()Frederic Weisbecker1-2/+13
2023-01-03rcu-tasks: Remove preemption disablement around srcu_read_[un]lock() callsFrederic Weisbecker1-4/+0
2023-01-03rcu-tasks: Improve comments explaining tasks_rcu_exit_srcu purposeFrederic Weisbecker1-8/+29
2023-01-03rcu-tasks: Use accurate runstart time for RCU Tasks boot-time testingZqiang1-5/+3
2023-01-03srcu: Update comment after the index flipPaul E. McKenney1-4/+5
2023-01-03srcu: Yet more detail for srcu_readers_active_idx_check() commentsPaul E. McKenney1-16/+51
2023-01-03srcu: Remove needless rcu_seq_done() check while holding read lockPingfan Liu1-4/+7
2023-01-03rcu: Add test code for semaphore-like SRCU readersPaul E. McKenney1-0/+3
2023-01-03srcu: Fix the comparision in srcu_invl_snp_seq()Pingfan Liu1-1/+1
2023-01-03srcu: Delegate work to the boot cpu if using SRCU_SIZE_SMALLPingfan Liu1-4/+5
2023-01-03srcu: Release early_srcu resources when no longer in useZqiang1-0/+1
2023-01-03rcu/kvfree: Split ready for reclaim objects from a batchUladzislau Rezki (Sony)1-33/+54
2023-01-03rcu/kvfree: Carefully reset number of objects in krcpUladzislau Rezki (Sony)1-10/+30
2023-01-03rcu/kvfree: Use READ_ONCE() when access to krcp->headUladzislau Rezki (Sony)1-2/+2
2023-01-03rcu/kvfree: Use a polled API to speedup a reclaim processUladzislau Rezki (Sony)1-8/+39
2023-01-03rcu/kvfree: Move need_offload_krc() out of krcp->lockUladzislau Rezki (Sony)1-7/+4
2023-01-03rcu/kvfree: Move bulk/list reclaim to separate functionsUladzislau Rezki (Sony)1-49/+65
2023-01-03rcu/kvfree: Switch to a generic linked list APIUladzislau Rezki (Sony)1-46/+43
2023-01-03rcu: Refactor kvfree_call_rcu() and high-level helpersUladzislau Rezki (Sony)2-23/+15
2023-01-03rcu: Allow expedited RCU CPU stall warnings to dump task stacksPaul E. McKenney3-0/+44
2023-01-03rcu: Test synchronous RCU grace periods at the end of rcu_init()Paul E. McKenney2-0/+3
2023-01-03rcu: Make rcu_blocking_is_gp() stop early-boot might_sleep()Zqiang1-2/+3