aboutsummaryrefslogtreecommitdiffstats
path: root/kernel/sched/fair.c
AgeCommit message (Expand)AuthorFilesLines
6 hoursMerge tag 'sched-urgent-2024-05-18' of git://git.kernel.org/pub/scm/linux/ker...Linus Torvalds1-4/+5
48 hoursMerge tag 'sysctl-6.10-rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/...Linus Torvalds1-1/+0
3 dayssched/fair: Remove stale FREQUENCY_UTIL commentChristian Loehle1-2/+2
3 dayssched/fair: Fix initial util_avg calculationDawei Li1-2/+3
6 daysMerge tag 'sched-core-2024-05-13' of git://git.kernel.org/pub/scm/linux/kerne...Linus Torvalds1-215/+288
2024-04-24sched/pelt: Remove shift of thermal clockVincent Guittot1-8/+2
2024-04-24sched/cpufreq: Rename arch_update_thermal_pressure() => arch_update_hw_pressu...Vincent Guittot1-8/+8
2024-04-24sched/cpufreq: Take cpufreq feedback into accountVincent Guittot1-20/+25
2024-04-24sched/fair: Fix update of rd->sg_overutilizedVincent Guittot1-1/+1
2024-04-24scheduler: Remove the now superfluous sentinel elements from ctl_table arrayJoel Granados1-1/+0
2024-04-22sched/eevdf: Prevent vlag from going out of bounds in reweight_eevdf()Xuewen Yan1-6/+12
2024-04-22sched/eevdf: Fix miscalculation in reweight_entity() when se is not currTianchen Ding1-5/+6
2024-04-22sched/eevdf: Always update V if se->on_rq when reweightingTianchen Ding1-3/+2
2024-03-29sched/balancing: Simplify the sg_status bitmask and use separate ->overloaded...Ingo Molnar1-18/+18
2024-03-28sched/fair: Rename set_rd_overutilized_status() to set_rd_overutilized()Ingo Molnar1-4/+4
2024-03-28sched/fair: Rename SG_OVERLOAD to SG_OVERLOADEDIngo Molnar1-3/+3
2024-03-28sched/fair: Rename {set|get}_rd_overload() to {set|get}_rd_overloaded()Ingo Molnar1-2/+2
2024-03-28sched/fair: Use helper functions to access root_domain::overloadShrikanth Hegde1-3/+2
2024-03-28sched/fair: Check root_domain::overload value before updateShrikanth Hegde1-1/+2
2024-03-28sched/fair: Combine EAS check with root_domain::overutilized accessShrikanth Hegde1-13/+7
2024-03-26sched/fair: Simplify the continue_balancing logic in sched_balance_newidle()Shrikanth Hegde1-5/+5
2024-03-26sched/fair: Introduce is_rd_overutilized() helper function to access root_dom...Shrikanth Hegde1-3/+12
2024-03-26sched/fair: Add EAS checks before updating root_domain::overutilizedShrikanth Hegde1-19/+34
2024-03-25sched/fair: Don't double balance_interval for migrate_misfitQais Yousef1-2/+11
2024-03-25sched/fair: Check if a task has a fitting CPU when updating misfitQais Yousef1-16/+50
2024-03-25Merge tag 'v6.9-rc1' into sched/core, to pick up fixes and to refresh the branchIngo Molnar1-0/+6
2024-03-14Merge tag 'mm-stable-2024-03-13-20-04' of git://git.kernel.org/pub/scm/linux/...Linus Torvalds1-0/+6
2024-03-14sched/fair: Fix typos in commentsIngo Molnar1-34/+34
2024-03-12sched/balancing: Fix a couple of outdated function names in commentsIngo Molnar1-1/+1
2024-03-12sched/balancing: Rename find_idlest_cpu() => sched_balance_find_dst_cpu()Ingo Molnar1-3/+3
2024-03-12sched/balancing: Rename find_idlest_group() => sched_balance_find_dst_group()Ingo Molnar1-4/+4
2024-03-12sched/balancing: Rename find_idlest_group_cpu() => sched_balance_find_dst_gro...Ingo Molnar1-3/+3
2024-03-12sched/balancing: Rename newidle_balance() => sched_balance_newidle()Ingo Molnar1-8/+8
2024-03-12sched/balancing: Rename update_blocked_averages() => sched_balance_update_blo...Ingo Molnar1-4/+4
2024-03-12sched/balancing: Rename find_busiest_group() => sched_balance_find_src_group()Ingo Molnar1-7/+7
2024-03-12sched/balancing: Rename find_busiest_queue() => sched_balance_find_src_rq()Ingo Molnar1-3/+3
2024-03-12sched/balancing: Rename load_balance() => sched_balance_rq()Ingo Molnar1-5/+5
2024-03-12sched/balancing: Rename rebalance_domains() => sched_balance_domains()Ingo Molnar1-4/+4
2024-03-12sched/balancing: Rename trigger_load_balance() => sched_balance_trigger()Ingo Molnar1-1/+1
2024-03-12sched/balancing: Rename run_rebalance_domains() => sched_balance_softirq()Ingo Molnar1-2/+2
2024-03-12sched/balancing: Update comments in 'struct sg_lb_stats' and 'struct sd_lb_st...Ingo Molnar1-10/+9
2024-03-12sched/balancing: Vertically align the comments of 'struct sg_lb_stats' and 's...Ingo Molnar1-18/+18
2024-03-12sched/balancing: Update run_rebalance_domains() commentsIngo Molnar1-3/+6
2024-03-12sched/balancing: Fix comments (trying to) refer to NOHZ_BALANCE_KICKIngo Molnar1-3/+4
2024-03-12sched/balancing: Change comment formatting to not overlap Git conflict marker...Ingo Molnar1-2/+2
2024-03-12sched/balancing: Change 'enum cpu_idle_type' to have more natural definitionsIngo Molnar1-15/+12
2024-03-12sched/balancing: Switch the 'DEFINE_SPINLOCK(balancing)' spinlock into an 'at...Ingo Molnar1-3/+16
2024-03-04sched/numa, mm: do not try to migrate memory to memoryless nodesByungchul Park1-0/+6
2024-02-28sched/topology: Rename SD_SHARE_PKG_RESOURCES to SD_SHARE_LLCAlex Shi1-1/+1
2024-02-28sched/fair: Check the SD_ASYM_PACKING flag in sched_use_asym_prio()Alex Shi1-9/+7
2024-02-28sched/fair: Rework sched_use_asym_prio() and sched_asym_prefer()Alex Shi1-25/+20
2024-02-28sched/fair: Remove unused parameter from sched_asym()Alex Shi1-4/+2
2024-02-28sched/fair: Simplify the update_sd_pick_busiest() logicDavid Vernet1-9/+3
2024-02-28sched/fair: Do strict inequality check for busiest misfit task groupDavid Vernet1-1/+1
2024-02-28sched/fair: Remove unnecessary goto in update_sd_lb_stats()David Vernet1-6/+1
2024-02-28sched/fair: Take the scheduling domain into account in select_idle_core()Keisuke Nishimura1-2/+2
2024-02-28sched/fair: Take the scheduling domain into account in select_idle_smt()Keisuke Nishimura1-3/+9
2024-02-28sched/fair: Add READ_ONCE() and use existing helper function to access ->avg_irqShrikanth Hegde1-3/+1
2024-02-28sched/fair: Use existing helper functions to access ->avg_rt and ->avg_dlShrikanth Hegde1-4/+4
2024-02-16sched/core: Simplify code by removing duplicate #ifdefsShrikanth Hegde1-2/+0
2024-01-09Merge tag 'mm-nonmm-stable-2024-01-09-10-33' of git://git.kernel.org/pub/scm/...Linus Torvalds1-13/+0
2024-01-08Merge branch 'sched/urgent' into sched/core, to pick up pending v6.7 fixes fo...Ingo Molnar1-0/+52
2023-12-29sched/fair: Fix tg->load when offlining a CPUVincent Guittot1-0/+52
2023-12-23sched/fair: Remove unused 'next_buddy_marked' local variable in check_preempt...Wang Jinchao1-2/+0
2023-12-23sched/fair: Use all little CPUs for CPU-bound workloadsPierre Gondois1-1/+1
2023-12-23sched/fair: Simplify util_estVincent Guittot1-51/+31
2023-12-23sched/fair: Remove SCHED_FEAT(UTIL_EST_FASTUP, true)Vincent Guittot1-5/+3
2023-12-10sched: fair: move unused stub functions to headerArnd Bergmann1-13/+0
2023-11-29sched/fair: Update min_vruntime for reweight_entity() correctlyYiwei Lin1-10/+10
2023-11-23sched/cpufreq: Rework schedutil governor performance estimationVincent Guittot1-3/+19
2023-11-23sched/pelt: Avoid underestimation of task utilizationVincent Guittot1-0/+13
2023-11-15sched/deadline: Introduce deadline serversPeter Zijlstra1-0/+2
2023-11-15sched: Unify more update_curr*()Peter Zijlstra1-13/+11
2023-11-15sched: Remove vruntime from trace_sched_stat_runtime()Peter Zijlstra1-3/+2
2023-11-15sched: Unify runtime accounting across classesPeter Zijlstra1-14/+43
2023-11-15sched/eevdf: O(1) fastpath for task selectionAbel Wu1-3/+11
2023-11-15sched/eevdf: Sort the rbtree by virtual deadlineAbel Wu1-101/+67
2023-11-15sched/numa: Fix mm numa_scan_seq based unconditional scanRaghavendra K T1-1/+3
2023-11-14sched/fair: Fix the decision for load balanceKeisuke Nishimura1-3/+7
2023-11-14sched/eevdf: Fix vruntime adjustment on reweightAbel Wu1-23/+128
2023-11-02Merge tag 'mm-stable-2023-11-01-14-33' of git://git.kernel.org/pub/scm/linux/...Linus Torvalds1-6/+6
2023-10-25sched/fair: use folio_xchg_last_cpupid() in should_numa_migrate_memory()Kefeng Wang1-1/+1
2023-10-25sched/fair: use folio_xchg_access_time() in numa_hint_fault_latency()Kefeng Wang1-1/+1
2023-10-24sched/fair: Remove SIS_PROPPeter Zijlstra1-48/+0
2023-10-24sched/fair: Use candidate prev/recent_used CPU if scanning failed for cluster...Yicong Yang1-1/+16
2023-10-24sched/fair: Scan cluster before scanning LLC in wake-up pathBarry Song1-4/+36
2023-10-23Merge tag 'v6.6-rc7' into sched/core, to pick up fixesIngo Molnar1-14/+60
2023-10-20sched/fair: Remove unused 'curr' argument from pick_next_entity()Yiwei Lin1-4/+4
2023-10-20sched/nohz: Update comments about NEWILB_KICKJoel Fernandes (Google)1-2/+13
2023-10-18sched/fair: Remove duplicate #includeJiapeng Chong1-2/+0
2023-10-18sched/eevdf: Fix heap corruption morePeter Zijlstra1-1/+2
2023-10-16sched/numa, mm: make numa migrate functions to take a folioKefeng Wang1-6/+6
2023-10-13sched: Fix stop_one_cpu_nowait() vs hotplugPeter Zijlstra1-1/+3
2023-10-12sched/topology: Rename 'DIE' domain to 'PKG'Peter Zijlstra1-1/+1
2023-10-10sched/numa: Complete scanning of inactive VMAs when there is no alternativeMel Gorman1-3/+52
2023-10-10sched/numa: Complete scanning of partial VMAs regardless of PID activityMel Gorman1-3/+15
2023-10-10sched/numa: Move up the access pid reset logicRaghavendra K T1-10/+7
2023-10-10sched/numa: Trace decisions related to skipping VMAsMel Gorman1-4/+13
2023-10-10sched/numa: Rename vma_numab_state::access_pids[] => ::pids_active[], ::next_...Mel Gorman1-6/+6
2023-10-09sched/topology: Consolidate and clean up access to a CPU's max compute capacityVincent Guittot1-10/+8
2023-10-09sched/nohz: Remove unnecessarily complex error handling pattern from find_new...Ingo Molnar1-3/+2
2023-10-09sched/nohz: Use consistent variable names in find_new_ilb() and kick_ilb()Ingo Molnar1-5/+5
2023-10-09sched/nohz: Update idle load-balancing (ILB) commentsIngo Molnar1-14/+16
2023-10-09sched/eevdf: Fix pick_eevdf()Benjamin Segall1-14/+58
2023-10-09sched/eevdf: Fix min_deadline heap integrityPeter Zijlstra1-0/+1
2023-10-07Merge branch 'sched/urgent' into sched/core, to pick up fixes and refresh the...Ingo Molnar1-5/+38
2023-10-03sched/eevdf: Fix avg_vruntime()Peter Zijlstra1-1/+9
2023-10-03sched/eevdf: Also update slice on placementPeter Zijlstra1-2/+4
2023-09-29sched/debug: Add new tracepoint to track compute energy computationQais Yousef1-1/+6
2023-09-29sched/uclamp: Ignore (util == 0) optimization in feec() when p_util_max = 0Qais Yousef1-17/+1
2023-09-29sched/uclamp: Set max_spare_cap_cpu even if max_spare_cap is 0Qais Yousef1-6/+5
2023-09-24sched/fair: Fix warning in bandwidth distributionJosh Don1-11/+25
2023-09-24sched/fair: Make cfs_rq->throttled_csd_list available on !SMPJosh Don1-4/+0
2023-09-21sched/debug: Remove the /proc/sys/kernel/sched_child_runs_first sysctlSebastian Andrzej Siewior1-13/+0
2023-09-19sched/fair: Rename check_preempt_curr() to wakeup_preempt()Ingo Molnar1-5/+5
2023-09-19sched/fair: Rename check_preempt_wakeup() to check_preempt_wakeup_fair()Ingo Molnar1-2/+2
2023-09-18sched/fair: Ratelimit update to tg->load_avgAaron Lu1-1/+12
2023-09-15sched/fair: Fix cfs_rq_is_decayed() on !SMPChengming Zhou1-1/+1
2023-09-15sched/fair: Fix open-coded numa_nearest_node()Yury Norov1-13/+1
2023-09-13sched/fair: Fix SMT4 group_smt_balance handlingTim Chen1-1/+11
2023-09-02sched/fair: Optimize should_we_balance() for large SMT systemsShrikanth Hegde1-1/+14
2023-08-29sched/fair: Make update_entity_lag() staticHao Jia1-1/+1
2023-08-28Merge tag 'x86-cleanups-2023-08-28' of git://git.kernel.org/pub/scm/linux/ker...Linus Torvalds1-3/+3
2023-08-28Merge tag 'sched-core-2023-08-28' of git://git.kernel.org/pub/scm/linux/kerne...Linus Torvalds1-615/+724
2023-08-17sched/eevdf: Curb wakeup-preemptionPeter Zijlstra1-0/+12
2023-08-10Merge branch 'sched/eevdf' into sched/coreIngo Molnar1-597/+494
2023-08-02sched/fair: Block nohz tick_stop when cfs bandwidth in usePhil Auld1-1/+51
2023-08-02sched, cgroup: Restore meaning to hierarchical_quotaPhil Auld1-3/+4
2023-07-31Revert "sched/fair: Move unused stub functions to header"Peter Zijlstra1-3/+3
2023-07-26sched/fair: remove util_est boostingVincent Guittot1-3/+0
2023-07-19sched/fair: Propagate enqueue flags into place_entity()Peter Zijlstra1-5/+5
2023-07-19sched/debug: Rename sysctl_sched_min_granularity to sysctl_sched_base_slicePeter Zijlstra1-6/+6
2023-07-19sched/fair: Commit to EEVDFPeter Zijlstra1-427/+38
2023-07-19sched/smp: Use lag to simplify cross-runqueue placementPeter Zijlstra1-126/+19
2023-07-19sched/fair: Commit to lag based placementPeter Zijlstra1-58/+1
2023-07-19sched/fair: Implement an EEVDF-like scheduling policyPeter Zijlstra1-46/+292
2023-07-19sched/fair: Add lag based placementPeter Zijlstra1-38/+130
2023-07-19sched/fair: Remove sched_feat(START_DEBIT)Peter Zijlstra1-20/+1
2023-07-19sched/fair: Add cfs_rq::avg_vruntimePeter Zijlstra1-3/+134
2023-07-19Merge tag 'v6.5-rc2' into sched/core, to pick up fixesIngo Molnar1-1/+1
2023-07-17sched: add WF_CURRENT_CPU and externise ttwuPeter Oskolkov1-0/+4
2023-07-13sched/fair: Stabilize asym cpu capacity system idle cpu selectionVincent Guittot1-1/+1
2023-07-13sched/fair: Consider the idle state of the whole core for load balanceRicardo Neri1-1/+15
2023-07-13sched/fair: Implement prefer sibling imbalance calculation between asymmetric...Tim C Chen1-4/+37
2023-07-13sched/fair: Determine active load balance for SMT sched groupsTim C Chen1-3/+77
2023-07-13sched: add throttled time stat for throttled childrenJosh Don1-1/+20
2023-07-13sched: don't account throttle time for empty groupsJosh Don1-3/+15
2023-07-10sched/fair: Use recent_used_cpu to test p->cpus_ptrMiaohe Lin1-1/+1
2023-06-16sched/core: Avoid multiple calling update_rq_clock() in __cfsb_csd_unthrottle()Hao Jia1-0/+18
2023-06-16sched/fair: Rename variable cpu_util eff_utilTom Rix1-3/+3
2023-06-05sched/fair, cpufreq: Introduce 'runnable boosting'Dietmar Eggemann1-8/+30
2023-06-05sched/fair: Refactor CPU utilization functionsDietmar Eggemann1-14/+49
2023-06-05sched/fair: Don't balance task to its current running CPUYicong Yang1-1/+1
2023-05-30sched/fair: Move unused stub functions to headerArnd Bergmann1-3/+3
2023-05-30sched/fair: Hide unused init_cfs_bandwidth() stubArnd Bergmann1-2/+1
2023-05-30sched: Hide unused sched_update_scaling()Arnd Bergmann1-1/+2
2023-05-08sched/fair: Do not even the number of busy CPUs via asym_packingRicardo Neri1-65/+21
2023-05-08sched/fair: Use the busiest group to set prefer_siblingRicardo Neri1-4/+11
2023-05-08sched/fair: Keep a fully_busy SMT sched group as busiestRicardo Neri1-2/+14
2023-05-08sched/fair: Let low-priority cores help high-priority busy SMT coresRicardo Neri1-2/+14
2023-05-08sched/fair: Simplify asym_packing logic for SMT coresRicardo Neri1-21/+12
2023-05-08sched/fair: Only do asym_packing load balancing from fully idle SMT coresRicardo Neri1-16/+40
2023-05-08sched/fair: Move is_core_idle() out of CONFIG_NUMARicardo Neri1-17/+17
2023-04-28Merge tag 'sched-core-2023-04-27' of git://git.kernel.org/pub/scm/linux/kerne...Linus Torvalds1-1/+21
2023-04-27Merge tag 'mm-stable-2023-04-27-15-30' of git://git.kernel.org/pub/scm/linux/...Linus Torvalds1-0/+57
2023-04-21Merge branch 'v6.3-rc7'Peter Zijlstra1-11/+54
2023-04-12sched/fair: Fix imbalance overflowVincent Guittot1-0/+10
2023-04-05sched/numa: use hash_32 to mix up PIDs accessing VMARaghavendra K T1-1/+1
2023-04-05sched/numa: implement access PID reset logicRaghavendra K T1-2/+21
2023-04-05sched/numa: enhance vma scanning logicRaghavendra K T1-0/+19
2023-04-05sched/numa: apply the scan delay to every new vmaMel Gorman1-0/+19
2023-04-05sched/fair: Fix inaccurate tally of ttwu_move_affineLibo Chen1-1/+1
2023-03-22sched: Interleave cfs bandwidth timers for improved single thread performance...Shrikanth Hegde1-0/+4
2023-03-22sched/core: Avoid selecting the task that is throttled to run when core-sched...Hao Jia1-0/+16
2023-03-21sched/fair: Sanitize vruntime of entity being migratedVincent Guittot1-11/+44
2023-02-23Merge tag 'mm-stable-2023-02-20-13-37' of git://git.kernel.org/pub/scm/linux/...Linus Torvalds1-7/+7
2023-02-11sched/fair: sanitize vruntime of entity being placedZhang Qiao1-2/+13
2023-02-11sched/fair: Remove capacity inversion detectionVincent Guittot1-79/+5
2023-02-11sched/fair: unlink misfit task from cpu overutilizedVincent Guittot1-23/+82
2023-02-09sched: convert to vma iteratorLiam R. Howlett1-7/+7
2023-01-31Merge tag 'v6.2-rc6' into sched/core, to pick up fixesIngo Molnar1-21/+27
2023-01-15sched/fair: Limit sched slice durationVincent Guittot1-1/+7
2023-01-13sched/fair: Fixes for capacity inversion detectionQais Yousef1-2/+11
2023-01-13sched/uclamp: Fix a uninitialized variable warningsQais Yousef1-19/+16
2022-12-27sched/core: Adjusting the order of scanning CPUHao Jia1-2/+2
2022-12-27sched/numa: Stop an exhastive search if an idle core is foundHao Jia1-1/+1
2022-12-27sched: Make const-safeMatthew Wilcox (Oracle)1-7/+9
2022-12-27sched: Async unthrottling for cfs bandwidthJosh Don1-13/+142
2022-12-13Merge tag 'sysctl-6.2-rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/m...Linus Torvalds1-3/+15
2022-12-12Merge tag 'mm-nonmm-stable-2022-12-12' of git://git.kernel.org/pub/scm/linux/...Linus Torvalds1-1/+1
2022-11-20sched: Move numa_balancing sysctls to its own fileKefeng Wang1-3/+15
2022-11-18sched/fair: use try_cmpxchg in task_numa_workUros Bizjak1-1/+1
2022-10-27sched/fair: Check if prev_cpu has highest spare cap in feec()Pierre Gondois1-6/+7
2022-10-27sched/fair: Consider capacity inversion in util_fits_cpu()Qais Yousef1-5/+9
2022-10-27sched/fair: Detect capacity inversionQais Yousef1-3/+60
2022-10-27sched/uclamp: Cater for uclamp in find_energy_efficient_cpu()'s early exit co...Qais Yousef1-6/+8
2022-10-27sched/uclamp: Make cpu_overutilized() use util_fits_cpu()Qais Yousef1-1/+4
2022-10-27sched/uclamp: Make asym_fits_capacity() use util_fits_cpu()Qais Yousef1-8/+13
2022-10-27sched/uclamp: Make select_idle_capacity() use util_fits_cpu()Qais Yousef1-3/+5
2022-10-27sched/uclamp: Fix fits_capacity() check in feec()Qais Yousef1-2/+24