aboutsummaryrefslogtreecommitdiffstats
path: root/io_uring/io_uring.c
AgeCommit message (Expand)AuthorFilesLines
2024-04-05io_uring: Fix io_cqring_wait() not restoring sigmask on get_timespec64() failureAlexey Izbyshev1-13/+13
2024-04-02io_uring/kbuf: hold io_buffer_list reference over mmapJens Axboe1-5/+6
2024-04-02io_uring/kbuf: get rid of lower BGID listsJens Axboe1-2/+0
2024-04-02io_uring: use private workqueue for exit workJens Axboe1-1/+4
2024-04-01io_uring: disable io-wq execution of multishot NOWAIT requestsJens Axboe1-4/+9
2024-03-16io_uring: clear opcode specific data for an early failureJens Axboe1-9/+16
2024-03-13io_uring: Fix release of pinned pages when __io_uaddr_map failsGabriel Krisman Bertazi1-9/+13
2024-03-13io_uring: simplify io_pages_freePavel Begunkov1-5/+1
2024-03-12io_uring: clean rings on NO_MMAP alloc failPavel Begunkov1-2/+3
2024-03-11io_uring: don't save/restore iowait stateJens Axboe1-3/+2
2024-03-08io_uring: refactor DEFER_TASKRUN multishot checksPavel Begunkov1-0/+20
2024-02-15io_uring: kill stale comment for io_cqring_overflow_kill()Jens Axboe1-1/+0
2024-02-14io_uring: wake SQPOLL task when task_work is added to an empty queueJens Axboe1-1/+6
2024-02-14io_uring/napi: ensure napi polling is aborted when work is availableJens Axboe1-11/+0
2024-02-12io_uring: Don't include af_unix.h.Kuniyuki Iwashima1-1/+0
2024-02-09io-uring: add napi busy poll supportStefan Roesch1-0/+8
2024-02-09io-uring: move io_wait_queue definition to header fileStefan Roesch1-21/+0
2024-02-08io_uring: Simplify the allocation of slab cachesKunwu Chan1-3/+2
2024-02-08io_uring/sqpoll: manage task_work privatelyJens Axboe1-10/+36
2024-02-08io_uring: pass in counter to handle_tw_list() rather than return itJens Axboe1-5/+3
2024-02-08io_uring: cleanup handle_tw_list() calling conventionJens Axboe1-16/+13
2024-02-08io_uring: remove unconditional looping in local task_work handlingJens Axboe1-15/+29
2024-02-08io_uring: remove next io_kiocb fetch in task_work runningJens Axboe1-3/+0
2024-02-08io_uring: handle traditional task_work in FIFO orderJens Axboe1-1/+1
2024-02-08io_uring: remove 'loops' argument from trace_io_uring_task_work_run()Jens Axboe1-1/+1
2024-02-08io_uring: remove looping around handling traditional task_workJens Axboe1-38/+7
2024-02-08io_uring: cleanup io_req_complete_post()Jens Axboe1-4/+4
2024-02-08io_uring: add io_file_can_poll() helperJens Axboe1-1/+1
2024-02-08io_uring/cancel: don't default to setting req->work.cancel_seqJens Axboe1-1/+0
2024-02-08io_uring: expand main struct io_kiocb flags to 64-bitsJens Axboe1-4/+5
2024-01-18Merge tag 'for-6.8/io_uring-2024-01-18' of git://git.kernel.dk/linuxLinus Torvalds1-18/+45
2024-01-17Merge tag 'for-linus' of git://git.kernel.org/pub/scm/virt/kvm/kvmLinus Torvalds1-1/+2
2024-01-17io_uring: combine cq_wait_nr checksPavel Begunkov1-7/+27
2024-01-17io_uring: clean *local_work_add var namingPavel Begunkov1-7/+7
2024-01-17io_uring: clean up local tw add-wait syncPavel Begunkov1-2/+8
2024-01-17io_uring: adjust defer tw countingPavel Begunkov1-1/+1
2024-01-11Merge tag 'for-6.8/io_uring-2024-01-08' of git://git.kernel.dk/linuxLinus Torvalds1-633/+30
2024-01-11io_uring/rsrc: improve code generation for fixed file assignmentJens Axboe1-2/+3
2024-01-08Merge tag 'vfs-6.8.misc' of git://git.kernel.org/pub/scm/linux/kernel/git/vfs...Linus Torvalds1-2/+2
2024-01-04io_uring: ensure local task_work is run on wait timeoutJens Axboe1-2/+12
2024-01-02Merge tag 'loongarch-kvm-6.8' of git://git.kernel.org/pub/scm/linux/kernel/gi...Paolo Bonzini1-50/+54
2023-12-19io_uring: drop any code related to SCM_RIGHTSJens Axboe1-30/+2
2023-12-19io_uring/unix: drop usage of io_uring socketJens Axboe1-13/+0
2023-12-19io_uring/register: move io_uring_register(2) related code to register.cJens Axboe1-579/+3
2023-12-12io_uring: split out cmd api into a separate headerPavel Begunkov1-0/+1
2023-12-12io_uring: optimise ltimeout for inline executionPavel Begunkov1-10/+9
2023-12-12io_uring: don't check iopoll if request completesPavel Begunkov1-1/+5
2023-12-03io_uring: fix mutex_unlock with unreferenced ctxPavel Begunkov1-6/+3
2023-11-28io_uring: use fget/fput consistentlyJens Axboe1-18/+18
2023-11-28io_uring: free io_buffer_list entries via RCUJens Axboe1-2/+2
2023-11-28io_uring/kbuf: defer release of mapped buffer ringsJens Axboe1-0/+2
2023-11-28eventfd: simplify eventfd_signal_mask()Christian Brauner1-2/+2
2023-11-27io_uring: enable io_mem_alloc/free to be used in other partsJens Axboe1-2/+2
2023-11-27io_uring: don't guard IORING_OFF_PBUF_RING with SETUP_NO_MMAPJens Axboe1-4/+6
2023-11-27io_uring: don't allow discontig pages for IORING_SETUP_NO_MMAPJens Axboe1-18/+21
2023-11-14Merge branch 'kvm-guestmemfd' into HEADPaolo Bonzini1-1/+2
2023-11-14fs: Rename anon_inode_getfile_secure() and anon_inode_getfd_secure()Paolo Bonzini1-1/+2
2023-11-01Merge tag 'io_uring-futex-2023-10-30' of git://git.kernel.dk/linuxLinus Torvalds1-0/+7
2023-11-01Merge tag 'for-6.7/io_uring-2023-10-30' of git://git.kernel.dk/linuxLinus Torvalds1-1/+42
2023-10-18io_uring: fix crash with IORING_SETUP_NO_MMAP and invalid SQ ring addressJens Axboe1-0/+6
2023-10-05io_uring/kbuf: Use slab for struct io_buffer objectsGabriel Krisman Bertazi1-1/+3
2023-10-03io_uring: don't allow IORING_SETUP_NO_MMAP rings on highmem pagesJens Axboe1-1/+15
2023-09-29io_uring: add support for futex wake and waitJens Axboe1-0/+7
2023-09-28io_uring: cancelable uring_cmdMing Lei1-0/+33
2023-09-28io_uring: retain top 8bits of uring_cmd flags for kernel internal useMing Lei1-0/+3
2023-09-21io_uring: add IORING_OP_WAITID supportJens Axboe1-0/+3
2023-09-07Revert "io_uring: fix IO hang in io_wq_put_and_exit from do_exit()"Jens Axboe1-32/+0
2023-09-07io_uring: fix unprotected iopoll overflowPavel Begunkov1-2/+2
2023-09-07io_uring: break out of iowq iopoll on teardownPavel Begunkov1-0/+2
2023-09-05io_uring: add a sysctl to disable io_uring system-wideMatteo Rizzo1-0/+50
2023-09-01io_uring: fix IO hang in io_wq_put_and_exit from do_exit()Ming Lei1-0/+32
2023-08-29Merge tag 'for-6.6/io_uring-2023-08-28' of git://git.kernel.dk/linuxLinus Torvalds1-102/+123
2023-08-29Merge tag 'mm-stable-2023-08-28-18-26' of git://git.kernel.org/pub/scm/linux/...Linus Torvalds1-5/+1
2023-08-24io_uring: move multishot cqe cache in ctxPavel Begunkov1-3/+3
2023-08-24io_uring: add option to remove SQ indirectionPavel Begunkov1-20/+32
2023-08-24io_uring: merge iopoll and normal completion pathsPavel Begunkov1-6/+12
2023-08-24io_uring: reorder cqring_flush and wakeupsPavel Begunkov1-11/+3
2023-08-24io_uring: optimise extra io_get_cqe null checkPavel Begunkov1-4/+3
2023-08-24io_uring: refactor __io_get_cqe()Pavel Begunkov1-9/+4
2023-08-24io_uring: simplify big_cqe handlingPavel Begunkov1-5/+3
2023-08-24io_uring: cqe init hardeningPavel Begunkov1-1/+1
2023-08-21io_uring: stop calling free_compound_page()Matthew Wilcox (Oracle)1-5/+1
2023-08-16io_uring/sqpoll: fix io-wq affinity when IORING_SETUP_SQPOLL is usedJens Axboe1-11/+18
2023-08-11io_uring: simplify io_run_task_work_sig returnPavel Begunkov1-2/+2
2023-08-11io_uring/rsrc: keep one global dummy_ubufPavel Begunkov1-9/+0
2023-08-11io_uring: never overflow io_aux_cqePavel Begunkov1-4/+7
2023-08-11io_uring: remove return from io_req_cqe_overflow()Pavel Begunkov1-4/+4
2023-08-11io_uring: open code io_fill_cqe_req()Pavel Begunkov1-3/+5
2023-08-10io_uring: remove unnecessary forward declarationJens Axboe1-1/+0
2023-08-10io_uring: have io_file_put() take an io_kiocb rather than the fileJens Axboe1-4/+2
2023-08-09io_uring: cleanup 'ret' handling in io_iopoll_check()Jens Axboe1-7/+10
2023-08-09io_uring: break iopolling on signalPavel Begunkov1-0/+3
2023-08-09io_uring: fix false positive KASAN warningsPavel Begunkov1-1/+0
2023-08-09io_uring: fix drain stalls by invalid SQEPavel Begunkov1-0/+2
2023-08-09io_uring: annotate the struct io_kiocb slab for appropriate user copyJens Axboe1-2/+14
2023-08-08io_uring/parisc: Adjust pgoff in io_uring mmap() for pariscHelge Deller1-0/+3
2023-07-24io_uring: gate iowait schedule on having pending requestsJens Axboe1-6/+17
2023-07-21io_uring: Fix io_uring mmap() by using architecture-provided get_unmapped_area()Helge Deller1-25/+17
2023-07-20io_uring: treat -EAGAIN for REQ_F_NOWAIT as final for io-wqJens Axboe1-0/+8
2023-07-18io_uring: don't audit the capability check in io_uring_create()Ondrej Mosnacek1-1/+1
2023-07-07io_uring: Use io_schedule* in cqring waitAndres Freund1-2/+13
2023-06-28io_uring: flush offloaded and delayed task_work on exitJens Axboe1-3/+19
2023-06-27io_uring: remove io_fallback_tw() forward declarationJens Axboe1-15/+14
2023-06-23io_uring: merge conditional unlock flush helpersPavel Begunkov1-12/+1
2023-06-23io_uring: make io_cq_unlock_post staticPavel Begunkov1-1/+1
2023-06-23io_uring: inline __io_cq_unlockPavel Begunkov1-8/+4
2023-06-23io_uring: fix acquire/release annotationsPavel Begunkov1-3/+0
2023-06-23io_uring: kill io_cq_unlock()Pavel Begunkov1-8/+2
2023-06-23io_uring: remove IOU_F_TWQ_FORCE_NORMALPavel Begunkov1-11/+14
2023-06-23io_uring: don't batch task put on reqs freePavel Begunkov1-22/+10
2023-06-23io_uring: move io_clean_op()Pavel Begunkov1-34/+33
2023-06-23io_uring: inline io_dismantle_req()Pavel Begunkov1-12/+5
2023-06-23io_uring: remove io_free_req_twPavel Begunkov1-18/+5
2023-06-23io_uring: open code io_put_req_find_nextPavel Begunkov1-18/+7
2023-06-20io_uring: add helpers to decode the fixed file file_ptrChristoph Hellwig1-6/+4
2023-06-20io_uring: return REQ_F_ flags from io_file_get_flagsChristoph Hellwig1-3/+3
2023-06-20io_uring: remove io_req_ffs_setChristoph Hellwig1-1/+1
2023-06-20io_uring: remove a confusing comment above io_file_get_flagsChristoph Hellwig1-5/+0
2023-06-20io_uring: remove the mode variable in io_file_get_flagsChristoph Hellwig1-2/+1
2023-06-20io_uring: remove __io_file_supports_nowaitChristoph Hellwig1-14/+1
2023-06-12io_uring: wait interruptibly for request completions on exitJens Axboe1-2/+18
2023-06-07io_uring: get rid of unnecessary 'length' variableJens Axboe1-4/+1
2023-06-07io_uring: cleanup io_aux_cqe() APIJens Axboe1-1/+3
2023-06-02io_uring: avoid indirect function calls for the hottest task_workJens Axboe1-2/+7
2023-05-19io_uring: maintain ordering for DEFER_TASKRUN tw listJens Axboe1-1/+5
2023-05-16io_uring: Add io_uring_setup flag to pre-register ring fd and never install itJosh Triplett1-15/+22
2023-05-16io_uring: support for user allocated memory for rings/sqesJens Axboe1-9/+97
2023-05-16io_uring: add ring freeing helperJens Axboe1-6/+11
2023-05-16io_uring: return error pointer from io_mem_alloc()Jens Axboe1-6/+12
2023-05-16io_uring: remove sq/cq_off memsetJens Axboe1-2/+4
2023-05-15io_uring: rely solely on FMODE_NOWAITJens Axboe1-21/+0
2023-04-26Merge tag 'for-6.4/io_uring-2023-04-21' of git://git.kernel.dk/linuxLinus Torvalds1-111/+237
2023-04-15io_uring/rsrc: remove rsrc_data refsPavel Begunkov1-2/+2
2023-04-15io_uring/rsrc: use wq for quiescingPavel Begunkov1-0/+1
2023-04-14io_uring: complete request via task work in case of DEFER_TASKRUNMing Lei1-1/+1
2023-04-12io_uring/rsrc: refactor io_rsrc_node_switchPavel Begunkov1-3/+2
2023-04-12io_uring/rsrc: consolidate node cachingPavel Begunkov1-2/+0
2023-04-12io_uring: shut io_prep_async_work warningPavel Begunkov1-1/+1
2023-04-06io_uring: optimise io_req_local_work_addPavel Begunkov1-8/+16
2023-04-06io_uring: refactor __io_cq_unlock_post_flush()Pavel Begunkov1-10/+12
2023-04-06io_uring: reduce scheduling due to twPavel Begunkov1-21/+47
2023-04-06io_uring: inline llist_add()Pavel Begunkov1-1/+8
2023-04-06io_uring: add tw add flagsPavel Begunkov1-3/+4
2023-04-06io_uring: refactor io_cqring_wake()Pavel Begunkov1-4/+2
2023-04-06io_uring: optimize local tw add ctx pinningPavel Begunkov1-2/+6
2023-04-06io_uring: move pinning out of io_req_local_work_addPavel Begunkov1-7/+4
2023-04-04io_uring/rsrc: add custom limit for node cachingPavel Begunkov1-3/+6
2023-04-04io_uring/rsrc: add lockdep sanity checksPavel Begunkov1-2/+2
2023-04-04io_uring/rsrc: cache struct io_rsrc_nodePavel Begunkov1-2/+9
2023-04-04io_uring/rsrc: don't offload node freePavel Begunkov1-6/+0
2023-04-04io_uring/rsrc: kill rsrc_ref_lockPavel Begunkov1-1/+0
2023-04-04io_uring/rsrc: protect node refs with uring_lockPavel Begunkov1-6/+12
2023-04-04io_uring: io_free_req() via twPavel Begunkov1-1/+7
2023-04-04io_uring: don't put nodes under spinlocksPavel Begunkov1-2/+5
2023-04-03io_uring: cap io_sqring_entries() at SQ ring sizeJens Axboe1-1/+1
2023-04-03io_uring: rename trace_io_uring_submit_sqe() tracepointJens Axboe1-2/+1
2023-04-03io_uring: encapsulate task_work statePavel Begunkov1-35/+36
2023-04-03io_uring: remove extra tw trylocksPavel Begunkov1-2/+1
2023-04-03io_uring: Add KASAN support for alloc_cachesBreno Leitao1-2/+2
2023-04-03io_uring: add support for user mapped provided buffer ringJens Axboe1-1/+12
2023-04-03io_uring: Adjust mapping wrt architecture aliasing requirementsHelge Deller1-0/+51
2023-04-03io_uring: avoid hashing O_DIRECT writes if the filesystem doesn't need itJens Axboe1-1/+7
2023-04-01io_uring: fix memory leak when removing provided buffersWojciech Lukowicz1-1/+1
2023-03-09io_uring: silence variable ‘prev’ set but not used warningJens Axboe1-2/+2
2023-03-03Merge tag 'io_uring-6.3-2023-03-03' of git://git.kernel.dk/linuxLinus Torvalds1-16/+16
2023-02-28io_uring: fix fget leak when fs don't support nowait buffered readJoseph Qi1-1/+1
2023-02-23Merge tag 'mm-stable-2023-02-20-13-37' of git://git.kernel.org/pub/scm/linux/...Linus Torvalds1-1/+1
2023-02-22io_uring: rename 'in_idle' to 'in_cancel'Jens Axboe1-9/+9
2023-02-22io_uring: consolidate the put_ref-and-return section of adding workJens Axboe1-6/+6
2023-02-16io_uring: Support calling io_uring_register with a registered ring fdJosh Triplett1-7/+26
2023-01-29io_uring: if a linked request has REQ_F_FORCE_ASYNC then run it asyncDylan Yudaken1-3/+5
2023-01-29io_uring: add reschedule point to handle_tw_list()Jens Axboe1-1/+7
2023-01-29io_uring: add a conditional reschedule to the IOPOLL cancelation loopJens Axboe1-0/+1
2023-01-29io_uring: return normal tw run linking optimisationPavel Begunkov1-0/+9
2023-01-29io_uring: refactor tctx_task_workPavel Begunkov1-8/+5
2023-01-29io_uring: refactor io_put_task helpersPavel Begunkov1-5/+12
2023-01-29io_uring: refactor req allocationPavel Begunkov1-4/+3
2023-01-29io_uring: improve io_get_sqePavel Begunkov1-5/+5
2023-01-29io_uring: kill outdated comment about overflow flushPavel Begunkov1-1/+0
2023-01-29io_uring: use user visible tail in io_uring_poll()Pavel Begunkov1-1/+1
2023-01-29io_uring: pass in io_issue_def to io_assign_file()Jens Axboe1-4/+5
2023-01-29io_uring: Enable KASAN for request cacheBreno Leitao1-1/+2
2023-01-29io_uring: Split io_issue_def structBreno Leitao1-7/+8
2023-01-29io_uring: Rename struct io_op_defBreno Leitao1-13/+13
2023-01-29io_uring: refactor __io_req_complete_postPavel Begunkov1-2/+2
2023-01-29io_uring: simplify fallback executionPavel Begunkov1-8/+6
2023-01-29io_uring: don't export io_put_task()Pavel Begunkov1-1/+10
2023-01-29io_uring: return back links tw run optimisationPavel Begunkov1-1/+4
2023-01-29io_uring: make io_sqpoll_wait_sq return voidQuanfa Fu1-5/+3
2023-01-29io_uring: optimise deferred tw executionPavel Begunkov1-17/+7
2023-01-29io_uring: add io_req_local_work_add wake fast pathPavel Begunkov1-1/+6
2023-01-29io_uring: waitqueue-less cq waitingPavel Begunkov1-7/+12
2023-01-29io_uring: wake up optimisationsPavel Begunkov1-1/+20
2023-01-29io_uring: add lazy poll_wq activationPavel Begunkov1-1/+59
2023-01-29io_uring: separate wq for ring pollingPavel Begunkov1-1/+2
2023-01-29io_uring: move io_run_local_work_lockedPavel Begunkov1-1/+17
2023-01-29io_uring: mark io_run_local_work staticPavel Begunkov1-1/+1
2023-01-29io_uring: don't set TASK_RUNNING in local tw runnerPavel Begunkov1-3/+2
2023-01-29io_uring: refactor io_wake_functionPavel Begunkov1-4/+2
2023-01-29io_uring: keep timeout in io_wait_queuePavel Begunkov1-14/+14