aboutsummaryrefslogtreecommitdiffstats
path: root/io_uring
AgeCommit message (Expand)AuthorFilesLines
2024-04-08io_uring/net: restore msg_control on sendzc retryPavel Begunkov1-0/+1
2024-04-05io_uring: Fix io_cqring_wait() not restoring sigmask on get_timespec64() failureAlexey Izbyshev1-13/+13
2024-04-02io_uring/kbuf: hold io_buffer_list reference over mmapJens Axboe3-14/+36
2024-04-02io_uring/kbuf: protect io_buffer_list teardown with a referenceJens Axboe2-4/+13
2024-04-02io_uring/kbuf: get rid of bl->is_readyJens Axboe2-10/+0
2024-04-02io_uring/kbuf: get rid of lower BGID listsJens Axboe2-64/+8
2024-04-02io_uring: use private workqueue for exit workJens Axboe1-1/+4
2024-04-01io_uring: disable io-wq execution of multishot NOWAIT requestsJens Axboe1-4/+9
2024-04-01io_uring/rw: don't allow multishot reads without NOWAIT supportJens Axboe1-1/+8
2024-03-18io_uring/sqpoll: early exit thread if task_context wasn't allocatedJens Axboe1-1/+5
2024-03-16io_uring: clear opcode specific data for an early failureJens Axboe1-9/+16
2024-03-16io_uring/net: ensure async prep handlers always initialize ->done_ioJens Axboe1-1/+8
2024-03-15io_uring/waitid: always remove waitid entry for cancel allJens Axboe1-6/+1
2024-03-15io_uring/futex: always remove futex entry for cancel allJens Axboe1-0/+1
2024-03-15io_uring: fix poll_remove stalled req completionPavel Begunkov1-2/+2
2024-03-13io_uring: Fix release of pinned pages when __io_uaddr_map failsGabriel Krisman Bertazi1-9/+13
2024-03-13io_uring/kbuf: rename is_mappedPavel Begunkov2-11/+11
2024-03-13io_uring: simplify io_pages_freePavel Begunkov1-5/+1
2024-03-12io_uring: clean rings on NO_MMAP alloc failPavel Begunkov1-2/+3
2024-03-12io_uring/rw: return IOU_ISSUE_SKIP_COMPLETE for multishot retryJens Axboe1-0/+2
2024-03-11io_uring: don't save/restore iowait stateJens Axboe1-3/+2
2024-03-11Merge tag 'for-6.9/io_uring-20240310' of git://git.kernel.dk/linuxLinus Torvalds23-395/+1067
2024-03-09io_uring: Fix sqpoll utilization check racing with dying sqpollGabriel Krisman Bertazi1-5/+12
2024-03-08io_uring/net: dedup io_recv_finish req completionPavel Begunkov1-12/+4
2024-03-08io_uring: refactor DEFER_TASKRUN multishot checksPavel Begunkov3-23/+20
2024-03-08io_uring: fix mshot io-wq checksPavel Begunkov1-1/+1
2024-03-08io_uring/net: add io_req_msg_cleanup() helperJens Axboe1-12/+15
2024-03-08io_uring/net: simplify msghd->msg_inq checkingJens Axboe1-2/+2
2024-03-08io_uring/kbuf: rename REQ_F_PARTIAL_IO to REQ_F_BL_NO_RECYCLEJens Axboe4-32/+13
2024-03-08io_uring/net: remove dependency on REQ_F_PARTIAL_IO for sr->done_ioJens Axboe1-5/+7
2024-03-07io_uring/net: correctly handle multishot recvmsg retry setupJens Axboe1-1/+2
2024-03-07io_uring/net: clear REQ_F_BL_EMPTY in the multishot retry handlerJens Axboe1-0/+1
2024-03-07io_uring: fix io_queue_proc modifying req->flagsPavel Begunkov1-8/+11
2024-03-07io_uring: fix mshot read defer taskrun cqe postingPavel Begunkov1-0/+2
2024-03-04io_uring/net: fix overflow check in io_recvmsg_mshot_prep()Dan Carpenter1-2/+2
2024-03-04io_uring/net: correct the type of variableMuhammad Usama Anjum1-1/+1
2024-03-01io_uring/sqpoll: statistics of the true utilization of sq threadsXiaobing Li3-1/+24
2024-03-01io_uring/net: move recv/recvmsg flags out of retry loopJens Axboe1-7/+8
2024-02-27io_uring/kbuf: flag request if buffer pool is empty after buffer pickJens Axboe1-2/+8
2024-02-27io_uring/net: improve the usercopy for sendmsg/recvmsgJens Axboe1-7/+22
2024-02-27io_uring/net: move receive multishot out of the generic msghdr pathJens Axboe1-70/+91
2024-02-27io_uring/net: unify how recvmsg and sendmsg copy in the msghdrJens Axboe1-129/+142
2024-02-15io_uring/napi: enable even with a timeout of 0Jens Axboe1-4/+5
2024-02-15io_uring: kill stale comment for io_cqring_overflow_kill()Jens Axboe1-1/+0
2024-02-14io_uring/net: fix multishot accept overflow handlingJens Axboe1-2/+3
2024-02-14io_uring/sqpoll: use the correct check for pending task_workJens Axboe1-1/+8
2024-02-14io_uring: wake SQPOLL task when task_work is added to an empty queueJens Axboe1-1/+6
2024-02-14io_uring/napi: ensure napi polling is aborted when work is availableJens Axboe3-12/+12
2024-02-12io_uring: Don't include af_unix.h.Kuniyuki Iwashima4-3/+2
2024-02-09io_uring: add register/unregister napi functionStefan Roesch3-0/+76
2024-02-09io-uring: add sqpoll support for napi busy pollStefan Roesch3-1/+33
2024-02-09io-uring: add napi busy poll supportStefan Roesch6-0/+359
2024-02-09io-uring: move io_wait_queue definition to header fileStefan Roesch2-21/+22
2024-02-09io_uring: add support for ftruncateTony Solomonik4-1/+63
2024-02-08io_uring: Simplify the allocation of slab cachesKunwu Chan1-3/+2
2024-02-08io_uring/sqpoll: manage task_work privatelyJens Axboe3-17/+82
2024-02-08io_uring: pass in counter to handle_tw_list() rather than return itJens Axboe1-5/+3
2024-02-08io_uring: cleanup handle_tw_list() calling conventionJens Axboe1-16/+13
2024-02-08io_uring/poll: improve readability of poll reference decrementingJens Axboe1-2/+2
2024-02-08io_uring: remove unconditional looping in local task_work handlingJens Axboe1-15/+29
2024-02-08io_uring: remove next io_kiocb fetch in task_work runningJens Axboe1-3/+0
2024-02-08io_uring: handle traditional task_work in FIFO orderJens Axboe1-1/+1
2024-02-08io_uring: remove 'loops' argument from trace_io_uring_task_work_run()Jens Axboe1-1/+1
2024-02-08io_uring: remove looping around handling traditional task_workJens Axboe1-38/+7
2024-02-08io_uring/kbuf: cleanup passing back cflagsJens Axboe2-24/+31
2024-02-08io_uring/rw: remove dead file == NULL checkJens Axboe1-1/+1
2024-02-08io_uring: cleanup io_req_complete_post()Jens Axboe1-4/+4
2024-02-08io_uring: mark the need to lock/unlock the ring as unlikelyJens Axboe1-2/+2
2024-02-08io_uring: add io_file_can_poll() helperJens Axboe5-6/+18
2024-02-08io_uring/cancel: don't default to setting req->work.cancel_seqJens Axboe4-8/+12
2024-02-08io_uring: expand main struct io_kiocb flags to 64-bitsJens Axboe2-5/+6
2024-02-06io_uring: use file_mnt_idmap helperAlexander Mikhalitsyn1-1/+1
2024-02-01io_uring/net: fix sr->len for IORING_OP_RECV with MSG_WAITALL and buffersJens Axboe1-0/+1
2024-01-29io_uring/net: limit inline multishot retriesJens Axboe1-3/+20
2024-01-29io_uring/poll: add requeue return code from poll multishot handlingJens Axboe2-2/+15
2024-01-29io_uring/net: un-indent mshot retry path in io_recv_finish()Jens Axboe1-16/+20
2024-01-29io_uring/poll: move poll execution helpers higher upJens Axboe1-20/+20
2024-01-28io_uring/rw: ensure poll based multishot read retries appropriatelyJens Axboe2-1/+18
2024-01-23io_uring: enable audit and restrict cred override for IORING_OP_FIXED_FD_INSTALLPaul Moore2-1/+4
2024-01-18Merge tag 'for-6.8/io_uring-2024-01-18' of git://git.kernel.dk/linuxLinus Torvalds4-47/+86
2024-01-17Merge tag 'for-linus' of git://git.kernel.org/pub/scm/virt/kvm/kvmLinus Torvalds1-1/+2
2024-01-17io_uring: combine cq_wait_nr checksPavel Begunkov1-7/+27
2024-01-17io_uring: clean *local_work_add var namingPavel Begunkov1-7/+7
2024-01-17io_uring: clean up local tw add-wait syncPavel Begunkov1-2/+8
2024-01-17io_uring: adjust defer tw countingPavel Begunkov1-1/+1
2024-01-17io_uring/register: guard compat syscall with CONFIG_COMPATJens Axboe1-3/+5
2024-01-11Merge tag 'for-6.8/io_uring-2024-01-08' of git://git.kernel.dk/linuxLinus Torvalds15-850/+752
2024-01-11Merge tag 'for-6.8/block-2024-01-08' of git://git.kernel.dk/linuxLinus Torvalds1-1/+0
2024-01-11io_uring/rsrc: improve code generation for fixed file assignmentJens Axboe2-7/+12
2024-01-10io_uring/rw: cleanup io_rw_done()Jens Axboe1-21/+27
2024-01-09Merge tag 'mm-stable-2024-01-08-15-31' of git://git.kernel.org/pub/scm/linux/...Linus Torvalds1-3/+2
2024-01-08Merge tag 'vfs-6.8.rw' of git://git.kernel.org/pub/scm/linux/kernel/git/vfs/vfsLinus Torvalds1-2/+2
2024-01-08Merge tag 'vfs-6.8.misc' of git://git.kernel.org/pub/scm/linux/kernel/git/vfs...Linus Torvalds2-3/+3
2024-01-04io_uring: ensure local task_work is run on wait timeoutJens Axboe1-2/+12
2024-01-02Merge tag 'loongarch-kvm-6.8' of git://git.kernel.org/pub/scm/linux/kernel/gi...Paolo Bonzini12-98/+256
2023-12-29io_uring: use mempool KASAN hookAndrey Konovalov1-1/+1
2023-12-29kasan: rename kasan_slab_free_mempool to kasan_mempool_poison_objectAndrey Konovalov1-2/+1
2023-12-21io_uring/kbuf: add method for returning provided buffer ring headJens Axboe3-0/+33
2023-12-21io_uring/rw: ensure io->bytes_done is always initializedJens Axboe1-3/+7
2023-12-21Merge branch 'vfs.file'Christian Brauner1-1/+1
2023-12-19io_uring: drop any code related to SCM_RIGHTSJens Axboe4-217/+10
2023-12-19io_uring/unix: drop usage of io_uring socketJens Axboe2-14/+0
2023-12-19io_uring/register: move io_uring_register(2) related code to register.cJens Axboe5-580/+619
2023-12-14io_uring/cmd: fix breakage in SOCKET_URING_OP_SIOC* implementationAl Viro1-1/+1
2023-12-13io_uring/poll: don't enable lazy wake for POLLEXCLUSIVEJens Axboe1-3/+17
2023-12-12splice: return type ssize_t from all helpersAmir Goldstein1-2/+2
2023-12-12io_uring/openclose: add support for IORING_OP_FIXED_FD_INSTALLJens Axboe3-0/+56
2023-12-12io_uring/cmd: inline io_uring_cmd_get_taskPavel Begunkov1-6/+0
2023-12-12io_uring/cmd: inline io_uring_cmd_do_in_task_lazyPavel Begunkov2-17/+0
2023-12-12io_uring: split out cmd api into a separate headerPavel Begunkov3-2/+3
2023-12-12io_uring: optimise ltimeout for inline executionPavel Begunkov1-10/+9
2023-12-12io_uring: don't check iopoll if request completesPavel Begunkov1-1/+5
2023-12-12Merge branch 'vfs.file' of git://git.kernel.org/pub/scm/linux/kernel/git/vfs/...Jens Axboe1-1/+1
2023-12-12file: remove pointless wrapperChristian Brauner1-1/+1
2023-12-07io_uring/af_unix: disable sending io_uring over socketsPavel Begunkov1-7/+0
2023-12-05io_uring/kbuf: check for buffer list readiness after NULL checkJens Axboe1-2/+2
2023-12-05io_uring/kbuf: Fix an NULL vs IS_ERR() bug in io_alloc_pbuf_ring()Dan Carpenter1-2/+2
2023-12-03io_uring: fix mutex_unlock with unreferenced ctxPavel Begunkov1-6/+3
2023-12-01io_uring: remove uring_cmd cookieKeith Busch1-1/+0
2023-11-28io_uring: use fget/fput consistentlyJens Axboe2-23/+24
2023-11-28io_uring: free io_buffer_list entries via RCUJens Axboe3-15/+56
2023-11-28io_uring/kbuf: prune deferred locked cache when tearing downJens Axboe1-0/+8
2023-11-28io_uring/kbuf: recycle freed mapped buffer ring entriesJens Axboe1-11/+66
2023-11-28io_uring/kbuf: defer release of mapped buffer ringsJens Axboe3-5/+43
2023-11-28eventfd: simplify eventfd_signal_mask()Christian Brauner1-2/+2
2023-11-27io_uring: enable io_mem_alloc/free to be used in other partsJens Axboe2-2/+5
2023-11-27io_uring: don't guard IORING_OFF_PBUF_RING with SETUP_NO_MMAPJens Axboe1-4/+6
2023-11-27io_uring: don't allow discontig pages for IORING_SETUP_NO_MMAPJens Axboe1-18/+21
2023-11-20io_uring: fix off-by one bvec indexKeith Busch1-1/+1
2023-11-20io_uring/fs: consider link->flags when getting path for LINKATCharles Mirabile1-1/+1
2023-11-15io_uring/fdinfo: remove need for sqpoll lock for thread/pid retrievalJens Axboe2-9/+12
2023-11-14Merge branch 'kvm-guestmemfd' into HEADPaolo Bonzini1-1/+2
2023-11-14fs: Rename anon_inode_getfile_secure() and anon_inode_getfd_secure()Paolo Bonzini1-1/+2
2023-11-06io_uring: do not clamp read length for multishot readDylan Yudaken1-1/+8
2023-11-06io_uring: do not allow multishot read to set addr or lenDylan Yudaken1-0/+4
2023-11-06io_uring: indicate if io_kbuf_recycle did recycle anythingDylan Yudaken2-8/+11
2023-11-06io_uring/rw: add separate prep handler for fixed read/writeJens Axboe3-14/+21
2023-11-06io_uring/rw: add separate prep handler for readv/writevJens Axboe3-9/+18
2023-11-03io_uring/net: ensure socket is marked connected on connect retryJens Axboe1-13/+11
2023-11-03io_uring/rw: don't attempt to allocate async data if opcode doesn't need itJens Axboe1-0/+7
2023-11-01Merge tag 'io_uring-futex-2023-10-30' of git://git.kernel.dk/linuxLinus Torvalds7-0/+473
2023-11-01Merge tag 'for-6.7/io_uring-sockopt-2023-10-30' of git://git.kernel.dk/linuxLinus Torvalds1-0/+53
2023-11-01Merge tag 'for-6.7/io_uring-2023-10-30' of git://git.kernel.dk/linuxLinus Torvalds14-56/+649
2023-10-30Merge tag 'vfs-6.7.misc' of gitolite.kernel.org:pub/scm/linux/kernel/git/vfs/vfsLinus Torvalds1-8/+1
2023-10-27Merge tag 'pull-fixes' of git://git.kernel.org/pub/scm/linux/kernel/git/viro/vfsLinus Torvalds1-1/+1
2023-10-27io_uring: kiocb_done() should *not* trust ->ki_pos if ->{read,write}_iter() f...Al Viro1-1/+1
2023-10-25io_uring/rw: disable IOCB_DIO_CALLER_COMPJens Axboe1-9/+0
2023-10-25io_uring/fdinfo: lock SQ thread while retrieving thread cpu/pidJens Axboe1-6/+12
2023-10-19io_uring/cmd: Introduce SOCKET_URING_OP_SETSOCKOPTBreno Leitao1-0/+21
2023-10-19io_uring/cmd: Introduce SOCKET_URING_OP_GETSOCKOPTBreno Leitao1-0/+28
2023-10-19io_uring/cmd: return -EOPNOTSUPP if net is disabledBreno Leitao1-0/+2
2023-10-19io_uring/cmd: Pass compat mode in issue_flagsBreno Leitao1-0/+2
2023-10-19io_uring/poll: use IOU_F_TWQ_LAZY_WAKE for wakeupsJens Axboe1-1/+1
2023-10-19io_uring: use files_lookup_fd_locked()Christian Brauner1-8/+1
2023-10-18io_uring: fix crash with IORING_SETUP_NO_MMAP and invalid SQ ring addressJens Axboe1-0/+6
2023-10-05io-wq: fully initialize wqe before calling cpuhp_state_add_instance_nocalls()Jeff Moyer1-6/+4
2023-10-05io_uring/kbuf: Use slab for struct io_buffer objectsGabriel Krisman Bertazi3-22/+30
2023-10-05io_uring/kbuf: Allow the full buffer id space for provided buffersGabriel Krisman Bertazi1-4/+7
2023-10-05io_uring/kbuf: Fix check of BID wrapping in provided buffersGabriel Krisman Bertazi1-1/+1
2023-10-03io_uring: don't allow IORING_SETUP_NO_MMAP rings on highmem pagesJens Axboe1-1/+15
2023-10-03io_uring: ensure io_lockdep_assert_cq_locked() handles disabled ringsJens Axboe1-14/+27
2023-10-03io_uring/kbuf: don't allow registered buffer rings on highmem pagesJens Axboe1-8/+19
2023-10-02io_uring/rsrc: cleanup io_pin_pages()Jens Axboe1-20/+17
2023-09-29io_uring/fs: remove sqe->rw_flags checking from LINKATJens Axboe1-1/+1
2023-09-29io_uring: add support for vectored futex waitsJens Axboe3-9/+173
2023-09-29io_uring: add support for futex wake and waitJens Axboe7-0/+309
2023-09-28io_uring: cancelable uring_cmdMing Lei2-0/+80
2023-09-28io_uring: retain top 8bits of uring_cmd flags for kernel internal useMing Lei2-1/+4
2023-09-21io_uring: add IORING_OP_WAITID supportJens Axboe6-1/+406
2023-09-21io_uring/rw: add support for IORING_OP_READ_MULTISHOTJens Axboe3-1/+81
2023-09-21io_uring/rw: mark readv/writev as vectored in the opcode definitionJens Axboe3-4/+10
2023-09-21io_uring/rw: split io_read() into a helperJens Axboe1-2/+13
2023-09-14io_uring/net: fix iter retargeting for selected bufPavel Begunkov1-0/+5
2023-09-07Revert "io_uring: fix IO hang in io_wq_put_and_exit from do_exit()"Jens Axboe1-32/+0
2023-09-07io_uring: fix unprotected iopoll overflowPavel Begunkov1-2/+2
2023-09-07io_uring: break out of iowq iopoll on teardownPavel Begunkov3-0/+13
2023-09-05io_uring: add a sysctl to disable io_uring system-wideMatteo Rizzo1-0/+50
2023-09-01io_uring/fdinfo: only print ->sq_array[] if it's thereJens Axboe1-0/+2
2023-09-01io_uring: fix IO hang in io_wq_put_and_exit from do_exit()Ming Lei1-0/+32
2023-08-30io_uring: Don't set affinity on a dying sqpoll threadGabriel Krisman Bertazi1-1/+3
2023-08-29Merge tag 'for-6.6/io_uring-2023-08-28' of git://git.kernel.dk/linuxLinus Torvalds17-261/+339
2023-08-29Merge tag 'mm-stable-2023-08-28-18-26' of git://git.kernel.org/pub/scm/linux/...Linus Torvalds2-10/+2
2023-08-28Merge tag 'iomap-6.6-merge-3' of git://git.kernel.org/pub/scm/fs/xfs/xfs-linuxLinus Torvalds1-3/+24
2023-08-28Merge tag 'v6.6-vfs.misc' of git://git.kernel.org/pub/scm/linux/kernel/git/vf...Linus Torvalds1-24/+9
2023-08-24io_uring: move multishot cqe cache in ctxPavel Begunkov1-3/+3
2023-08-24io_uring: add option to remove SQ indirectionPavel Begunkov1-20/+32
2023-08-24io_uring: force inline io_fill_cqe_reqPavel Begunkov1-1/+2
2023-08-24io_uring: merge iopoll and normal completion pathsPavel Begunkov3-26/+18
2023-08-24io_uring: reorder cqring_flush and wakeupsPavel Begunkov2-12/+4
2023-08-24io_uring: optimise extra io_get_cqe null checkPavel Begunkov2-15/+12
2023-08-24io_uring: refactor __io_get_cqe()Pavel Begunkov2-20/+16
2023-08-24io_uring: simplify big_cqe handlingPavel Begunkov3-20/+8
2023-08-24io_uring: cqe init hardeningPavel Begunkov1-1/+1
2023-08-24io_uring: improve cqe !tracing hot pathPavel Begunkov1-4/+5
2023-08-21io_uring: stop calling free_compound_page()Matthew Wilcox (Oracle)2-10/+2
2023-08-21io_uring: use kiocb_{start,end}_write() helpersAmir Goldstein1-19/+4
2023-08-21io_uring: rename kiocb_end_write() local helperAmir Goldstein1-5/+5
2023-08-17io_uring/rsrc: Annotate struct io_mapped_ubuf with __counted_byKees Cook1-1/+1
2023-08-16io_uring/sqpoll: fix io-wq affinity when IORING_SETUP_SQPOLL is usedJens Axboe5-15/+41
2023-08-11io_uring: simplify io_run_task_work_sig returnPavel Begunkov1-2/+2