aboutsummaryrefslogtreecommitdiffstats
path: root/io_uring
AgeCommit message (Expand)AuthorFilesLines
2023-08-11io_uring/rsrc: keep one global dummy_ubufPavel Begunkov2-13/+10
2023-08-11io_uring: never overflow io_aux_cqePavel Begunkov5-14/+16
2023-08-11io_uring: remove return from io_req_cqe_overflow()Pavel Begunkov2-5/+5
2023-08-11io_uring: open code io_fill_cqe_req()Pavel Begunkov3-14/+7
2023-08-11io_uring/net: don't overflow multishot recvPavel Begunkov1-1/+1
2023-08-11io_uring/net: don't overflow multishot acceptPavel Begunkov1-1/+1
2023-08-11io_uring/io-wq: don't gate worker wake up success on wake_up_process()Jens Axboe1-4/+7
2023-08-11io_uring/io-wq: reduce frequency of acct->lock acquisitionsJens Axboe1-13/+34
2023-08-11io_uring/io-wq: don't grab wq->lock for worker activationJens Axboe1-3/+0
2023-08-10io_uring: remove unnecessary forward declarationJens Axboe1-1/+0
2023-08-10io_uring: have io_file_put() take an io_kiocb rather than the fileJens Axboe2-7/+5
2023-08-10io_uring/splice: use fput() directlyJens Axboe1-2/+2
2023-08-10io_uring/fdinfo: get rid of ref trygetJens Axboe1-12/+6
2023-08-09io_uring: cleanup 'ret' handling in io_iopoll_check()Jens Axboe1-7/+10
2023-08-09io_uring: break iopolling on signalPavel Begunkov1-0/+3
2023-08-09io_uring: fix false positive KASAN warningsPavel Begunkov2-2/+0
2023-08-09io_uring: fix drain stalls by invalid SQEPavel Begunkov1-0/+2
2023-08-09io_uring/rsrc: Remove unused declaration io_rsrc_put_tw()Yue Haibing1-1/+0
2023-08-09io_uring: annotate the struct io_kiocb slab for appropriate user copyJens Axboe1-2/+14
2023-08-09io_uring: Add io_uring command support for socketsBreno Leitao1-0/+28
2023-08-08io_uring/parisc: Adjust pgoff in io_uring mmap() for pariscHelge Deller1-0/+3
2023-08-07io_uring: correct check for O_TMPFILEAleksa Sarai1-2/+4
2023-08-01Merge tag 'xfs-async-dio.6-2023-08-01' of git://git.kernel.dk/linux into ioma...Darrick J. Wong1-3/+24
2023-08-01io_uring/rw: add write support for IOCB_DIO_CALLER_COMPJens Axboe1-3/+24
2023-07-28Merge tag 'io_uring-6.5-2023-07-28' of git://git.kernel.dk/linuxLinus Torvalds1-6/+17
2023-07-24io_uring: gate iowait schedule on having pending requestsJens Axboe1-6/+17
2023-07-22Merge tag 'io_uring-6.5-2023-07-21' of git://git.kernel.dk/linuxLinus Torvalds1-26/+26
2023-07-21io_uring: Fix io_uring mmap() by using architecture-provided get_unmapped_area()Helge Deller1-25/+17
2023-07-20io_uring: treat -EAGAIN for REQ_F_NOWAIT as final for io-wqJens Axboe1-0/+8
2023-07-18io_uring: don't audit the capability check in io_uring_create()Ondrej Mosnacek1-1/+1
2023-07-17io_uring/cancel: wire up IORING_ASYNC_CANCEL_OP for sync cancelJens Axboe1-3/+8
2023-07-17io_uring/cancel: support opcode based lookup and cancelationJens Axboe3-5/+17
2023-07-17io_uring/cancel: add IORING_ASYNC_CANCEL_USERDATAJens Axboe1-6/+12
2023-07-17io_uring: use cancelation match helper for poll and timeout requestsJens Axboe2-17/+7
2023-07-17io_uring/cancel: fix sequence matching for IORING_ASYNC_CANCEL_ANYJens Axboe1-2/+3
2023-07-17io_uring/cancel: abstract out request match helperJens Axboe2-4/+14
2023-07-17io_uring/timeout: always set 'ctx' in io_cancel_dataJens Axboe1-2/+2
2023-07-17io_uring/poll: always set 'ctx' in io_cancel_dataJens Axboe1-1/+1
2023-07-14Merge tag 'io_uring-6.5-2023-07-14' of git://git.kernel.dk/linuxLinus Torvalds1-2/+13
2023-07-07io_uring: Use io_schedule* in cqring waitAndres Freund1-2/+13
2023-07-03Merge tag 'io_uring-6.5-2023-07-03' of git://git.kernel.dk/linuxLinus Torvalds2-21/+36
2023-06-29Merge tag 'fsnotify_for_v6.5-rc1' of git://git.kernel.org/pub/scm/linux/kerne...Linus Torvalds1-1/+0
2023-06-28Merge tag 'net-next-6.5' of git://git.kernel.org/pub/scm/linux/kernel/git/net...Linus Torvalds1-0/+2
2023-06-28Merge tag 'mm-stable-2023-06-24-19-15' of git://git.kernel.org/pub/scm/linux/...Linus Torvalds1-28/+6
2023-06-28io_uring: flush offloaded and delayed task_work on exitJens Axboe1-3/+19
2023-06-27io_uring: remove io_fallback_tw() forward declarationJens Axboe1-15/+14
2023-06-27io_uring/net: use proper value for msg_inqJens Axboe1-4/+4
2023-06-26Merge tag 'for-6.5/io_uring-2023-06-23' of git://git.kernel.dk/linuxLinus Torvalds15-327/+369
2023-06-23io_uring: merge conditional unlock flush helpersPavel Begunkov1-12/+1
2023-06-23io_uring: make io_cq_unlock_post staticPavel Begunkov2-3/+1
2023-06-23io_uring: inline __io_cq_unlockPavel Begunkov1-8/+4
2023-06-23io_uring: fix acquire/release annotationsPavel Begunkov1-3/+0
2023-06-23io_uring: kill io_cq_unlock()Pavel Begunkov1-8/+2
2023-06-23io_uring: remove IOU_F_TWQ_FORCE_NORMALPavel Begunkov2-15/+15
2023-06-23io_uring: don't batch task put on reqs freePavel Begunkov1-22/+10
2023-06-23io_uring: move io_clean_op()Pavel Begunkov1-34/+33
2023-06-23io_uring: inline io_dismantle_req()Pavel Begunkov1-12/+5
2023-06-23io_uring: remove io_free_req_twPavel Begunkov1-18/+5
2023-06-23io_uring: open code io_put_req_find_nextPavel Begunkov1-18/+7
2023-06-22Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/netJakub Kicinski3-11/+26
2023-06-21io_uring/net: use the correct msghdr union member in io_sendmsg_copy_hdrJens Axboe1-2/+2
2023-06-21io_uring/net: disable partial retries for recvmsg with cmsgJens Axboe1-4/+7
2023-06-21io_uring/net: clear msg_controllen on partial sendmsg retryJens Axboe1-0/+2
2023-06-20io_uring: add helpers to decode the fixed file file_ptrChristoph Hellwig4-24/+27
2023-06-20io_uring: use io_file_from_index in io_msg_grab_fileChristoph Hellwig1-3/+1
2023-06-20io_uring: use io_file_from_index in __io_sync_cancelChristoph Hellwig1-4/+1
2023-06-20io_uring: return REQ_F_ flags from io_file_get_flagsChristoph Hellwig3-8/+6
2023-06-20io_uring: remove io_req_ffs_setChristoph Hellwig3-7/+2
2023-06-20io_uring: remove a confusing comment above io_file_get_flagsChristoph Hellwig1-5/+0
2023-06-20io_uring: remove the mode variable in io_file_get_flagsChristoph Hellwig1-2/+1
2023-06-20io_uring: remove __io_file_supports_nowaitChristoph Hellwig1-14/+1
2023-06-17io_uring/poll: serialize poll linked timer start with poll removalJens Axboe1-5/+4
2023-06-15Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/netJakub Kicinski1-3/+0
2023-06-14io_uring/io-wq: clear current->worker_private on exitJens Axboe1-1/+6
2023-06-13io_uring/net: save msghdr->msg_control for retriesJens Axboe1-1/+7
2023-06-12io_uring/io-wq: don't clear PF_IO_WORKER on exitJens Axboe1-3/+0
2023-06-12io_uring: wait interruptibly for request completions on exitJens Axboe1-2/+18
2023-06-12fsnotify: move fsnotify_open() hook into do_dentry_open()Amir Goldstein1-1/+0
2023-06-09mm/gup: remove vmas parameter from pin_user_pages()Lorenzo Stoakes1-1/+1
2023-06-09io_uring: rsrc: delegate VMA file-backed check to GUPLorenzo Stoakes1-28/+6
2023-06-08Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/netJakub Kicinski1-4/+0
2023-06-07io_uring: get rid of unnecessary 'length' variableJens Axboe1-4/+1
2023-06-07io_uring: cleanup io_aux_cqe() APIJens Axboe5-11/+12
2023-06-02io_uring: avoid indirect function calls for the hottest task_workJens Axboe5-4/+12
2023-06-01Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/netJakub Kicinski1-1/+5
2023-05-26io_uring: undeprecate epoll_ctl supportBen Noordhuis1-4/+0
2023-05-25io_uring: unlock sqd->lock before sq thread release CPUWenwen Chen1-1/+5
2023-05-25io_uring/cmd: add cmd lazy tw wake helperPavel Begunkov1-4/+12
2023-05-23net: Declare MSG_SPLICE_PAGES internal sendmsg() flagDavid Howells1-0/+2
2023-05-19io_uring: annotate offset timeout racesPavel Begunkov1-1/+1
2023-05-19io_uring: maintain ordering for DEFER_TASKRUN tw listJens Axboe1-1/+5
2023-05-17io_uring/net: don't retry recvmsg() unnecessarilyJens Axboe1-1/+9
2023-05-17io_uring/net: push IORING_CQE_F_SOCK_NONEMPTY into io_recv_finish()Jens Axboe1-13/+9
2023-05-17io_uring/net: initalize msghdr->msg_inq to known valueJens Axboe1-2/+4
2023-05-17io_uring/net: initialize struct msghdr more sanely for io_recv()Jens Axboe1-7/+8
2023-05-16io_uring: Add io_uring_setup flag to pre-register ring fd and never install itJosh Triplett3-26/+45
2023-05-16io_uring: support for user allocated memory for rings/sqesJens Axboe1-9/+97
2023-05-16io_uring: add ring freeing helperJens Axboe1-6/+11
2023-05-16io_uring: return error pointer from io_mem_alloc()Jens Axboe1-6/+12
2023-05-16io_uring: remove sq/cq_off memsetJens Axboe1-2/+4
2023-05-15io_uring: rely solely on FMODE_NOWAITJens Axboe1-21/+0
2023-05-07Merge tag 'for-6.4/io_uring-2023-05-07' of git://git.kernel.dk/linuxLinus Torvalds5-19/+20
2023-05-04io_uring: Remove unnecessary BUILD_BUG_ONBreno Leitao2-11/+0
2023-05-04io_uring: Pass whole sqe to commandsBreno Leitao2-7/+4
2023-05-04io_uring: Create a helper to return the SQE sizeBreno Leitao1-0/+10
2023-05-03io_uring/rsrc: check for nonconsecutive pagesTobias Holl1-1/+6
2023-04-26Merge tag 'net-next-6.4' of git://git.kernel.org/pub/scm/linux/kernel/git/net...Linus Torvalds1-2/+1
2023-04-26Merge tag 'for-6.4/block-2023-04-21' of git://git.kernel.dk/linuxLinus Torvalds1-1/+1
2023-04-26Merge tag 'for-6.4/io_uring-2023-04-21' of git://git.kernel.dk/linuxLinus Torvalds16-813/+902
2023-04-24Merge tag 'iter-ubuf.2-2023-04-21' of git://git.kernel.dk/linuxLinus Torvalds2-20/+19
2023-04-20Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/netJakub Kicinski1-1/+1
2023-04-20Revert "io_uring/rsrc: disallow multi-source reg buffers"Jens Axboe1-8/+5
2023-04-18io_uring: add support for multishot timeoutsDavid Wei1-3/+54
2023-04-18io_uring/rsrc: disassociate nodes and rsrc_dataPavel Begunkov2-12/+11
2023-04-18io_uring/rsrc: devirtualise rsrc put callbacksPavel Begunkov2-7/+20
2023-04-18io_uring/rsrc: pass node to io_rsrc_put_work()Pavel Begunkov1-6/+6
2023-04-18io_uring/rsrc: inline io_rsrc_put_work()Pavel Begunkov2-14/+6
2023-04-18io_uring/rsrc: add empty flag in rsrc_nodePavel Begunkov2-4/+4
2023-04-18io_uring/rsrc: merge nodes and io_rsrc_putPavel Begunkov3-97/+25
2023-04-18io_uring/rsrc: infer node from ctx on io_queue_rsrc_removalPavel Begunkov3-9/+8
2023-04-18io_uring/rsrc: remove unused io_rsrc_node::llistPavel Begunkov1-1/+0
2023-04-15io_uring/rsrc: refactor io_queue_rsrc_removalPavel Begunkov1-4/+1
2023-04-15io_uring/rsrc: simplify single file node switchingPavel Begunkov1-7/+4
2023-04-15io_uring/rsrc: clean up __io_sqe_buffers_update()Pavel Begunkov1-2/+1
2023-04-15io_uring/rsrc: inline switch_start fast pathPavel Begunkov2-8/+13
2023-04-15io_uring/rsrc: remove rsrc_data refsPavel Begunkov3-28/+10
2023-04-15io_uring/rsrc: fix DEFER_TASKRUN rsrc quiescePavel Begunkov1-0/+9
2023-04-15io_uring/rsrc: use wq for quiescingPavel Begunkov3-7/+13
2023-04-15io_uring/rsrc: refactor io_rsrc_ref_quiescePavel Begunkov1-13/+5
2023-04-15io_uring/rsrc: remove io_rsrc_node::donePavel Begunkov2-5/+1
2023-04-15io_uring/rsrc: use nospec'ed indexesPavel Begunkov1-1/+1
2023-04-15io_uring/notif: add constant for ubuf_info flagsPavel Begunkov2-1/+2
2023-04-15Merge tag 'io_uring-6.3-2023-04-14' of git://git.kernel.dk/linuxLinus Torvalds1-1/+1
2023-04-14io_uring: complete request via task work in case of DEFER_TASKRUNMing Lei1-1/+1
2023-04-13Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/netJakub Kicinski2-4/+5
2023-04-12io_uring/rsrc: extract SCM file put helperPavel Begunkov1-9/+11
2023-04-12io_uring/rsrc: refactor io_rsrc_node_switchPavel Begunkov3-28/+20
2023-04-12io_uring/rsrc: zero node's rsrc data on allocPavel Begunkov1-0/+1
2023-04-12io_uring/rsrc: consolidate node cachingPavel Begunkov3-11/+16
2023-04-12io_uring/rsrc: add lockdep checksPavel Begunkov1-0/+2
2023-04-12io_uring: add irq lockdep checksPavel Begunkov1-0/+2
2023-04-12io_uring/kbuf: remove extra ->buf_ring null checkPavel Begunkov1-8/+6
2023-04-12io_uring: shut io_prep_async_work warningPavel Begunkov1-1/+1
2023-04-12io_uring/uring_cmd: take advantage of completion batchingJens Axboe1-3/+7
2023-04-08Merge tag 'io_uring-6.3-2023-04-06' of git://git.kernel.dk/linuxLinus Torvalds2-4/+5
2023-04-06io_uring: optimise io_req_local_work_addPavel Begunkov1-8/+16
2023-04-06io_uring: refactor __io_cq_unlock_post_flush()Pavel Begunkov1-10/+12
2023-04-06io_uring: reduce scheduling due to twPavel Begunkov5-24/+59
2023-04-06io_uring: inline llist_add()Pavel Begunkov1-1/+8
2023-04-06io_uring: add tw add flagsPavel Begunkov2-5/+11
2023-04-06io_uring: refactor io_cqring_wake()Pavel Begunkov2-13/+4
2023-04-06io_uring: optimize local tw add ctx pinningPavel Begunkov1-2/+6
2023-04-06io_uring: move pinning out of io_req_local_work_addPavel Begunkov1-7/+4
2023-04-06Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/netJakub Kicinski3-7/+7
2023-04-05io_uring/uring_cmd: assign ioucmd->cmd at async prep timeJens Axboe1-3/+1
2023-04-04io_uring/rsrc: add custom limit for node cachingPavel Begunkov3-5/+12
2023-04-04io_uring/rsrc: optimise io_rsrc_data refcountingPavel Begunkov2-13/+19
2023-04-04io_uring/rsrc: add lockdep sanity checksPavel Begunkov3-5/+7
2023-04-04io_uring/rsrc: cache struct io_rsrc_nodePavel Begunkov3-12/+31
2023-04-04io_uring/rsrc: don't offload node freePavel Begunkov2-61/+4
2023-04-04io_uring/rsrc: optimise io_rsrc_put allocationPavel Begunkov2-17/+36
2023-04-04io_uring/rsrc: rename rsrc_listPavel Begunkov2-4/+10
2023-04-04io_uring/rsrc: kill rsrc_ref_lockPavel Begunkov2-6/+0
2023-04-04io_uring/rsrc: protect node refs with uring_lockPavel Begunkov3-56/+21
2023-04-04io_uring: io_free_req() via twPavel Begunkov1-1/+7
2023-04-04io_uring: don't put nodes under spinlocksPavel Begunkov2-5/+8
2023-04-04io_uring/rsrc: keep cached refs per nodePavel Begunkov2-13/+18
2023-04-04io_uring/rsrc: use non-pcpu refcounts for nodesPavel Begunkov2-12/+9
2023-04-03io_uring: cap io_sqring_entries() at SQ ring sizeJens Axboe2-2/+4
2023-04-03io_uring: rename trace_io_uring_submit_sqe() tracepointJens Axboe1-2/+1
2023-04-03io_uring: encapsulate task_work statePavel Begunkov7-72/+73
2023-04-03io_uring: remove extra tw trylocksPavel Begunkov1-2/+1
2023-04-03io_uring/io-wq: drop outdated commentJens Axboe1-5/+1
2023-04-03io-wq: Drop struct io_wqeGabriel Krisman Bertazi1-188/+156
2023-04-03io-wq: Move wq accounting to io_wqGabriel Krisman Bertazi1-38/+40
2023-04-03io_uring/kbuf: disallow mapping a badly aligned provided ring bufferJens Axboe1-0/+18
2023-04-03io_uring: Add KASAN support for alloc_cachesBreno Leitao3-4/+11
2023-04-03io_uring: Move from hlist to io_wq_work_nodeBreno Leitao1-11/+13
2023-04-03io_uring: One wqe per wqBreno Leitao1-110/+70
2023-04-03io_uring: add support for user mapped provided buffer ringJens Axboe3-24/+92
2023-04-03io_uring/kbuf: rename struct io_uring_buf_reg 'pad' to'flags'Jens Axboe1-2/+6
2023-04-03io_uring/kbuf: add buffer_list->is_mapped memberJens Axboe2-6/+11
2023-04-03io_uring/kbuf: move pinning of provided buffer ring into helperJens Axboe1-12/+25
2023-04-03io_uring: Adjust mapping wrt architecture aliasing requirementsHelge Deller1-0/+51
2023-04-03io_uring: avoid hashing O_DIRECT writes if the filesystem doesn't need itJens Axboe1-1/+7
2023-04-01io_uring: fix memory leak when removing provided buffersWojciech Lukowicz2-2/+5
2023-04-01io_uring: fix return value when removing provided buffersWojciech Lukowicz1-2/+0
2023-03-31Merge tag 'io_uring-6.3-2023-03-30' of git://git.kernel.dk/linuxLinus Torvalds3-7/+7
2023-03-30Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/netJakub Kicinski4-13/+26
2023-03-30iov_iter: add iter_iov_addr() and iter_iov_len() helpersJens Axboe1-14/+13
2023-03-30iov_iter: add iter_iovec() helperJens Axboe2-6/+6
2023-03-30io_uring: fix poll/netmsg alloc cachesPavel Begunkov1-0/+1
2023-03-29io_uring/rsrc: fix rogue rsrc node grabbingPavel Begunkov1-7/+5
2023-03-28io_uring/poll: clear single/double poll flags on poll armingJens Axboe1-0/+1
2023-03-24Merge tag 'block-6.3-2023-03-24' of git://git.kernel.dk/linuxLinus Torvalds1-4/+6
2023-03-22io_uring/rsrc: fix null-ptr-deref in io_file_bitmap_get()Savino Dicanosa2-0/+4
2023-03-20io_uring/net: avoid sending -ECONNABORTED on repeated connection requestsJens Axboe1-9/+16
2023-03-20block/io_uring: pass in issue_flags for uring_cmd task_work handlingJens Axboe1-4/+6
2023-03-20blk-mq: remove hybrid pollingKeith Busch1-1/+1
2023-03-17Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/netJakub Kicinski7-13/+31