sphinx.addnodesdocument)}( rawsourcechildren]( translations LanguagesNode)}(hhh](h pending_xref)}(hhh]docutils.nodesTextChinese (Simplified)}parenthsba attributes}(ids]classes]names]dupnames]backrefs] refdomainstdreftypedoc reftarget+/translations/zh_CN/networking/timestampingmodnameN classnameN refexplicitutagnamehhh ubh)}(hhh]hChinese (Traditional)}hh2sbah}(h]h ]h"]h$]h&] refdomainh)reftypeh+ reftarget+/translations/zh_TW/networking/timestampingmodnameN classnameN refexplicituh1hhh ubh)}(hhh]hItalian}hhFsbah}(h]h ]h"]h$]h&] refdomainh)reftypeh+ reftarget+/translations/it_IT/networking/timestampingmodnameN classnameN refexplicituh1hhh ubh)}(hhh]hJapanese}hhZsbah}(h]h ]h"]h$]h&] refdomainh)reftypeh+ reftarget+/translations/ja_JP/networking/timestampingmodnameN classnameN refexplicituh1hhh ubh)}(hhh]hKorean}hhnsbah}(h]h ]h"]h$]h&] refdomainh)reftypeh+ reftarget+/translations/ko_KR/networking/timestampingmodnameN classnameN refexplicituh1hhh ubh)}(hhh]hSpanish}hhsbah}(h]h ]h"]h$]h&] refdomainh)reftypeh+ reftarget+/translations/sp_SP/networking/timestampingmodnameN classnameN refexplicituh1hhh ubeh}(h]h ]h"]h$]h&]current_languageEnglishuh1h hh _documenthsourceNlineNubhcomment)}(h SPDX-License-Identifier: GPL-2.0h]h SPDX-License-Identifier: GPL-2.0}hhsbah}(h]h ]h"]h$]h&] xml:spacepreserveuh1hhhhhhE/var/lib/git/docbuild/linux/Documentation/networking/timestamping.rsthKubhsection)}(hhh](htitle)}(h Timestampingh]h Timestamping}(hhhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhhhhhKubh)}(hhh](h)}(h1. Control Interfacesh]h1. Control Interfaces}(hhhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhhhhhK ubh paragraph)}(h=The interfaces for receiving network packages timestamps are:h]h=The interfaces for receiving network packages timestamps are:}(hhhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhK hhhhubhdefinition_list)}(hhh](hdefinition_list_item)}(hXSO_TIMESTAMP Generates a timestamp for each incoming packet in (not necessarily monotonic) system time. Reports the timestamp via recvmsg() in a control message in usec resolution. SO_TIMESTAMP is defined as SO_TIMESTAMP_NEW or SO_TIMESTAMP_OLD based on the architecture type and time_t representation of libc. Control message format is in struct __kernel_old_timeval for SO_TIMESTAMP_OLD and in struct __kernel_sock_timeval for SO_TIMESTAMP_NEW options respectively. h](hterm)}(h SO_TIMESTAMPh]h SO_TIMESTAMP}(hhhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhhubh definition)}(hhh]h)}(hXGenerates a timestamp for each incoming packet in (not necessarily monotonic) system time. Reports the timestamp via recvmsg() in a control message in usec resolution. SO_TIMESTAMP is defined as SO_TIMESTAMP_NEW or SO_TIMESTAMP_OLD based on the architecture type and time_t representation of libc. Control message format is in struct __kernel_old_timeval for SO_TIMESTAMP_OLD and in struct __kernel_sock_timeval for SO_TIMESTAMP_NEW options respectively.h]hXGenerates a timestamp for each incoming packet in (not necessarily monotonic) system time. Reports the timestamp via recvmsg() in a control message in usec resolution. SO_TIMESTAMP is defined as SO_TIMESTAMP_NEW or SO_TIMESTAMP_OLD based on the architecture type and time_t representation of libc. Control message format is in struct __kernel_old_timeval for SO_TIMESTAMP_OLD and in struct __kernel_sock_timeval for SO_TIMESTAMP_NEW options respectively.}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjubah}(h]h ]h"]h$]h&]uh1jhhubeh}(h]h ]h"]h$]h&]uh1hhhhKhhubh)}(hXSO_TIMESTAMPNS Same timestamping mechanism as SO_TIMESTAMP, but reports the timestamp as struct timespec in nsec resolution. SO_TIMESTAMPNS is defined as SO_TIMESTAMPNS_NEW or SO_TIMESTAMPNS_OLD based on the architecture type and time_t representation of libc. Control message format is in struct timespec for SO_TIMESTAMPNS_OLD and in struct __kernel_timespec for SO_TIMESTAMPNS_NEW options respectively. h](h)}(hSO_TIMESTAMPNSh]hSO_TIMESTAMPNS}(hj(hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhj$ubj)}(hhh]h)}(hXSame timestamping mechanism as SO_TIMESTAMP, but reports the timestamp as struct timespec in nsec resolution. SO_TIMESTAMPNS is defined as SO_TIMESTAMPNS_NEW or SO_TIMESTAMPNS_OLD based on the architecture type and time_t representation of libc. Control message format is in struct timespec for SO_TIMESTAMPNS_OLD and in struct __kernel_timespec for SO_TIMESTAMPNS_NEW options respectively.h]hXSame timestamping mechanism as SO_TIMESTAMP, but reports the timestamp as struct timespec in nsec resolution. SO_TIMESTAMPNS is defined as SO_TIMESTAMPNS_NEW or SO_TIMESTAMPNS_OLD based on the architecture type and time_t representation of libc. Control message format is in struct timespec for SO_TIMESTAMPNS_OLD and in struct __kernel_timespec for SO_TIMESTAMPNS_NEW options respectively.}(hj9hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhj6ubah}(h]h ]h"]h$]h&]uh1jhj$ubeh}(h]h ]h"]h$]h&]uh1hhhhKhhhhubh)}(hIP_MULTICAST_LOOP + SO_TIMESTAMP[NS] Only for multicast:approximate transmit timestamp obtained by reading the looped packet receive timestamp. h](h)}(h$IP_MULTICAST_LOOP + SO_TIMESTAMP[NS]h]h$IP_MULTICAST_LOOP + SO_TIMESTAMP[NS]}(hjWhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhK"hjSubj)}(hhh]h)}(hjOnly for multicast:approximate transmit timestamp obtained by reading the looped packet receive timestamp.h]hjOnly for multicast:approximate transmit timestamp obtained by reading the looped packet receive timestamp.}(hjhhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhK!hjeubah}(h]h ]h"]h$]h&]uh1jhjSubeh}(h]h ]h"]h$]h&]uh1hhhhK"hhhhubh)}(hSO_TIMESTAMPING Generates timestamps on reception, transmission or both. Supports multiple timestamp sources, including hardware. Supports generating timestamps for stream sockets. h](h)}(hSO_TIMESTAMPINGh]hSO_TIMESTAMPING}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhK(hjubj)}(hhh]h)}(hGenerates timestamps on reception, transmission or both. Supports multiple timestamp sources, including hardware. Supports generating timestamps for stream sockets.h]hGenerates timestamps on reception, transmission or both. Supports multiple timestamp sources, including hardware. Supports generating timestamps for stream sockets.}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhK%hjubah}(h]h ]h"]h$]h&]uh1jhjubeh}(h]h ]h"]h$]h&]uh1hhhhK(hhhhubeh}(h]h ]h"]h$]h&]uh1hhhhhhhhNubh)}(hhh](h)}(h=1.1 SO_TIMESTAMP (also SO_TIMESTAMP_OLD and SO_TIMESTAMP_NEW)h]h=1.1 SO_TIMESTAMP (also SO_TIMESTAMP_OLD and SO_TIMESTAMP_NEW)}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhjhhhhhK+ubh)}(hXThis socket option enables timestamping of datagrams on the reception path. Because the destination socket, if any, is not known early in the network stack, the feature has to be enabled for all packets. The same is true for all early receive timestamp options.h]hXThis socket option enables timestamping of datagrams on the reception path. Because the destination socket, if any, is not known early in the network stack, the feature has to be enabled for all packets. The same is true for all early receive timestamp options.}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhK-hjhhubh)}(h*For interface details, see `man 7 socket`.h](hFor interface details, see }(hjhhhNhNubhtitle_reference)}(h`man 7 socket`h]h man 7 socket}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1jhjubh.}(hjhhhNhNubeh}(h]h ]h"]h$]h&]uh1hhhhK2hjhhubh)}(heAlways use SO_TIMESTAMP_NEW timestamp to always get timestamp in struct __kernel_sock_timeval format.h]heAlways use SO_TIMESTAMP_NEW timestamp to always get timestamp in struct __kernel_sock_timeval format.}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhK4hjhhubh)}(hUSO_TIMESTAMP_OLD returns incorrect timestamps after the year 2038 on 32 bit machines.h]hUSO_TIMESTAMP_OLD returns incorrect timestamps after the year 2038 on 32 bit machines.}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhK7hjhhubeh}(h]7so-timestamp-also-so-timestamp-old-and-so-timestamp-newah ]h"]=1.1 so_timestamp (also so_timestamp_old and so_timestamp_new)ah$]h&]uh1hhhhhhhhK+ubh)}(hhh](h)}(hC1.2 SO_TIMESTAMPNS (also SO_TIMESTAMPNS_OLD and SO_TIMESTAMPNS_NEW)h]hC1.2 SO_TIMESTAMPNS (also SO_TIMESTAMPNS_OLD and SO_TIMESTAMPNS_NEW)}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhjhhhhhK;ubh)}(hThis option is identical to SO_TIMESTAMP except for the returned data type. Its struct timespec allows for higher resolution (ns) timestamps than the timeval of SO_TIMESTAMP (ms).h]hThis option is identical to SO_TIMESTAMP except for the returned data type. Its struct timespec allows for higher resolution (ns) timestamps than the timeval of SO_TIMESTAMP (ms).}(hj-hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhK=hjhhubh)}(hcAlways use SO_TIMESTAMPNS_NEW timestamp to always get timestamp in struct __kernel_timespec format.h]hcAlways use SO_TIMESTAMPNS_NEW timestamp to always get timestamp in struct __kernel_timespec format.}(hj;hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKAhjhhubh)}(hWSO_TIMESTAMPNS_OLD returns incorrect timestamps after the year 2038 on 32 bit machines.h]hWSO_TIMESTAMPNS_OLD returns incorrect timestamps after the year 2038 on 32 bit machines.}(hjIhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKDhjhhubeh}(h]=so-timestampns-also-so-timestampns-old-and-so-timestampns-newah ]h"]C1.2 so_timestampns (also so_timestampns_old and so_timestampns_new)ah$]h&]uh1hhhhhhhhK;ubh)}(hhh](h)}(hF1.3 SO_TIMESTAMPING (also SO_TIMESTAMPING_OLD and SO_TIMESTAMPING_NEW)h]hF1.3 SO_TIMESTAMPING (also SO_TIMESTAMPING_OLD and SO_TIMESTAMPING_NEW)}(hjbhhhNhNubah}(h]h ]h"]h$]h&]uh1hhj_hhhhhKHubh)}(h{Supports multiple types of timestamp requests. As a result, this socket option takes a bitmap of flags, not a boolean. In::h]hzSupports multiple types of timestamp requests. As a result, this socket option takes a bitmap of flags, not a boolean. In:}(hjphhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKJhj_hhubh literal_block)}(hEerr = setsockopt(fd, SOL_SOCKET, SO_TIMESTAMPING, &val, sizeof(val));h]hEerr = setsockopt(fd, SOL_SOCKET, SO_TIMESTAMPING, &val, sizeof(val));}hjsbah}(h]h ]h"]h$]h&]hhuh1j~hhhKMhj_hhubh)}(h}val is an integer with any of the following bits set. Setting other bit returns EINVAL and does not change the current state.h]h}val is an integer with any of the following bits set. Setting other bit returns EINVAL and does not change the current state.}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKOhj_hhubh)}(hThe socket option configures timestamp generation for individual sk_buffs (1.3.1), timestamp reporting to the socket's error queue (1.3.2) and options (1.3.3). Timestamp generation can also be enabled for individual sendmsg calls using cmsg (1.3.4).h]hThe socket option configures timestamp generation for individual sk_buffs (1.3.1), timestamp reporting to the socket’s error queue (1.3.2) and options (1.3.3). Timestamp generation can also be enabled for individual sendmsg calls using cmsg (1.3.4).}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKRhj_hhubh)}(hhh](h)}(h1.3.1 Timestamp Generationh]h1.3.1 Timestamp Generation}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhjhhhhhKYubh)}(hXMSome bits are requests to the stack to try to generate timestamps. Any combination of them is valid. Changes to these bits apply to newly created packets, not to packets already in the stack. As a result, it is possible to selectively request timestamps for a subset of packets (e.g., for sampling) by embedding an send() call within two setsockopt calls, one to enable timestamp generation and one to disable it. Timestamps may also be generated for reasons other than being requested by a particular socket, such as when receive timestamping is enabled system wide, as explained earlier.h]hXMSome bits are requests to the stack to try to generate timestamps. Any combination of them is valid. Changes to these bits apply to newly created packets, not to packets already in the stack. As a result, it is possible to selectively request timestamps for a subset of packets (e.g., for sampling) by embedding an send() call within two setsockopt calls, one to enable timestamp generation and one to disable it. Timestamps may also be generated for reasons other than being requested by a particular socket, such as when receive timestamping is enabled system wide, as explained earlier.}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhK[hjhhubh)}(hhh](h)}(hVSOF_TIMESTAMPING_RX_HARDWARE: Request rx timestamps generated by the network adapter. h](h)}(hSOF_TIMESTAMPING_RX_HARDWARE:h]hSOF_TIMESTAMPING_RX_HARDWARE:}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKfhjubj)}(hhh]h)}(h7Request rx timestamps generated by the network adapter.h]h7Request rx timestamps generated by the network adapter.}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKfhjubah}(h]h ]h"]h$]h&]uh1jhjubeh}(h]h ]h"]h$]h&]uh1hhhhKfhjubh)}(hSOF_TIMESTAMPING_RX_SOFTWARE: Request rx timestamps when data enters the kernel. These timestamps are generated just after a device driver hands a packet to the kernel receive stack. h](h)}(hSOF_TIMESTAMPING_RX_SOFTWARE:h]hSOF_TIMESTAMPING_RX_SOFTWARE:}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKkhjubj)}(hhh]h)}(hRequest rx timestamps when data enters the kernel. These timestamps are generated just after a device driver hands a packet to the kernel receive stack.h]hRequest rx timestamps when data enters the kernel. These timestamps are generated just after a device driver hands a packet to the kernel receive stack.}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKihj ubah}(h]h ]h"]h$]h&]uh1jhjubeh}(h]h ]h"]h$]h&]uh1hhhhKkhjhhubh)}(hSOF_TIMESTAMPING_TX_HARDWARE: Request tx timestamps generated by the network adapter. This flag can be enabled via both socket options and control messages. h](h)}(hSOF_TIMESTAMPING_TX_HARDWARE:h]hSOF_TIMESTAMPING_TX_HARDWARE:}(hj.hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKohj*ubj)}(hhh]h)}(h~Request tx timestamps generated by the network adapter. This flag can be enabled via both socket options and control messages.h]h~Request tx timestamps generated by the network adapter. This flag can be enabled via both socket options and control messages.}(hj?hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKnhj<ubah}(h]h ]h"]h$]h&]uh1jhj*ubeh}(h]h ]h"]h$]h&]uh1hhhhKohjhhubh)}(hXqSOF_TIMESTAMPING_TX_SOFTWARE: Request tx timestamps when data leaves the kernel. These timestamps are generated in the device driver as close as possible, but always prior to, passing the packet to the network interface. Hence, they require driver support and may not be available for all devices. This flag can be enabled via both socket options and control messages. h](h)}(hSOF_TIMESTAMPING_TX_SOFTWARE:h]hSOF_TIMESTAMPING_TX_SOFTWARE:}(hj]hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKvhjYubj)}(hhh]h)}(hXRRequest tx timestamps when data leaves the kernel. These timestamps are generated in the device driver as close as possible, but always prior to, passing the packet to the network interface. Hence, they require driver support and may not be available for all devices. This flag can be enabled via both socket options and control messages.h]hXRRequest tx timestamps when data leaves the kernel. These timestamps are generated in the device driver as close as possible, but always prior to, passing the packet to the network interface. Hence, they require driver support and may not be available for all devices. This flag can be enabled via both socket options and control messages.}(hjnhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKrhjkubah}(h]h ]h"]h$]h&]uh1jhjYubeh}(h]h ]h"]h$]h&]uh1hhhhKvhjhhubh)}(hXSOF_TIMESTAMPING_TX_SCHED: Request tx timestamps prior to entering the packet scheduler. Kernel transmit latency is, if long, often dominated by queuing delay. The difference between this timestamp and one taken at SOF_TIMESTAMPING_TX_SOFTWARE will expose this latency independent of protocol processing. The latency incurred in protocol processing, if any, can be computed by subtracting a userspace timestamp taken immediately before send() from this timestamp. On machines with virtual devices where a transmitted packet travels through multiple devices and, hence, multiple packet schedulers, a timestamp is generated at each layer. This allows for fine grained measurement of queuing delay. This flag can be enabled via both socket options and control messages. h](h)}(hSOF_TIMESTAMPING_TX_SCHED:h]hSOF_TIMESTAMPING_TX_SCHED:}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjubj)}(hhh]h)}(hXRequest tx timestamps prior to entering the packet scheduler. Kernel transmit latency is, if long, often dominated by queuing delay. The difference between this timestamp and one taken at SOF_TIMESTAMPING_TX_SOFTWARE will expose this latency independent of protocol processing. The latency incurred in protocol processing, if any, can be computed by subtracting a userspace timestamp taken immediately before send() from this timestamp. On machines with virtual devices where a transmitted packet travels through multiple devices and, hence, multiple packet schedulers, a timestamp is generated at each layer. This allows for fine grained measurement of queuing delay. This flag can be enabled via both socket options and control messages.h]hXRequest tx timestamps prior to entering the packet scheduler. Kernel transmit latency is, if long, often dominated by queuing delay. The difference between this timestamp and one taken at SOF_TIMESTAMPING_TX_SOFTWARE will expose this latency independent of protocol processing. The latency incurred in protocol processing, if any, can be computed by subtracting a userspace timestamp taken immediately before send() from this timestamp. On machines with virtual devices where a transmitted packet travels through multiple devices and, hence, multiple packet schedulers, a timestamp is generated at each layer. This allows for fine grained measurement of queuing delay. This flag can be enabled via both socket options and control messages.}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKyhjubah}(h]h ]h"]h$]h&]uh1jhjubeh}(h]h ]h"]h$]h&]uh1hhhhKhjhhubh)}(hXSOF_TIMESTAMPING_TX_ACK: Request tx timestamps when all data in the send buffer has been acknowledged. This only makes sense for reliable protocols. It is currently only implemented for TCP. For that protocol, it may over-report measurement, because the timestamp is generated when all data up to and including the buffer at send() was acknowledged: the cumulative acknowledgment. The mechanism ignores SACK and FACK. This flag can be enabled via both socket options and control messages. h](h)}(hSOF_TIMESTAMPING_TX_ACK:h]hSOF_TIMESTAMPING_TX_ACK:}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjubj)}(hhh]h)}(hXRequest tx timestamps when all data in the send buffer has been acknowledged. This only makes sense for reliable protocols. It is currently only implemented for TCP. For that protocol, it may over-report measurement, because the timestamp is generated when all data up to and including the buffer at send() was acknowledged: the cumulative acknowledgment. The mechanism ignores SACK and FACK. This flag can be enabled via both socket options and control messages.h]hXRequest tx timestamps when all data in the send buffer has been acknowledged. This only makes sense for reliable protocols. It is currently only implemented for TCP. For that protocol, it may over-report measurement, because the timestamp is generated when all data up to and including the buffer at send() was acknowledged: the cumulative acknowledgment. The mechanism ignores SACK and FACK. This flag can be enabled via both socket options and control messages.}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjubah}(h]h ]h"]h$]h&]uh1jhjubeh}(h]h ]h"]h$]h&]uh1hhhhKhjhhubh)}(hXSOF_TIMESTAMPING_TX_COMPLETION: Request tx timestamps on packet tx completion. The completion timestamp is generated by the kernel when it receives packet a completion report from the hardware. Hardware may report multiple packets at once, and completion timestamps reflect the timing of the report and not actual tx time. This flag can be enabled via both socket options and control messages. h](h)}(hSOF_TIMESTAMPING_TX_COMPLETION:h]hSOF_TIMESTAMPING_TX_COMPLETION:}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjubj)}(hhh]h)}(hXjRequest tx timestamps on packet tx completion. The completion timestamp is generated by the kernel when it receives packet a completion report from the hardware. Hardware may report multiple packets at once, and completion timestamps reflect the timing of the report and not actual tx time. This flag can be enabled via both socket options and control messages.h]hXjRequest tx timestamps on packet tx completion. The completion timestamp is generated by the kernel when it receives packet a completion report from the hardware. Hardware may report multiple packets at once, and completion timestamps reflect the timing of the report and not actual tx time. This flag can be enabled via both socket options and control messages.}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjubah}(h]h ]h"]h$]h&]uh1jhjubeh}(h]h ]h"]h$]h&]uh1hhhhKhjhhubeh}(h]h ]h"]h$]h&]uh1hhjhhhhhNubeh}(h]timestamp-generationah ]h"]1.3.1 timestamp generationah$]h&]uh1hhj_hhhhhKYubh)}(hhh](h)}(h1.3.2 Timestamp Reportingh]h1.3.2 Timestamp Reporting}(hj&hhhNhNubah}(h]h ]h"]h$]h&]uh1hhj#hhhhhKubh)}(hX"The other three bits control which timestamps will be reported in a generated control message. Changes to the bits take immediate effect at the timestamp reporting locations in the stack. Timestamps are only reported for packets that also have the relevant timestamp generation request set.h]hX"The other three bits control which timestamps will be reported in a generated control message. Changes to the bits take immediate effect at the timestamp reporting locations in the stack. Timestamps are only reported for packets that also have the relevant timestamp generation request set.}(hj4hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhj#hhubh)}(hhh](h)}(hJSOF_TIMESTAMPING_SOFTWARE: Report any software timestamps when available. h](h)}(hSOF_TIMESTAMPING_SOFTWARE:h]hSOF_TIMESTAMPING_SOFTWARE:}(hjIhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjEubj)}(hhh]h)}(h.Report any software timestamps when available.h]h.Report any software timestamps when available.}(hjZhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjWubah}(h]h ]h"]h$]h&]uh1jhjEubeh}(h]h ]h"]h$]h&]uh1hhhhKhjBubh)}(hFSOF_TIMESTAMPING_SYS_HARDWARE: This option is deprecated and ignored. h](h)}(hSOF_TIMESTAMPING_SYS_HARDWARE:h]hSOF_TIMESTAMPING_SYS_HARDWARE:}(hjxhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjtubj)}(hhh]h)}(h&This option is deprecated and ignored.h]h&This option is deprecated and ignored.}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjubah}(h]h ]h"]h$]h&]uh1jhjtubeh}(h]h ]h"]h$]h&]uh1hhhhKhjBhhubh)}(hSOF_TIMESTAMPING_RAW_HARDWARE: Report hardware timestamps as generated by SOF_TIMESTAMPING_TX_HARDWARE or SOF_TIMESTAMPING_RX_HARDWARE when available. h](h)}(hSOF_TIMESTAMPING_RAW_HARDWARE:h]hSOF_TIMESTAMPING_RAW_HARDWARE:}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjubj)}(hhh]h)}(hwReport hardware timestamps as generated by SOF_TIMESTAMPING_TX_HARDWARE or SOF_TIMESTAMPING_RX_HARDWARE when available.h]hwReport hardware timestamps as generated by SOF_TIMESTAMPING_TX_HARDWARE or SOF_TIMESTAMPING_RX_HARDWARE when available.}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjubah}(h]h ]h"]h$]h&]uh1jhjubeh}(h]h ]h"]h$]h&]uh1hhhhKhjBhhubeh}(h]h ]h"]h$]h&]uh1hhj#hhhhhNubeh}(h]timestamp-reportingah ]h"]1.3.2 timestamp reportingah$]h&]uh1hhj_hhhhhKubh)}(hhh](h)}(h1.3.3 Timestamp Optionsh]h1.3.3 Timestamp Options}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhjhhhhhKubh)}(h"The interface supports the optionsh]h"The interface supports the options}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjhhubh)}(hhh](h)}(hXKSOF_TIMESTAMPING_OPT_ID: Generate a unique identifier along with each packet. A process can have multiple concurrent timestamping requests outstanding. Packets can be reordered in the transmit path, for instance in the packet scheduler. In that case timestamps will be queued onto the error queue out of order from the original send() calls. It is not always possible to uniquely match timestamps to the original send() calls based on timestamp order or payload inspection alone, then. This option associates each packet at send() with a unique identifier and returns that along with the timestamp. The identifier is derived from a per-socket u32 counter (that wraps). For datagram sockets, the counter increments with each sent packet. For stream sockets, it increments with every byte. For stream sockets, also set SOF_TIMESTAMPING_OPT_ID_TCP, see the section below. The counter starts at zero. It is initialized the first time that the socket option is enabled. It is reset each time the option is enabled after having been disabled. Resetting the counter does not change the identifiers of existing packets in the system. This option is implemented only for transmit timestamps. There, the timestamp is always looped along with a struct sock_extended_err. The option modifies field ee_data to pass an id that is unique among all possibly concurrently outstanding timestamp requests for that socket. The process can optionally override the default generated ID, by passing a specific ID with control message SCM_TS_OPT_ID (not supported for TCP sockets):: struct msghdr *msg; ... cmsg = CMSG_FIRSTHDR(msg); cmsg->cmsg_level = SOL_SOCKET; cmsg->cmsg_type = SCM_TS_OPT_ID; cmsg->cmsg_len = CMSG_LEN(sizeof(__u32)); *((__u32 *) CMSG_DATA(cmsg)) = opt_id; err = sendmsg(fd, msg, 0); h](h)}(hSOF_TIMESTAMPING_OPT_ID:h]hSOF_TIMESTAMPING_OPT_ID:}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjubj)}(hhh](h)}(hXGenerate a unique identifier along with each packet. A process can have multiple concurrent timestamping requests outstanding. Packets can be reordered in the transmit path, for instance in the packet scheduler. In that case timestamps will be queued onto the error queue out of order from the original send() calls. It is not always possible to uniquely match timestamps to the original send() calls based on timestamp order or payload inspection alone, then.h]hXGenerate a unique identifier along with each packet. A process can have multiple concurrent timestamping requests outstanding. Packets can be reordered in the transmit path, for instance in the packet scheduler. In that case timestamps will be queued onto the error queue out of order from the original send() calls. It is not always possible to uniquely match timestamps to the original send() calls based on timestamp order or payload inspection alone, then.}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjubh)}(hX~This option associates each packet at send() with a unique identifier and returns that along with the timestamp. The identifier is derived from a per-socket u32 counter (that wraps). For datagram sockets, the counter increments with each sent packet. For stream sockets, it increments with every byte. For stream sockets, also set SOF_TIMESTAMPING_OPT_ID_TCP, see the section below.h]hX~This option associates each packet at send() with a unique identifier and returns that along with the timestamp. The identifier is derived from a per-socket u32 counter (that wraps). For datagram sockets, the counter increments with each sent packet. For stream sockets, it increments with every byte. For stream sockets, also set SOF_TIMESTAMPING_OPT_ID_TCP, see the section below.}(hj%hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjubh)}(hXThe counter starts at zero. It is initialized the first time that the socket option is enabled. It is reset each time the option is enabled after having been disabled. Resetting the counter does not change the identifiers of existing packets in the system.h]hXThe counter starts at zero. It is initialized the first time that the socket option is enabled. It is reset each time the option is enabled after having been disabled. Resetting the counter does not change the identifiers of existing packets in the system.}(hj3hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjubh)}(hXThis option is implemented only for transmit timestamps. There, the timestamp is always looped along with a struct sock_extended_err. The option modifies field ee_data to pass an id that is unique among all possibly concurrently outstanding timestamp requests for that socket.h]hXThis option is implemented only for transmit timestamps. There, the timestamp is always looped along with a struct sock_extended_err. The option modifies field ee_data to pass an id that is unique among all possibly concurrently outstanding timestamp requests for that socket.}(hjAhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjubh)}(hThe process can optionally override the default generated ID, by passing a specific ID with control message SCM_TS_OPT_ID (not supported for TCP sockets)::h]hThe process can optionally override the default generated ID, by passing a specific ID with control message SCM_TS_OPT_ID (not supported for TCP sockets):}(hjOhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjubj)}(hXstruct msghdr *msg; ... cmsg = CMSG_FIRSTHDR(msg); cmsg->cmsg_level = SOL_SOCKET; cmsg->cmsg_type = SCM_TS_OPT_ID; cmsg->cmsg_len = CMSG_LEN(sizeof(__u32)); *((__u32 *) CMSG_DATA(cmsg)) = opt_id; err = sendmsg(fd, msg, 0);h]hXstruct msghdr *msg; ... cmsg = CMSG_FIRSTHDR(msg); cmsg->cmsg_level = SOL_SOCKET; cmsg->cmsg_type = SCM_TS_OPT_ID; cmsg->cmsg_len = CMSG_LEN(sizeof(__u32)); *((__u32 *) CMSG_DATA(cmsg)) = opt_id; err = sendmsg(fd, msg, 0);}hj]sbah}(h]h ]h"]h$]h&]hhuh1j~hhhKhjubeh}(h]h ]h"]h$]h&]uh1jhjubeh}(h]h ]h"]h$]h&]uh1hhhhKhjubh)}(hXSOF_TIMESTAMPING_OPT_ID_TCP: Pass this modifier along with SOF_TIMESTAMPING_OPT_ID for new TCP timestamping applications. SOF_TIMESTAMPING_OPT_ID defines how the counter increments for stream sockets, but its starting point is not entirely trivial. This option fixes that. For stream sockets, if SOF_TIMESTAMPING_OPT_ID is set, this should always be set too. On datagram sockets the option has no effect. A reasonable expectation is that the counter is reset to zero with the system call, so that a subsequent write() of N bytes generates a timestamp with counter N-1. SOF_TIMESTAMPING_OPT_ID_TCP implements this behavior under all conditions. SOF_TIMESTAMPING_OPT_ID without modifier often reports the same, especially when the socket option is set when no data is in transmission. If data is being transmitted, it may be off by the length of the output queue (SIOCOUTQ). The difference is due to being based on snd_una versus write_seq. snd_una is the offset in the stream acknowledged by the peer. This depends on factors outside of process control, such as network RTT. write_seq is the last byte written by the process. This offset is not affected by external inputs. The difference is subtle and unlikely to be noticed when configured at initial socket creation, when no data is queued or sent. But SOF_TIMESTAMPING_OPT_ID_TCP behavior is more robust regardless of when the socket option is set. h](h)}(hSOF_TIMESTAMPING_OPT_ID_TCP:h]hSOF_TIMESTAMPING_OPT_ID_TCP:}(hj{hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjwubj)}(hhh](h)}(hPass this modifier along with SOF_TIMESTAMPING_OPT_ID for new TCP timestamping applications. SOF_TIMESTAMPING_OPT_ID defines how the counter increments for stream sockets, but its starting point is not entirely trivial. This option fixes that.h]hPass this modifier along with SOF_TIMESTAMPING_OPT_ID for new TCP timestamping applications. SOF_TIMESTAMPING_OPT_ID defines how the counter increments for stream sockets, but its starting point is not entirely trivial. This option fixes that.}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjubh)}(hFor stream sockets, if SOF_TIMESTAMPING_OPT_ID is set, this should always be set too. On datagram sockets the option has no effect.h]hFor stream sockets, if SOF_TIMESTAMPING_OPT_ID is set, this should always be set too. On datagram sockets the option has no effect.}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjubh)}(hA reasonable expectation is that the counter is reset to zero with the system call, so that a subsequent write() of N bytes generates a timestamp with counter N-1. SOF_TIMESTAMPING_OPT_ID_TCP implements this behavior under all conditions.h]hA reasonable expectation is that the counter is reset to zero with the system call, so that a subsequent write() of N bytes generates a timestamp with counter N-1. SOF_TIMESTAMPING_OPT_ID_TCP implements this behavior under all conditions.}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjubh)}(hSOF_TIMESTAMPING_OPT_ID without modifier often reports the same, especially when the socket option is set when no data is in transmission. If data is being transmitted, it may be off by the length of the output queue (SIOCOUTQ).h]hSOF_TIMESTAMPING_OPT_ID without modifier often reports the same, especially when the socket option is set when no data is in transmission. If data is being transmitted, it may be off by the length of the output queue (SIOCOUTQ).}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjubh)}(hX+The difference is due to being based on snd_una versus write_seq. snd_una is the offset in the stream acknowledged by the peer. This depends on factors outside of process control, such as network RTT. write_seq is the last byte written by the process. This offset is not affected by external inputs.h]hX+The difference is due to being based on snd_una versus write_seq. snd_una is the offset in the stream acknowledged by the peer. This depends on factors outside of process control, such as network RTT. write_seq is the last byte written by the process. This offset is not affected by external inputs.}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjubh)}(hThe difference is subtle and unlikely to be noticed when configured at initial socket creation, when no data is queued or sent. But SOF_TIMESTAMPING_OPT_ID_TCP behavior is more robust regardless of when the socket option is set.h]hThe difference is subtle and unlikely to be noticed when configured at initial socket creation, when no data is queued or sent. But SOF_TIMESTAMPING_OPT_ID_TCP behavior is more robust regardless of when the socket option is set.}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjubeh}(h]h ]h"]h$]h&]uh1jhjwubeh}(h]h ]h"]h$]h&]uh1hhhhKhjhhubh)}(hXSOF_TIMESTAMPING_OPT_CMSG: Support recv() cmsg for all timestamped packets. Control messages are already supported unconditionally on all packets with receive timestamps and on IPv6 packets with transmit timestamp. This option extends them to IPv4 packets with transmit timestamp. One use case is to correlate packets with their egress device, by enabling socket option IP_PKTINFO simultaneously. h](h)}(hSOF_TIMESTAMPING_OPT_CMSG:h]hSOF_TIMESTAMPING_OPT_CMSG:}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhjubj)}(hhh]h)}(hXqSupport recv() cmsg for all timestamped packets. Control messages are already supported unconditionally on all packets with receive timestamps and on IPv6 packets with transmit timestamp. This option extends them to IPv4 packets with transmit timestamp. One use case is to correlate packets with their egress device, by enabling socket option IP_PKTINFO simultaneously.h]hXqSupport recv() cmsg for all timestamped packets. Control messages are already supported unconditionally on all packets with receive timestamps and on IPv6 packets with transmit timestamp. This option extends them to IPv4 packets with transmit timestamp. One use case is to correlate packets with their egress device, by enabling socket option IP_PKTINFO simultaneously.}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjubah}(h]h ]h"]h$]h&]uh1jhjubeh}(h]h ]h"]h$]h&]uh1hhhhMhjhhubh)}(hXSOF_TIMESTAMPING_OPT_TSONLY: Applies to transmit timestamps only. Makes the kernel return the timestamp as a cmsg alongside an empty packet, as opposed to alongside the original packet. This reduces the amount of memory charged to the socket's receive budget (SO_RCVBUF) and delivers the timestamp even if sysctl net.core.tstamp_allow_data is 0. This option disables SOF_TIMESTAMPING_OPT_CMSG. h](h)}(hSOF_TIMESTAMPING_OPT_TSONLY:h]hSOF_TIMESTAMPING_OPT_TSONLY:}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhjubj)}(hhh]h)}(hXlApplies to transmit timestamps only. Makes the kernel return the timestamp as a cmsg alongside an empty packet, as opposed to alongside the original packet. This reduces the amount of memory charged to the socket's receive budget (SO_RCVBUF) and delivers the timestamp even if sysctl net.core.tstamp_allow_data is 0. This option disables SOF_TIMESTAMPING_OPT_CMSG.h]hXnApplies to transmit timestamps only. Makes the kernel return the timestamp as a cmsg alongside an empty packet, as opposed to alongside the original packet. This reduces the amount of memory charged to the socket’s receive budget (SO_RCVBUF) and delivers the timestamp even if sysctl net.core.tstamp_allow_data is 0. This option disables SOF_TIMESTAMPING_OPT_CMSG.}(hj0hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhj-ubah}(h]h ]h"]h$]h&]uh1jhjubeh}(h]h ]h"]h$]h&]uh1hhhhMhjhhubh)}(hXSOF_TIMESTAMPING_OPT_STATS: Optional stats that are obtained along with the transmit timestamps. It must be used together with SOF_TIMESTAMPING_OPT_TSONLY. When the transmit timestamp is available, the stats are available in a separate control message of type SCM_TIMESTAMPING_OPT_STATS, as a list of TLVs (struct nlattr) of types. These stats allow the application to associate various transport layer stats with the transmit timestamps, such as how long a certain block of data was limited by peer's receiver window. h](h)}(hSOF_TIMESTAMPING_OPT_STATS:h]hSOF_TIMESTAMPING_OPT_STATS:}(hjNhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhjJubj)}(hhh]h)}(hXOptional stats that are obtained along with the transmit timestamps. It must be used together with SOF_TIMESTAMPING_OPT_TSONLY. When the transmit timestamp is available, the stats are available in a separate control message of type SCM_TIMESTAMPING_OPT_STATS, as a list of TLVs (struct nlattr) of types. These stats allow the application to associate various transport layer stats with the transmit timestamps, such as how long a certain block of data was limited by peer's receiver window.h]hXOptional stats that are obtained along with the transmit timestamps. It must be used together with SOF_TIMESTAMPING_OPT_TSONLY. When the transmit timestamp is available, the stats are available in a separate control message of type SCM_TIMESTAMPING_OPT_STATS, as a list of TLVs (struct nlattr) of types. These stats allow the application to associate various transport layer stats with the transmit timestamps, such as how long a certain block of data was limited by peer’s receiver window.}(hj_hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhM hj\ubah}(h]h ]h"]h$]h&]uh1jhjJubeh}(h]h ]h"]h$]h&]uh1hhhhMhjhhubh)}(hXSOF_TIMESTAMPING_OPT_PKTINFO: Enable the SCM_TIMESTAMPING_PKTINFO control message for incoming packets with hardware timestamps. The message contains struct scm_ts_pktinfo, which supplies the index of the real interface which received the packet and its length at layer 2. A valid (non-zero) interface index will be returned only if CONFIG_NET_RX_BUSY_POLL is enabled and the driver is using NAPI. The struct contains also two other fields, but they are reserved and undefined. h](h)}(hSOF_TIMESTAMPING_OPT_PKTINFO:h]hSOF_TIMESTAMPING_OPT_PKTINFO:}(hj}hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhjyubj)}(hhh]h)}(hXEnable the SCM_TIMESTAMPING_PKTINFO control message for incoming packets with hardware timestamps. The message contains struct scm_ts_pktinfo, which supplies the index of the real interface which received the packet and its length at layer 2. A valid (non-zero) interface index will be returned only if CONFIG_NET_RX_BUSY_POLL is enabled and the driver is using NAPI. The struct contains also two other fields, but they are reserved and undefined.h]hXEnable the SCM_TIMESTAMPING_PKTINFO control message for incoming packets with hardware timestamps. The message contains struct scm_ts_pktinfo, which supplies the index of the real interface which received the packet and its length at layer 2. A valid (non-zero) interface index will be returned only if CONFIG_NET_RX_BUSY_POLL is enabled and the driver is using NAPI. The struct contains also two other fields, but they are reserved and undefined.}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhjubah}(h]h ]h"]h$]h&]uh1jhjyubeh}(h]h ]h"]h$]h&]uh1hhhhMhjhhubh)}(hXJSOF_TIMESTAMPING_OPT_TX_SWHW: Request both hardware and software timestamps for outgoing packets when SOF_TIMESTAMPING_TX_HARDWARE and SOF_TIMESTAMPING_TX_SOFTWARE are enabled at the same time. If both timestamps are generated, two separate messages will be looped to the socket's error queue, each containing just one timestamp. h](h)}(hSOF_TIMESTAMPING_OPT_TX_SWHW:h]hSOF_TIMESTAMPING_OPT_TX_SWHW:}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhM"hjubj)}(hhh]h)}(hX+Request both hardware and software timestamps for outgoing packets when SOF_TIMESTAMPING_TX_HARDWARE and SOF_TIMESTAMPING_TX_SOFTWARE are enabled at the same time. If both timestamps are generated, two separate messages will be looped to the socket's error queue, each containing just one timestamp.h]hX-Request both hardware and software timestamps for outgoing packets when SOF_TIMESTAMPING_TX_HARDWARE and SOF_TIMESTAMPING_TX_SOFTWARE are enabled at the same time. If both timestamps are generated, two separate messages will be looped to the socket’s error queue, each containing just one timestamp.}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhjubah}(h]h ]h"]h$]h&]uh1jhjubeh}(h]h ]h"]h$]h&]uh1hhhhM"hjhhubh)}(hX.SOF_TIMESTAMPING_OPT_RX_FILTER: Filter out spurious receive timestamps: report a receive timestamp only if the matching timestamp generation flag is enabled. Receive timestamps are generated early in the ingress path, before a packet's destination socket is known. If any socket enables receive timestamps, packets for all socket will receive timestamped packets. Including those that request timestamp reporting with SOF_TIMESTAMPING_SOFTWARE and/or SOF_TIMESTAMPING_RAW_HARDWARE, but do not request receive timestamp generation. This can happen when requesting transmit timestamps only. Receiving spurious timestamps is generally benign. A process can ignore the unexpected non-zero value. But it makes behavior subtly dependent on other sockets. This flag isolates the socket for more deterministic behavior. h](h)}(hSOF_TIMESTAMPING_OPT_RX_FILTER:h]hSOF_TIMESTAMPING_OPT_RX_FILTER:}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhM3hjubj)}(hhh](h)}(h}Filter out spurious receive timestamps: report a receive timestamp only if the matching timestamp generation flag is enabled.h]h}Filter out spurious receive timestamps: report a receive timestamp only if the matching timestamp generation flag is enabled.}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhM%hjubh)}(hXReceive timestamps are generated early in the ingress path, before a packet's destination socket is known. If any socket enables receive timestamps, packets for all socket will receive timestamped packets. Including those that request timestamp reporting with SOF_TIMESTAMPING_SOFTWARE and/or SOF_TIMESTAMPING_RAW_HARDWARE, but do not request receive timestamp generation. This can happen when requesting transmit timestamps only.h]hXReceive timestamps are generated early in the ingress path, before a packet’s destination socket is known. If any socket enables receive timestamps, packets for all socket will receive timestamped packets. Including those that request timestamp reporting with SOF_TIMESTAMPING_SOFTWARE and/or SOF_TIMESTAMPING_RAW_HARDWARE, but do not request receive timestamp generation. This can happen when requesting transmit timestamps only.}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhM(hjubh)}(hReceiving spurious timestamps is generally benign. A process can ignore the unexpected non-zero value. But it makes behavior subtly dependent on other sockets. This flag isolates the socket for more deterministic behavior.h]hReceiving spurious timestamps is generally benign. A process can ignore the unexpected non-zero value. But it makes behavior subtly dependent on other sockets. This flag isolates the socket for more deterministic behavior.}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhM0hjubeh}(h]h ]h"]h$]h&]uh1jhjubeh}(h]h ]h"]h$]h&]uh1hhhhM3hjhhubeh}(h]h ]h"]h$]h&]uh1hhjhhhhhNubh)}(hNew applications are encouraged to pass SOF_TIMESTAMPING_OPT_ID to disambiguate timestamps and SOF_TIMESTAMPING_OPT_TSONLY to operate regardless of the setting of sysctl net.core.tstamp_allow_data.h]hNew applications are encouraged to pass SOF_TIMESTAMPING_OPT_ID to disambiguate timestamps and SOF_TIMESTAMPING_OPT_TSONLY to operate regardless of the setting of sysctl net.core.tstamp_allow_data.}(hj(hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhM5hjhhubh)}(hX2An exception is when a process needs additional cmsg data, for instance SOL_IP/IP_PKTINFO to detect the egress network interface. Then pass option SOF_TIMESTAMPING_OPT_CMSG. This option depends on having access to the contents of the original packet, so cannot be combined with SOF_TIMESTAMPING_OPT_TSONLY.h]hX2An exception is when a process needs additional cmsg data, for instance SOL_IP/IP_PKTINFO to detect the egress network interface. Then pass option SOF_TIMESTAMPING_OPT_CMSG. This option depends on having access to the contents of the original packet, so cannot be combined with SOF_TIMESTAMPING_OPT_TSONLY.}(hj6hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhM9hjhhubeh}(h]timestamp-optionsah ]h"]1.3.3 timestamp optionsah$]h&]uh1hhj_hhhhhKubh)}(hhh](h)}(h/1.3.4. Enabling timestamps via control messagesh]h/1.3.4. Enabling timestamps via control messages}(hjOhhhNhNubah}(h]h ]h"]h$]h&]uh1hhjLhhhhhMAubh)}(hX#In addition to socket options, timestamp generation can be requested per write via cmsg, only for SOF_TIMESTAMPING_TX_* (see Section 1.3.1). Using this feature, applications can sample timestamps per sendmsg() without paying the overhead of enabling and disabling timestamps via setsockopt::h]hX"In addition to socket options, timestamp generation can be requested per write via cmsg, only for SOF_TIMESTAMPING_TX_* (see Section 1.3.1). Using this feature, applications can sample timestamps per sendmsg() without paying the overhead of enabling and disabling timestamps via setsockopt:}(hj]hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMChjLhhubj)}(hXstruct msghdr *msg; ... cmsg = CMSG_FIRSTHDR(msg); cmsg->cmsg_level = SOL_SOCKET; cmsg->cmsg_type = SO_TIMESTAMPING; cmsg->cmsg_len = CMSG_LEN(sizeof(__u32)); *((__u32 *) CMSG_DATA(cmsg)) = SOF_TIMESTAMPING_TX_SCHED | SOF_TIMESTAMPING_TX_SOFTWARE | SOF_TIMESTAMPING_TX_ACK; err = sendmsg(fd, msg, 0);h]hXstruct msghdr *msg; ... cmsg = CMSG_FIRSTHDR(msg); cmsg->cmsg_level = SOL_SOCKET; cmsg->cmsg_type = SO_TIMESTAMPING; cmsg->cmsg_len = CMSG_LEN(sizeof(__u32)); *((__u32 *) CMSG_DATA(cmsg)) = SOF_TIMESTAMPING_TX_SCHED | SOF_TIMESTAMPING_TX_SOFTWARE | SOF_TIMESTAMPING_TX_ACK; err = sendmsg(fd, msg, 0);}hjksbah}(h]h ]h"]h$]h&]hhuh1j~hhhMIhjLhhubh)}(hnThe SOF_TIMESTAMPING_TX_* flags set via cmsg will override the SOF_TIMESTAMPING_TX_* flags set via setsockopt.h]hnThe SOF_TIMESTAMPING_TX_* flags set via cmsg will override the SOF_TIMESTAMPING_TX_* flags set via setsockopt.}(hjyhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMThjLhhubh)}(hcMoreover, applications must still enable timestamp reporting via setsockopt to receive timestamps::h]hbMoreover, applications must still enable timestamp reporting via setsockopt to receive timestamps:}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMWhjLhhubj)}(h__u32 val = SOF_TIMESTAMPING_SOFTWARE | SOF_TIMESTAMPING_OPT_ID /* or any other flag */; err = setsockopt(fd, SOL_SOCKET, SO_TIMESTAMPING, &val, sizeof(val));h]h__u32 val = SOF_TIMESTAMPING_SOFTWARE | SOF_TIMESTAMPING_OPT_ID /* or any other flag */; err = setsockopt(fd, SOL_SOCKET, SO_TIMESTAMPING, &val, sizeof(val));}hjsbah}(h]h ]h"]h$]h&]hhuh1j~hhhMZhjLhhubeh}(h](enabling-timestamps-via-control-messagesah ]h"]/1.3.4. enabling timestamps via control messagesah$]h&]uh1hhj_hhhhhMAubeh}(h]@so-timestamping-also-so-timestamping-old-and-so-timestamping-newah ]h"]F1.3 so_timestamping (also so_timestamping_old and so_timestamping_new)ah$]h&]uh1hhhhhhhhKHubh)}(hhh](h)}(h1.4 Bytestream Timestampsh]h1.4 Bytestream Timestamps}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhjhhhhhM`ubh)}(hXwThe SO_TIMESTAMPING interface supports timestamping of bytes in a bytestream. Each request is interpreted as a request for when the entire contents of the buffer has passed a timestamping point. That is, for streams option SOF_TIMESTAMPING_TX_SOFTWARE will record when all bytes have reached the device driver, regardless of how many packets the data has been converted into.h]hXwThe SO_TIMESTAMPING interface supports timestamping of bytes in a bytestream. Each request is interpreted as a request for when the entire contents of the buffer has passed a timestamping point. That is, for streams option SOF_TIMESTAMPING_TX_SOFTWARE will record when all bytes have reached the device driver, regardless of how many packets the data has been converted into.}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMbhjhhubh)}(hXIn general, bytestreams have no natural delimiters and therefore correlating a timestamp with data is non-trivial. A range of bytes may be split across segments, any segments may be merged (possibly coalescing sections of previously segmented buffers associated with independent send() calls). Segments can be reordered and the same byte range can coexist in multiple segments for protocols that implement retransmissions.h]hXIn general, bytestreams have no natural delimiters and therefore correlating a timestamp with data is non-trivial. A range of bytes may be split across segments, any segments may be merged (possibly coalescing sections of previously segmented buffers associated with independent send() calls). Segments can be reordered and the same byte range can coexist in multiple segments for protocols that implement retransmissions.}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMihjhhubh)}(hXIIt is essential that all timestamps implement the same semantics, regardless of these possible transformations, as otherwise they are incomparable. Handling "rare" corner cases differently from the simple case (a 1:1 mapping from buffer to skb) is insufficient because performance debugging often needs to focus on such outliers.h]hXMIt is essential that all timestamps implement the same semantics, regardless of these possible transformations, as otherwise they are incomparable. Handling “rare” corner cases differently from the simple case (a 1:1 mapping from buffer to skb) is insufficient because performance debugging often needs to focus on such outliers.}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMqhjhhubh)}(hXvIn practice, timestamps can be correlated with segments of a bytestream consistently, if both semantics of the timestamp and the timing of measurement are chosen correctly. This challenge is no different from deciding on a strategy for IP fragmentation. There, the definition is that only the first fragment is timestamped. For bytestreams, we chose that a timestamp is generated only when all bytes have passed a point. SOF_TIMESTAMPING_TX_ACK as defined is easy to implement and reason about. An implementation that has to take into account SACK would be more complex due to possible transmission holes and out of order arrival.h]hXvIn practice, timestamps can be correlated with segments of a bytestream consistently, if both semantics of the timestamp and the timing of measurement are chosen correctly. This challenge is no different from deciding on a strategy for IP fragmentation. There, the definition is that only the first fragment is timestamped. For bytestreams, we chose that a timestamp is generated only when all bytes have passed a point. SOF_TIMESTAMPING_TX_ACK as defined is easy to implement and reason about. An implementation that has to take into account SACK would be more complex due to possible transmission holes and out of order arrival.}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMwhjhhubh)}(hXOn the host, TCP can also break the simple 1:1 mapping from buffer to skbuff as a result of Nagle, cork, autocork, segmentation and GSO. The implementation ensures correctness in all cases by tracking the individual last byte passed to send(), even if it is no longer the last byte after an skbuff extend or merge operation. It stores the relevant sequence number in skb_shinfo(skb)->tskey. Because an skbuff has only one such field, only one timestamp can be generated.h]hXOn the host, TCP can also break the simple 1:1 mapping from buffer to skbuff as a result of Nagle, cork, autocork, segmentation and GSO. The implementation ensures correctness in all cases by tracking the individual last byte passed to send(), even if it is no longer the last byte after an skbuff extend or merge operation. It stores the relevant sequence number in skb_shinfo(skb)->tskey. Because an skbuff has only one such field, only one timestamp can be generated.}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhjhhubh)}(hXIn rare cases, a timestamp request can be missed if two requests are collapsed onto the same skb. A process can detect this situation by enabling SOF_TIMESTAMPING_OPT_ID and comparing the byte offset at send time with the value returned for each timestamp. It can prevent the situation by always flushing the TCP stack in between requests, for instance by enabling TCP_NODELAY and disabling TCP_CORK and autocork. After linux-4.7, a better way to prevent coalescing is to use MSG_EOR flag at sendmsg() time.h]hXIn rare cases, a timestamp request can be missed if two requests are collapsed onto the same skb. A process can detect this situation by enabling SOF_TIMESTAMPING_OPT_ID and comparing the byte offset at send time with the value returned for each timestamp. It can prevent the situation by always flushing the TCP stack in between requests, for instance by enabling TCP_NODELAY and disabling TCP_CORK and autocork. After linux-4.7, a better way to prevent coalescing is to use MSG_EOR flag at sendmsg() time.}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhjhhubh)}(hXThese precautions ensure that the timestamp is generated only when all bytes have passed a timestamp point, assuming that the network stack itself does not reorder the segments. The stack indeed tries to avoid reordering. The one exception is under administrator control: it is possible to construct a packet scheduler configuration that delays segments from the same stream differently. Such a setup would be unusual.h]hXThese precautions ensure that the timestamp is generated only when all bytes have passed a timestamp point, assuming that the network stack itself does not reorder the segments. The stack indeed tries to avoid reordering. The one exception is under administrator control: it is possible to construct a packet scheduler configuration that delays segments from the same stream differently. Such a setup would be unusual.}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhjhhubeh}(h]bytestream-timestampsah ]h"]1.4 bytestream timestampsah$]h&]uh1hhhhhhhhM`ubeh}(h]control-interfacesah ]h"]1. control interfacesah$]h&]uh1hhhhhhhhK ubh)}(hhh](h)}(h2 Data Interfacesh]h2 Data Interfaces}(hj9hhhNhNubah}(h]h ]h"]h$]h&]uh1hhj6hhhhhMubh)}(hTimestamps are read using the ancillary data feature of recvmsg(). See `man 3 cmsg` for details of this interface. The socket manual page (`man 7 socket`) describes how timestamps generated with SO_TIMESTAMP and SO_TIMESTAMPNS records can be retrieved.h](hGTimestamps are read using the ancillary data feature of recvmsg(). See }(hjGhhhNhNubj)}(h `man 3 cmsg`h]h man 3 cmsg}(hjOhhhNhNubah}(h]h ]h"]h$]h&]uh1jhjGubh8 for details of this interface. The socket manual page (}(hjGhhhNhNubj)}(h`man 7 socket`h]h man 7 socket}(hjahhhNhNubah}(h]h ]h"]h$]h&]uh1jhjGubhc) describes how timestamps generated with SO_TIMESTAMP and SO_TIMESTAMPNS records can be retrieved.}(hjGhhhNhNubeh}(h]h ]h"]h$]h&]uh1hhhhMhj6hhubh)}(hhh](h)}(h2.1 SCM_TIMESTAMPING recordsh]h2.1 SCM_TIMESTAMPING records}(hj|hhhNhNubah}(h]h ]h"]h$]h&]uh1hhjyhhhhhMubh)}(h~These timestamps are returned in a control message with cmsg_level SOL_SOCKET, cmsg_type SCM_TIMESTAMPING, and payload of typeh]h~These timestamps are returned in a control message with cmsg_level SOL_SOCKET, cmsg_type SCM_TIMESTAMPING, and payload of type}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhjyhhubh)}(hFor SO_TIMESTAMPING_OLD::h]hFor SO_TIMESTAMPING_OLD:}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhjyhhubj)}(h;struct scm_timestamping { struct timespec ts[3]; };h]h;struct scm_timestamping { struct timespec ts[3]; };}hjsbah}(h]h ]h"]h$]h&]hhuh1j~hhhMhjyhhubh)}(hFor SO_TIMESTAMPING_NEW::h]hFor SO_TIMESTAMPING_NEW:}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhjyhhubj)}(hCstruct scm_timestamping64 { struct __kernel_timespec ts[3];h]hCstruct scm_timestamping64 { struct __kernel_timespec ts[3];}hjsbah}(h]h ]h"]h$]h&]hhuh1j~hhhMhjyhhubh)}(heAlways use SO_TIMESTAMPING_NEW timestamp to always get timestamp in struct scm_timestamping64 format.h]heAlways use SO_TIMESTAMPING_NEW timestamp to always get timestamp in struct scm_timestamping64 format.}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhjyhhubh)}(hXSO_TIMESTAMPING_OLD returns incorrect timestamps after the year 2038 on 32 bit machines.h]hXSO_TIMESTAMPING_OLD returns incorrect timestamps after the year 2038 on 32 bit machines.}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhjyhhubh)}(hThe structure can return up to three timestamps. This is a legacy feature. At least one field is non-zero at any time. Most timestamps are passed in ts[0]. Hardware timestamps are passed in ts[2].h]hThe structure can return up to three timestamps. This is a legacy feature. At least one field is non-zero at any time. Most timestamps are passed in ts[0]. Hardware timestamps are passed in ts[2].}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhjyhhubh)}(hXOts[1] used to hold hardware timestamps converted to system time. Instead, expose the hardware clock device on the NIC directly as a HW PTP clock source, to allow time conversion in userspace and optionally synchronize system time with a userspace PTP stack such as linuxptp. For the PTP clock API, see Documentation/driver-api/ptp.rst.h]hXOts[1] used to hold hardware timestamps converted to system time. Instead, expose the hardware clock device on the NIC directly as a HW PTP clock source, to allow time conversion in userspace and optionally synchronize system time with a userspace PTP stack such as linuxptp. For the PTP clock API, see Documentation/driver-api/ptp.rst.}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhjyhhubh)}(hX5Note that if the SO_TIMESTAMP or SO_TIMESTAMPNS option is enabled together with SO_TIMESTAMPING using SOF_TIMESTAMPING_SOFTWARE, a false software timestamp will be generated in the recvmsg() call and passed in ts[0] when a real software timestamp is missing. This happens also on hardware transmit timestamps.h]hX5Note that if the SO_TIMESTAMP or SO_TIMESTAMPNS option is enabled together with SO_TIMESTAMPING using SOF_TIMESTAMPING_SOFTWARE, a false software timestamp will be generated in the recvmsg() call and passed in ts[0] when a real software timestamp is missing. This happens also on hardware transmit timestamps.}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhjyhhubh)}(hhh](h)}(h+2.1.1 Transmit timestamps with MSG_ERRQUEUEh]h+2.1.1 Transmit timestamps with MSG_ERRQUEUE}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1hhj hhhhhMubh)}(hXFor transmit timestamps the outgoing packet is looped back to the socket's error queue with the send timestamp(s) attached. A process receives the timestamps by calling recvmsg() with flag MSG_ERRQUEUE set and with a msg_control buffer sufficiently large to receive the relevant metadata structures. The recvmsg call returns the original outgoing data packet with two ancillary messages attached.h]hXFor transmit timestamps the outgoing packet is looped back to the socket’s error queue with the send timestamp(s) attached. A process receives the timestamps by calling recvmsg() with flag MSG_ERRQUEUE set and with a msg_control buffer sufficiently large to receive the relevant metadata structures. The recvmsg call returns the original outgoing data packet with two ancillary messages attached.}(hj' hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhj hhubh)}(hX*A message of cm_level SOL_IP(V6) and cm_type IP(V6)_RECVERR embeds a struct sock_extended_err. This defines the error type. For timestamps, the ee_errno field is ENOMSG. The other ancillary message will have cm_level SOL_SOCKET and cm_type SCM_TIMESTAMPING. This embeds the struct scm_timestamping.h]hX*A message of cm_level SOL_IP(V6) and cm_type IP(V6)_RECVERR embeds a struct sock_extended_err. This defines the error type. For timestamps, the ee_errno field is ENOMSG. The other ancillary message will have cm_level SOL_SOCKET and cm_type SCM_TIMESTAMPING. This embeds the struct scm_timestamping.}(hj5 hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhj hhubh)}(hhh](h)}(h2.1.1.2 Timestamp typesh]h2.1.1.2 Timestamp types}(hjF hhhNhNubah}(h]h ]h"]h$]h&]uh1hhjC hhhhhMubh)}(hThe semantics of the three struct timespec are defined by field ee_info in the extended error structure. It contains a value of type SCM_TSTAMP_* to define the actual timestamp passed in scm_timestamping.h]hThe semantics of the three struct timespec are defined by field ee_info in the extended error structure. It contains a value of type SCM_TSTAMP_* to define the actual timestamp passed in scm_timestamping.}(hjT hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhjC hhubh)}(hXpThe SCM_TSTAMP_* types are 1:1 matches to the SOF_TIMESTAMPING_* control fields discussed previously, with one exception. For legacy reasons, SCM_TSTAMP_SND is equal to zero and can be set for both SOF_TIMESTAMPING_TX_HARDWARE and SOF_TIMESTAMPING_TX_SOFTWARE. It is the first if ts[2] is non-zero, the second otherwise, in which case the timestamp is stored in ts[0].h]hXpThe SCM_TSTAMP_* types are 1:1 matches to the SOF_TIMESTAMPING_* control fields discussed previously, with one exception. For legacy reasons, SCM_TSTAMP_SND is equal to zero and can be set for both SOF_TIMESTAMPING_TX_HARDWARE and SOF_TIMESTAMPING_TX_SOFTWARE. It is the first if ts[2] is non-zero, the second otherwise, in which case the timestamp is stored in ts[0].}(hjb hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhjC hhubeh}(h]timestamp-typesah ]h"]2.1.1.2 timestamp typesah$]h&]uh1hhj hhhhhMubh)}(hhh](h)}(h2.1.1.3 Fragmentationh]h2.1.1.3 Fragmentation}(hj{ hhhNhNubah}(h]h ]h"]h$]h&]uh1hhjx hhhhhMubh)}(hFragmentation of outgoing datagrams is rare, but is possible, e.g., by explicitly disabling PMTU discovery. If an outgoing packet is fragmented, then only the first fragment is timestamped and returned to the sending socket.h]hFragmentation of outgoing datagrams is rare, but is possible, e.g., by explicitly disabling PMTU discovery. If an outgoing packet is fragmented, then only the first fragment is timestamped and returned to the sending socket.}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhjx hhubeh}(h] fragmentationah ]h"]2.1.1.3 fragmentationah$]h&]uh1hhj hhhhhMubh)}(hhh](h)}(h2.1.1.4 Packet Payloadh]h2.1.1.4 Packet Payload}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1hhj hhhhhMubh)}(hXThe calling application is often not interested in receiving the whole packet payload that it passed to the stack originally: the socket error queue mechanism is just a method to piggyback the timestamp on. In this case, the application can choose to read datagrams with a smaller buffer, possibly even of length 0. The payload is truncated accordingly. Until the process calls recvmsg() on the error queue, however, the full packet is queued, taking up budget from SO_RCVBUF.h]hXThe calling application is often not interested in receiving the whole packet payload that it passed to the stack originally: the socket error queue mechanism is just a method to piggyback the timestamp on. In this case, the application can choose to read datagrams with a smaller buffer, possibly even of length 0. The payload is truncated accordingly. Until the process calls recvmsg() on the error queue, however, the full packet is queued, taking up budget from SO_RCVBUF.}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhj hhubeh}(h]packet-payloadah ]h"]2.1.1.4 packet payloadah$]h&]uh1hhj hhhhhMubh)}(hhh](h)}(h2.1.1.5 Blocking Readh]h2.1.1.5 Blocking Read}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1hhj hhhhhMubh)}(hX8Reading from the error queue is always a non-blocking operation. To block waiting on a timestamp, use poll or select. poll() will return POLLERR in pollfd.revents if any data is ready on the error queue. There is no need to pass this flag in pollfd.events. This flag is ignored on request. See also `man 2 poll`.h](hX+Reading from the error queue is always a non-blocking operation. To block waiting on a timestamp, use poll or select. poll() will return POLLERR in pollfd.revents if any data is ready on the error queue. There is no need to pass this flag in pollfd.events. This flag is ignored on request. See also }(hj hhhNhNubj)}(h `man 2 poll`h]h man 2 poll}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1jhj ubh.}(hj hhhNhNubeh}(h]h ]h"]h$]h&]uh1hhhhMhj hhubeh}(h] blocking-readah ]h"]2.1.1.5 blocking readah$]h&]uh1hhj hhhhhMubeh}(h]%transmit-timestamps-with-msg-errqueueah ]h"]+2.1.1 transmit timestamps with msg_errqueueah$]h&]uh1hhjyhhhhhMubh)}(hhh](h)}(h2.1.2 Receive timestampsh]h2.1.2 Receive timestamps}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1hhj hhhhhM ubh)}(hXOn reception, there is no reason to read from the socket error queue. The SCM_TIMESTAMPING ancillary data is sent along with the packet data on a normal recvmsg(). Since this is not a socket error, it is not accompanied by a message SOL_IP(V6)/IP(V6)_RECVERROR. In this case, the meaning of the three fields in struct scm_timestamping is implicitly defined. ts[0] holds a software timestamp if set, ts[1] is again deprecated and ts[2] holds a hardware timestamp if set.h]hXOn reception, there is no reason to read from the socket error queue. The SCM_TIMESTAMPING ancillary data is sent along with the packet data on a normal recvmsg(). Since this is not a socket error, it is not accompanied by a message SOL_IP(V6)/IP(V6)_RECVERROR. In this case, the meaning of the three fields in struct scm_timestamping is implicitly defined. ts[0] holds a software timestamp if set, ts[1] is again deprecated and ts[2] holds a hardware timestamp if set.}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhj hhubeh}(h]receive-timestampsah ]h"]2.1.2 receive timestampsah$]h&]uh1hhjyhhhhhM ubeh}(h]scm-timestamping-recordsah ]h"]2.1 scm_timestamping recordsah$]h&]uh1hhj6hhhhhMubeh}(h]data-interfacesah ]h"]2 data interfacesah$]h&]uh1hhhhhhhhMubh)}(hhh](h)}(hD3. Hardware Timestamping configuration: ETHTOOL_MSG_TSCONFIG_SET/GETh]hD3. Hardware Timestamping configuration: ETHTOOL_MSG_TSCONFIG_SET/GET}(hjA hhhNhNubah}(h]h ]h"]h$]h&]uh1hhj> hhhhhMubh)}(hHardware time stamping must also be initialized for each device driver that is expected to do hardware time stamping. The parameter is defined in include/uapi/linux/net_tstamp.h as::h]hHardware time stamping must also be initialized for each device driver that is expected to do hardware time stamping. The parameter is defined in include/uapi/linux/net_tstamp.h as:}(hjO hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhj> hhubj)}(hstruct hwtstamp_config { int flags; /* no flags defined right now, must be zero */ int tx_type; /* HWTSTAMP_TX_* */ int rx_filter; /* HWTSTAMP_FILTER_* */ };h]hstruct hwtstamp_config { int flags; /* no flags defined right now, must be zero */ int tx_type; /* HWTSTAMP_TX_* */ int rx_filter; /* HWTSTAMP_FILTER_* */ };}hj] sbah}(h]h ]h"]h$]h&]hhuh1j~hhhMhj> hhubh)}(hXIDesired behavior is passed into the kernel and to a specific device by calling the tsconfig netlink socket ``ETHTOOL_MSG_TSCONFIG_SET``. The ``ETHTOOL_A_TSCONFIG_TX_TYPES``, ``ETHTOOL_A_TSCONFIG_RX_FILTERS`` and ``ETHTOOL_A_TSCONFIG_HWTSTAMP_FLAGS`` netlink attributes are then used to set the struct hwtstamp_config accordingly.h](hkDesired behavior is passed into the kernel and to a specific device by calling the tsconfig netlink socket }(hjk hhhNhNubhliteral)}(h``ETHTOOL_MSG_TSCONFIG_SET``h]hETHTOOL_MSG_TSCONFIG_SET}(hju hhhNhNubah}(h]h ]h"]h$]h&]uh1js hjk ubh. The }(hjk hhhNhNubjt )}(h``ETHTOOL_A_TSCONFIG_TX_TYPES``h]hETHTOOL_A_TSCONFIG_TX_TYPES}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1js hjk ubh, }(hjk hhhNhNubjt )}(h!``ETHTOOL_A_TSCONFIG_RX_FILTERS``h]hETHTOOL_A_TSCONFIG_RX_FILTERS}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1js hjk ubh and }(hjk hhhNhNubjt )}(h%``ETHTOOL_A_TSCONFIG_HWTSTAMP_FLAGS``h]h!ETHTOOL_A_TSCONFIG_HWTSTAMP_FLAGS}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1js hjk ubhP netlink attributes are then used to set the struct hwtstamp_config accordingly.}(hjk hhhNhNubeh}(h]h ]h"]h$]h&]uh1hhhhM%hj> hhubh)}(hThe ``ETHTOOL_A_TSCONFIG_HWTSTAMP_PROVIDER`` netlink nested attribute is used to select the source of the hardware time stamping. It is composed of an index for the device source and a qualifier for the type of time stamping.h](hThe }(hj hhhNhNubjt )}(h(``ETHTOOL_A_TSCONFIG_HWTSTAMP_PROVIDER``h]h$ETHTOOL_A_TSCONFIG_HWTSTAMP_PROVIDER}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1js hj ubh netlink nested attribute is used to select the source of the hardware time stamping. It is composed of an index for the device source and a qualifier for the type of time stamping.}(hj hhhNhNubeh}(h]h ]h"]h$]h&]uh1hhhhM+hj> hhubh)}(hXDrivers are free to use a more permissive configuration than the requested configuration. It is expected that drivers should only implement directly the most generic mode that can be supported. For example if the hardware can support HWTSTAMP_FILTER_PTP_V2_EVENT, then it should generally always upscale HWTSTAMP_FILTER_PTP_V2_L2_SYNC, and so forth, as HWTSTAMP_FILTER_PTP_V2_EVENT is more generic (and more useful to applications).h]hXDrivers are free to use a more permissive configuration than the requested configuration. It is expected that drivers should only implement directly the most generic mode that can be supported. For example if the hardware can support HWTSTAMP_FILTER_PTP_V2_EVENT, then it should generally always upscale HWTSTAMP_FILTER_PTP_V2_L2_SYNC, and so forth, as HWTSTAMP_FILTER_PTP_V2_EVENT is more generic (and more useful to applications).}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhM/hj> hhubh)}(hXAA driver which supports hardware time stamping shall update the struct with the actual, possibly more permissive configuration. If the requested packets cannot be time stamped, then nothing should be changed and ERANGE shall be returned (in contrast to EINVAL, which indicates that SIOCSHWTSTAMP is not supported at all).h]hXAA driver which supports hardware time stamping shall update the struct with the actual, possibly more permissive configuration. If the requested packets cannot be time stamped, then nothing should be changed and ERANGE shall be returned (in contrast to EINVAL, which indicates that SIOCSHWTSTAMP is not supported at all).}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhM6hj> hhubh)}(hOnly a processes with admin rights may change the configuration. User space is responsible to ensure that multiple processes don't interfere with each other and that the settings are reset.h]hOnly a processes with admin rights may change the configuration. User space is responsible to ensure that multiple processes don’t interfere with each other and that the settings are reset.}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhM<hj> hhubh)}(hqAny process can read the actual configuration by requesting tsconfig netlink socket ``ETHTOOL_MSG_TSCONFIG_GET``.h](hTAny process can read the actual configuration by requesting tsconfig netlink socket }(hj hhhNhNubjt )}(h``ETHTOOL_MSG_TSCONFIG_GET``h]hETHTOOL_MSG_TSCONFIG_GET}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1js hj ubh.}(hj hhhNhNubeh}(h]h ]h"]h$]h&]uh1hhhhM@hj> hhubh)}(hXThe legacy configuration is the use of the ioctl(SIOCSHWTSTAMP) with a pointer to a struct ifreq whose ifr_data points to a struct hwtstamp_config. The tx_type and rx_filter are hints to the driver what it is expected to do. If the requested fine-grained filtering for incoming packets is not supported, the driver may time stamp more than just the requested types of packets. ioctl(SIOCGHWTSTAMP) is used in the same way as the ioctl(SIOCSHWTSTAMP). However, this has not been implemented in all drivers.h]hXThe legacy configuration is the use of the ioctl(SIOCSHWTSTAMP) with a pointer to a struct ifreq whose ifr_data points to a struct hwtstamp_config. The tx_type and rx_filter are hints to the driver what it is expected to do. If the requested fine-grained filtering for incoming packets is not supported, the driver may time stamp more than just the requested types of packets. ioctl(SIOCGHWTSTAMP) is used in the same way as the ioctl(SIOCSHWTSTAMP). However, this has not been implemented in all drivers.}(hj- hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMChj> hhubj)}(hXB/* possible values for hwtstamp_config->tx_type */ enum { /* * no outgoing packet will need hardware time stamping; * should a packet arrive which asks for it, no hardware * time stamping will be done */ HWTSTAMP_TX_OFF, /* * enables hardware time stamping for outgoing packets; * the sender of the packet decides which are to be * time stamped by setting SOF_TIMESTAMPING_TX_SOFTWARE * before sending the packet */ HWTSTAMP_TX_ON, }; /* possible values for hwtstamp_config->rx_filter */ enum { /* time stamp no incoming packet at all */ HWTSTAMP_FILTER_NONE, /* time stamp any incoming packet */ HWTSTAMP_FILTER_ALL, /* return value: time stamp all packets requested plus some others */ HWTSTAMP_FILTER_SOME, /* PTP v1, UDP, any kind of event packet */ HWTSTAMP_FILTER_PTP_V1_L4_EVENT, /* for the complete list of values, please check * the include file include/uapi/linux/net_tstamp.h */ };h]hXB/* possible values for hwtstamp_config->tx_type */ enum { /* * no outgoing packet will need hardware time stamping; * should a packet arrive which asks for it, no hardware * time stamping will be done */ HWTSTAMP_TX_OFF, /* * enables hardware time stamping for outgoing packets; * the sender of the packet decides which are to be * time stamped by setting SOF_TIMESTAMPING_TX_SOFTWARE * before sending the packet */ HWTSTAMP_TX_ON, }; /* possible values for hwtstamp_config->rx_filter */ enum { /* time stamp no incoming packet at all */ HWTSTAMP_FILTER_NONE, /* time stamp any incoming packet */ HWTSTAMP_FILTER_ALL, /* return value: time stamp all packets requested plus some others */ HWTSTAMP_FILTER_SOME, /* PTP v1, UDP, any kind of event packet */ HWTSTAMP_FILTER_PTP_V1_L4_EVENT, /* for the complete list of values, please check * the include file include/uapi/linux/net_tstamp.h */ };}hj; sbah}(h]h ]h"]h$]h&]hhuh1j~hhhMMhj> hhubh)}(hhh](h)}(h83.1 Hardware Timestamping Implementation: Device Driversh]h83.1 Hardware Timestamping Implementation: Device Drivers}(hjL hhhNhNubah}(h]h ]h"]h$]h&]uh1hhjI hhhhhMsubh)}(hX/A driver which supports hardware time stamping must support the ndo_hwtstamp_set NDO or the legacy SIOCSHWTSTAMP ioctl and update the supplied struct hwtstamp_config with the actual values as described in the section on SIOCSHWTSTAMP. It should also support ndo_hwtstamp_get or the legacy SIOCGHWTSTAMP.h]hX/A driver which supports hardware time stamping must support the ndo_hwtstamp_set NDO or the legacy SIOCSHWTSTAMP ioctl and update the supplied struct hwtstamp_config with the actual values as described in the section on SIOCSHWTSTAMP. It should also support ndo_hwtstamp_get or the legacy SIOCGHWTSTAMP.}(hjZ hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMuhjI hhubh)}(hTime stamps for received packets must be stored in the skb. To get a pointer to the shared time stamp structure of the skb call skb_hwtstamps(). Then set the time stamps in the structure::h]hTime stamps for received packets must be stored in the skb. To get a pointer to the shared time stamp structure of the skb call skb_hwtstamps(). Then set the time stamps in the structure:}(hjh hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhM{hjI hhubj)}(hstruct skb_shared_hwtstamps { /* hardware time stamp transformed into duration * since arbitrary point in time */ ktime_t hwtstamp; };h]hstruct skb_shared_hwtstamps { /* hardware time stamp transformed into duration * since arbitrary point in time */ ktime_t hwtstamp; };}hjv sbah}(h]h ]h"]h$]h&]hhuh1j~hhhMhjI hhubh)}(h@Time stamps for outgoing packets are to be generated as follows:h]h@Time stamps for outgoing packets are to be generated as follows:}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhjI hhubh bullet_list)}(hhh](h list_item)}(hIn hard_start_xmit(), check if (skb_shinfo(skb)->tx_flags & SKBTX_HW_TSTAMP) is set no-zero. If yes, then the driver is expected to do hardware time stamping.h]h)}(hIn hard_start_xmit(), check if (skb_shinfo(skb)->tx_flags & SKBTX_HW_TSTAMP) is set no-zero. If yes, then the driver is expected to do hardware time stamping.h]hIn hard_start_xmit(), check if (skb_shinfo(skb)->tx_flags & SKBTX_HW_TSTAMP) is set no-zero. If yes, then the driver is expected to do hardware time stamping.}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhj ubah}(h]h ]h"]h$]h&]uh1j hj hhhhhNubj )}(hXIf this is possible for the skb and requested, then declare that the driver is doing the time stamping by setting the flag SKBTX_IN_PROGRESS in skb_shinfo(skb)->tx_flags , e.g. with:: skb_shinfo(skb)->tx_flags |= SKBTX_IN_PROGRESS; You might want to keep a pointer to the associated skb for the next step and not free the skb. A driver not supporting hardware time stamping doesn't do that. A driver must never touch sk_buff::tstamp! It is used to store software generated time stamps by the network subsystem.h](h)}(hIf this is possible for the skb and requested, then declare that the driver is doing the time stamping by setting the flag SKBTX_IN_PROGRESS in skb_shinfo(skb)->tx_flags , e.g. with::h]hIf this is possible for the skb and requested, then declare that the driver is doing the time stamping by setting the flag SKBTX_IN_PROGRESS in skb_shinfo(skb)->tx_flags , e.g. with:}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhj ubj)}(h/skb_shinfo(skb)->tx_flags |= SKBTX_IN_PROGRESS;h]h/skb_shinfo(skb)->tx_flags |= SKBTX_IN_PROGRESS;}hj sbah}(h]h ]h"]h$]h&]hhuh1j~hhhMhj ubh)}(hXYou might want to keep a pointer to the associated skb for the next step and not free the skb. A driver not supporting hardware time stamping doesn't do that. A driver must never touch sk_buff::tstamp! It is used to store software generated time stamps by the network subsystem.h]hXYou might want to keep a pointer to the associated skb for the next step and not free the skb. A driver not supporting hardware time stamping doesn’t do that. A driver must never touch sk_buff::tstamp! It is used to store software generated time stamps by the network subsystem.}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhj ubeh}(h]h ]h"]h$]h&]uh1j hj hhhhhNubj )}(hDriver should call skb_tx_timestamp() as close to passing sk_buff to hardware as possible. skb_tx_timestamp() provides a software time stamp if requested and hardware timestamping is not possible (SKBTX_IN_PROGRESS not set).h]h)}(hDriver should call skb_tx_timestamp() as close to passing sk_buff to hardware as possible. skb_tx_timestamp() provides a software time stamp if requested and hardware timestamping is not possible (SKBTX_IN_PROGRESS not set).h]hDriver should call skb_tx_timestamp() as close to passing sk_buff to hardware as possible. skb_tx_timestamp() provides a software time stamp if requested and hardware timestamping is not possible (SKBTX_IN_PROGRESS not set).}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhj ubah}(h]h ]h"]h$]h&]uh1j hj hhhhhNubj )}(hXaAs soon as the driver has sent the packet and/or obtained a hardware time stamp for it, it passes the time stamp back by calling skb_tstamp_tx() with the original skb, the raw hardware time stamp. skb_tstamp_tx() clones the original skb and adds the timestamps, therefore the original skb has to be freed now. If obtaining the hardware time stamp somehow fails, then the driver should not fall back to software time stamping. The rationale is that this would occur at a later time in the processing pipeline than other software time stamping and therefore could lead to unexpected deltas between time stamps. h]h)}(hX`As soon as the driver has sent the packet and/or obtained a hardware time stamp for it, it passes the time stamp back by calling skb_tstamp_tx() with the original skb, the raw hardware time stamp. skb_tstamp_tx() clones the original skb and adds the timestamps, therefore the original skb has to be freed now. If obtaining the hardware time stamp somehow fails, then the driver should not fall back to software time stamping. The rationale is that this would occur at a later time in the processing pipeline than other software time stamping and therefore could lead to unexpected deltas between time stamps.h]hX`As soon as the driver has sent the packet and/or obtained a hardware time stamp for it, it passes the time stamp back by calling skb_tstamp_tx() with the original skb, the raw hardware time stamp. skb_tstamp_tx() clones the original skb and adds the timestamps, therefore the original skb has to be freed now. If obtaining the hardware time stamp somehow fails, then the driver should not fall back to software time stamping. The rationale is that this would occur at a later time in the processing pipeline than other software time stamping and therefore could lead to unexpected deltas between time stamps.}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhj ubah}(h]h ]h"]h$]h&]uh1j hj hhhhhNubeh}(h]h ]h"]h$]h&]bullet-uh1j hhhMhjI hhubeh}(h]3hardware-timestamping-implementation-device-driversah ]h"]83.1 hardware timestamping implementation: device driversah$]h&]uh1hhj> hhhhhMsubh)}(hhh](h)}(h:3.2 Special considerations for stacked PTP Hardware Clocksh]h:3.2 Special considerations for stacked PTP Hardware Clocks}(hj( hhhNhNubah}(h]h ]h"]h$]h&]uh1hhj% hhhhhMubh)}(hXThere are situations when there may be more than one PHC (PTP Hardware Clock) in the data path of a packet. The kernel has no explicit mechanism to allow the user to select which PHC to use for timestamping Ethernet frames. Instead, the assumption is that the outermost PHC is always the most preferable, and that kernel drivers collaborate towards achieving that goal. Currently there are 3 cases of stacked PHCs, detailed below:h]hXThere are situations when there may be more than one PHC (PTP Hardware Clock) in the data path of a packet. The kernel has no explicit mechanism to allow the user to select which PHC to use for timestamping Ethernet frames. Instead, the assumption is that the outermost PHC is always the most preferable, and that kernel drivers collaborate towards achieving that goal. Currently there are 3 cases of stacked PHCs, detailed below:}(hj6 hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhj% hhubh)}(hhh](h)}(h43.2.1 DSA (Distributed Switch Architecture) switchesh]h43.2.1 DSA (Distributed Switch Architecture) switches}(hjG hhhNhNubah}(h]h ]h"]h$]h&]uh1hhjD hhhhhMubh)}(hXThese are Ethernet switches which have one of their ports connected to an (otherwise completely unaware) host Ethernet interface, and perform the role of a port multiplier with optional forwarding acceleration features. Each DSA switch port is visible to the user as a standalone (virtual) network interface, and its network I/O is performed, under the hood, indirectly through the host interface (redirecting to the host port on TX, and intercepting frames on RX).h]hXThese are Ethernet switches which have one of their ports connected to an (otherwise completely unaware) host Ethernet interface, and perform the role of a port multiplier with optional forwarding acceleration features. Each DSA switch port is visible to the user as a standalone (virtual) network interface, and its network I/O is performed, under the hood, indirectly through the host interface (redirecting to the host port on TX, and intercepting frames on RX).}(hjU hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhjD hhubh)}(hXWhen a DSA switch is attached to a host port, PTP synchronization has to suffer, since the switch's variable queuing delay introduces a path delay jitter between the host port and its PTP partner. For this reason, some DSA switches include a timestamping clock of their own, and have the ability to perform network timestamping on their own MAC, such that path delays only measure wire and PHY propagation latencies. Timestamping DSA switches are supported in Linux and expose the same ABI as any other network interface (save for the fact that the DSA interfaces are in fact virtual in terms of network I/O, they do have their own PHC). It is typical, but not mandatory, for all interfaces of a DSA switch to share the same PHC.h]hXWhen a DSA switch is attached to a host port, PTP synchronization has to suffer, since the switch’s variable queuing delay introduces a path delay jitter between the host port and its PTP partner. For this reason, some DSA switches include a timestamping clock of their own, and have the ability to perform network timestamping on their own MAC, such that path delays only measure wire and PHY propagation latencies. Timestamping DSA switches are supported in Linux and expose the same ABI as any other network interface (save for the fact that the DSA interfaces are in fact virtual in terms of network I/O, they do have their own PHC). It is typical, but not mandatory, for all interfaces of a DSA switch to share the same PHC.}(hjc hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhjD hhubh)}(hXBy design, PTP timestamping with a DSA switch does not need any special handling in the driver for the host port it is attached to. However, when the host port also supports PTP timestamping, DSA will take care of intercepting the ``.ndo_eth_ioctl`` calls towards the host port, and block attempts to enable hardware timestamping on it. This is because the SO_TIMESTAMPING API does not allow the delivery of multiple hardware timestamps for the same packet, so anybody else except for the DSA switch port must be prevented from doing so.h](hBy design, PTP timestamping with a DSA switch does not need any special handling in the driver for the host port it is attached to. However, when the host port also supports PTP timestamping, DSA will take care of intercepting the }(hjq hhhNhNubjt )}(h``.ndo_eth_ioctl``h]h.ndo_eth_ioctl}(hjy hhhNhNubah}(h]h ]h"]h$]h&]uh1js hjq ubhX  calls towards the host port, and block attempts to enable hardware timestamping on it. This is because the SO_TIMESTAMPING API does not allow the delivery of multiple hardware timestamps for the same packet, so anybody else except for the DSA switch port must be prevented from doing so.}(hjq hhhNhNubeh}(h]h ]h"]h$]h&]uh1hhhhMhjD hhubh)}(hUIn the generic layer, DSA provides the following infrastructure for PTP timestamping:h]hUIn the generic layer, DSA provides the following infrastructure for PTP timestamping:}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhjD hhubj )}(hhh](j )}(hX3``.port_txtstamp()``: a hook called prior to the transmission of packets with a hardware TX timestamping request from user space. This is required for two-step timestamping, since the hardware timestamp becomes available after the actual MAC transmission, so the driver must be prepared to correlate the timestamp with the original packet so that it can re-enqueue the packet back into the socket's error queue. To save the packet for when the timestamp becomes available, the driver can call ``skb_clone_sk`` , save the clone pointer in skb->cb and enqueue a tx skb queue. Typically, a switch will have a PTP TX timestamp register (or sometimes a FIFO) where the timestamp becomes available. In case of a FIFO, the hardware might store key-value pairs of PTP sequence ID/message type/domain number and the actual timestamp. To perform the correlation correctly between the packets in a queue waiting for timestamping and the actual timestamps, drivers can use a BPF classifier (``ptp_classify_raw``) to identify the PTP transport type, and ``ptp_parse_header`` to interpret the PTP header fields. There may be an IRQ that is raised upon this timestamp's availability, or the driver might have to poll after invoking ``dev_queue_xmit()`` towards the host interface. One-step TX timestamping do not require packet cloning, since there is no follow-up message required by the PTP protocol (because the TX timestamp is embedded into the packet by the MAC), and therefore user space does not expect the packet annotated with the TX timestamp to be re-enqueued into its socket's error queue. h]h)}(hX2``.port_txtstamp()``: a hook called prior to the transmission of packets with a hardware TX timestamping request from user space. This is required for two-step timestamping, since the hardware timestamp becomes available after the actual MAC transmission, so the driver must be prepared to correlate the timestamp with the original packet so that it can re-enqueue the packet back into the socket's error queue. To save the packet for when the timestamp becomes available, the driver can call ``skb_clone_sk`` , save the clone pointer in skb->cb and enqueue a tx skb queue. Typically, a switch will have a PTP TX timestamp register (or sometimes a FIFO) where the timestamp becomes available. In case of a FIFO, the hardware might store key-value pairs of PTP sequence ID/message type/domain number and the actual timestamp. To perform the correlation correctly between the packets in a queue waiting for timestamping and the actual timestamps, drivers can use a BPF classifier (``ptp_classify_raw``) to identify the PTP transport type, and ``ptp_parse_header`` to interpret the PTP header fields. There may be an IRQ that is raised upon this timestamp's availability, or the driver might have to poll after invoking ``dev_queue_xmit()`` towards the host interface. One-step TX timestamping do not require packet cloning, since there is no follow-up message required by the PTP protocol (because the TX timestamp is embedded into the packet by the MAC), and therefore user space does not expect the packet annotated with the TX timestamp to be re-enqueued into its socket's error queue.h](jt )}(h``.port_txtstamp()``h]h.port_txtstamp()}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1js hj ubhX: a hook called prior to the transmission of packets with a hardware TX timestamping request from user space. This is required for two-step timestamping, since the hardware timestamp becomes available after the actual MAC transmission, so the driver must be prepared to correlate the timestamp with the original packet so that it can re-enqueue the packet back into the socket’s error queue. To save the packet for when the timestamp becomes available, the driver can call }(hj hhhNhNubjt )}(h``skb_clone_sk``h]h skb_clone_sk}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1js hj ubhX , save the clone pointer in skb->cb and enqueue a tx skb queue. Typically, a switch will have a PTP TX timestamp register (or sometimes a FIFO) where the timestamp becomes available. In case of a FIFO, the hardware might store key-value pairs of PTP sequence ID/message type/domain number and the actual timestamp. To perform the correlation correctly between the packets in a queue waiting for timestamping and the actual timestamps, drivers can use a BPF classifier (}(hj hhhNhNubjt )}(h``ptp_classify_raw``h]hptp_classify_raw}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1js hj ubh*) to identify the PTP transport type, and }(hj hhhNhNubjt )}(h``ptp_parse_header``h]hptp_parse_header}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1js hj ubh to interpret the PTP header fields. There may be an IRQ that is raised upon this timestamp’s availability, or the driver might have to poll after invoking }(hj hhhNhNubjt )}(h``dev_queue_xmit()``h]hdev_queue_xmit()}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1js hj ubhX_ towards the host interface. One-step TX timestamping do not require packet cloning, since there is no follow-up message required by the PTP protocol (because the TX timestamp is embedded into the packet by the MAC), and therefore user space does not expect the packet annotated with the TX timestamp to be re-enqueued into its socket’s error queue.}(hj hhhNhNubeh}(h]h ]h"]h$]h&]uh1hhhhMhj ubah}(h]h ]h"]h$]h&]uh1j hj hhhhhNubj )}(hX``.port_rxtstamp()``: On RX, the BPF classifier is run by DSA to identify PTP event messages (any other packets, including PTP general messages, are not timestamped). The original (and only) timestampable skb is provided to the driver, for it to annotate it with a timestamp, if that is immediately available, or defer to later. On reception, timestamps might either be available in-band (through metadata in the DSA header, or attached in other ways to the packet), or out-of-band (through another RX timestamping FIFO). Deferral on RX is typically necessary when retrieving the timestamp needs a sleepable context. In that case, it is the responsibility of the DSA driver to call ``netif_rx()`` on the freshly timestamped skb. h]h)}(hX``.port_rxtstamp()``: On RX, the BPF classifier is run by DSA to identify PTP event messages (any other packets, including PTP general messages, are not timestamped). The original (and only) timestampable skb is provided to the driver, for it to annotate it with a timestamp, if that is immediately available, or defer to later. On reception, timestamps might either be available in-band (through metadata in the DSA header, or attached in other ways to the packet), or out-of-band (through another RX timestamping FIFO). Deferral on RX is typically necessary when retrieving the timestamp needs a sleepable context. In that case, it is the responsibility of the DSA driver to call ``netif_rx()`` on the freshly timestamped skb.h](jt )}(h``.port_rxtstamp()``h]h.port_rxtstamp()}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1js hj ubhX: On RX, the BPF classifier is run by DSA to identify PTP event messages (any other packets, including PTP general messages, are not timestamped). The original (and only) timestampable skb is provided to the driver, for it to annotate it with a timestamp, if that is immediately available, or defer to later. On reception, timestamps might either be available in-band (through metadata in the DSA header, or attached in other ways to the packet), or out-of-band (through another RX timestamping FIFO). Deferral on RX is typically necessary when retrieving the timestamp needs a sleepable context. In that case, it is the responsibility of the DSA driver to call }(hj hhhNhNubjt )}(h``netif_rx()``h]h netif_rx()}(hj* hhhNhNubah}(h]h ]h"]h$]h&]uh1js hj ubh on the freshly timestamped skb.}(hj hhhNhNubeh}(h]h ]h"]h$]h&]uh1hhhhMhj ubah}(h]h ]h"]h$]h&]uh1j hj hhhhhNubeh}(h]h ]h"]h$]h&]j j uh1j hhhMhjD hhubeh}(h],dsa-distributed-switch-architecture-switchesah ]h"]43.2.1 dsa (distributed switch architecture) switchesah$]h&]uh1hhj% hhhhhMubh)}(hhh](h)}(h3.2.2 Ethernet PHYsh]h3.2.2 Ethernet PHYs}(hjY hhhNhNubah}(h]h ]h"]h$]h&]uh1hhjV hhhhhMubh)}(hXzThese are devices that typically fulfill a Layer 1 role in the network stack, hence they do not have a representation in terms of a network interface as DSA switches do. However, PHYs may be able to detect and timestamp PTP packets, for performance reasons: timestamps taken as close as possible to the wire have the potential to yield a more stable and precise synchronization.h]hXzThese are devices that typically fulfill a Layer 1 role in the network stack, hence they do not have a representation in terms of a network interface as DSA switches do. However, PHYs may be able to detect and timestamp PTP packets, for performance reasons: timestamps taken as close as possible to the wire have the potential to yield a more stable and precise synchronization.}(hjg hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhjV hhubh)}(hA PHY driver that supports PTP timestamping must create a ``struct mii_timestamper`` and add a pointer to it in ``phydev->mii_ts``. The presence of this pointer will be checked by the networking stack.h](h:A PHY driver that supports PTP timestamping must create a }(hju hhhNhNubjt )}(h``struct mii_timestamper``h]hstruct mii_timestamper}(hj} hhhNhNubah}(h]h ]h"]h$]h&]uh1js hju ubh and add a pointer to it in }(hju hhhNhNubjt )}(h``phydev->mii_ts``h]hphydev->mii_ts}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1js hju ubhG. The presence of this pointer will be checked by the networking stack.}(hju hhhNhNubeh}(h]h ]h"]h$]h&]uh1hhhhMhjV hhubh)}(hX4Since PHYs do not have network interface representations, the timestamping and ethtool ioctl operations for them need to be mediated by their respective MAC driver. Therefore, as opposed to DSA switches, modifications need to be done to each individual MAC driver for PHY timestamping support. This entails:h]hX4Since PHYs do not have network interface representations, the timestamping and ethtool ioctl operations for them need to be mediated by their respective MAC driver. Therefore, as opposed to DSA switches, modifications need to be done to each individual MAC driver for PHY timestamping support. This entails:}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhjV hhubj )}(hhh](j )}(hChecking, in ``.ndo_eth_ioctl``, whether ``phy_has_hwtstamp(netdev->phydev)`` is true or not. If it is, then the MAC driver should not process this request but instead pass it on to the PHY using ``phy_mii_ioctl()``. h]h)}(hChecking, in ``.ndo_eth_ioctl``, whether ``phy_has_hwtstamp(netdev->phydev)`` is true or not. If it is, then the MAC driver should not process this request but instead pass it on to the PHY using ``phy_mii_ioctl()``.h](h Checking, in }(hj hhhNhNubjt )}(h``.ndo_eth_ioctl``h]h.ndo_eth_ioctl}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1js hj ubh , whether }(hj hhhNhNubjt )}(h$``phy_has_hwtstamp(netdev->phydev)``h]h phy_has_hwtstamp(netdev->phydev)}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1js hj ubhw is true or not. If it is, then the MAC driver should not process this request but instead pass it on to the PHY using }(hj hhhNhNubjt )}(h``phy_mii_ioctl()``h]hphy_mii_ioctl()}(hj hhhNhNubah}(h]h ]h"]h$]h&]uh1js hj ubh.}(hj hhhNhNubeh}(h]h ]h"]h$]h&]uh1hhhhMhj ubah}(h]h ]h"]h$]h&]uh1j hj hhhhhNubj )}(hX{On RX, special intervention may or may not be needed, depending on the function used to deliver skb's up the network stack. In the case of plain ``netif_rx()`` and similar, MAC drivers must check whether ``skb_defer_rx_timestamp(skb)`` is necessary or not - and if it is, don't call ``netif_rx()`` at all. If ``CONFIG_NETWORK_PHY_TIMESTAMPING`` is enabled, and ``skb->dev->phydev->mii_ts`` exists, its ``.rxtstamp()`` hook will be called now, to determine, using logic very similar to DSA, whether deferral for RX timestamping is necessary. Again like DSA, it becomes the responsibility of the PHY driver to send the packet up the stack when the timestamp is available. For other skb receive functions, such as ``napi_gro_receive`` and ``netif_receive_skb``, the stack automatically checks whether ``skb_defer_rx_timestamp()`` is necessary, so this check is not needed inside the driver. h](h)}(hXOn RX, special intervention may or may not be needed, depending on the function used to deliver skb's up the network stack. In the case of plain ``netif_rx()`` and similar, MAC drivers must check whether ``skb_defer_rx_timestamp(skb)`` is necessary or not - and if it is, don't call ``netif_rx()`` at all. If ``CONFIG_NETWORK_PHY_TIMESTAMPING`` is enabled, and ``skb->dev->phydev->mii_ts`` exists, its ``.rxtstamp()`` hook will be called now, to determine, using logic very similar to DSA, whether deferral for RX timestamping is necessary. Again like DSA, it becomes the responsibility of the PHY driver to send the packet up the stack when the timestamp is available.h](hOn RX, special intervention may or may not be needed, depending on the function used to deliver skb’s up the network stack. In the case of plain }(hj hhhNhNubjt )}(h``netif_rx()``h]h netif_rx()}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1js hj ubh- and similar, MAC drivers must check whether }(hj hhhNhNubjt )}(h``skb_defer_rx_timestamp(skb)``h]hskb_defer_rx_timestamp(skb)}(hj$hhhNhNubah}(h]h ]h"]h$]h&]uh1js hj ubh2 is necessary or not - and if it is, don’t call }(hj hhhNhNubjt )}(h``netif_rx()``h]h netif_rx()}(hj6hhhNhNubah}(h]h ]h"]h$]h&]uh1js hj ubh at all. If }(hj hhhNhNubjt )}(h#``CONFIG_NETWORK_PHY_TIMESTAMPING``h]hCONFIG_NETWORK_PHY_TIMESTAMPING}(hjHhhhNhNubah}(h]h ]h"]h$]h&]uh1js hj ubh is enabled, and }(hj hhhNhNubjt )}(h``skb->dev->phydev->mii_ts``h]hskb->dev->phydev->mii_ts}(hjZhhhNhNubah}(h]h ]h"]h$]h&]uh1js hj ubh exists, its }(hj hhhNhNubjt )}(h``.rxtstamp()``h]h .rxtstamp()}(hjlhhhNhNubah}(h]h ]h"]h$]h&]uh1js hj ubh hook will be called now, to determine, using logic very similar to DSA, whether deferral for RX timestamping is necessary. Again like DSA, it becomes the responsibility of the PHY driver to send the packet up the stack when the timestamp is available.}(hj hhhNhNubeh}(h]h ]h"]h$]h&]uh1hhhhMhjubh)}(hFor other skb receive functions, such as ``napi_gro_receive`` and ``netif_receive_skb``, the stack automatically checks whether ``skb_defer_rx_timestamp()`` is necessary, so this check is not needed inside the driver.h](h)For other skb receive functions, such as }(hjhhhNhNubjt )}(h``napi_gro_receive``h]hnapi_gro_receive}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1js hjubh and }(hjhhhNhNubjt )}(h``netif_receive_skb``h]hnetif_receive_skb}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1js hjubh), the stack automatically checks whether }(hjhhhNhNubjt )}(h``skb_defer_rx_timestamp()``h]hskb_defer_rx_timestamp()}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1js hjubh= is necessary, so this check is not needed inside the driver.}(hjhhhNhNubeh}(h]h ]h"]h$]h&]uh1hhhhMhjubeh}(h]h ]h"]h$]h&]uh1j hj hhhhhNubj )}(hXOn TX, again, special intervention might or might not be needed. The function that calls the ``mii_ts->txtstamp()`` hook is named ``skb_clone_tx_timestamp()``. This function can either be called directly (case in which explicit MAC driver support is indeed needed), but the function also piggybacks from the ``skb_tx_timestamp()`` call, which many MAC drivers already perform for software timestamping purposes. Therefore, if a MAC supports software timestamping, it does not need to do anything further at this stage. h]h)}(hXOn TX, again, special intervention might or might not be needed. The function that calls the ``mii_ts->txtstamp()`` hook is named ``skb_clone_tx_timestamp()``. This function can either be called directly (case in which explicit MAC driver support is indeed needed), but the function also piggybacks from the ``skb_tx_timestamp()`` call, which many MAC drivers already perform for software timestamping purposes. Therefore, if a MAC supports software timestamping, it does not need to do anything further at this stage.h](h^On TX, again, special intervention might or might not be needed. The function that calls the }(hjhhhNhNubjt )}(h``mii_ts->txtstamp()``h]hmii_ts->txtstamp()}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1js hjubh hook is named }(hjhhhNhNubjt )}(h``skb_clone_tx_timestamp()``h]hskb_clone_tx_timestamp()}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1js hjubh. This function can either be called directly (case in which explicit MAC driver support is indeed needed), but the function also piggybacks from the }(hjhhhNhNubjt )}(h``skb_tx_timestamp()``h]hskb_tx_timestamp()}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1js hjubh call, which many MAC drivers already perform for software timestamping purposes. Therefore, if a MAC supports software timestamping, it does not need to do anything further at this stage.}(hjhhhNhNubeh}(h]h ]h"]h$]h&]uh1hhhhMhjubah}(h]h ]h"]h$]h&]uh1j hj hhhhhNubeh}(h]h ]h"]h$]h&]j j uh1j hhhMhjV hhubeh}(h] ethernet-physah ]h"]3.2.2 ethernet physah$]h&]uh1hhj% hhhhhMubh)}(hhh](h)}(h3.2.3 MII bus snooping devicesh]h3.2.3 MII bus snooping devices}(hj-hhhNhNubah}(h]h ]h"]h$]h&]uh1hhj*hhhhhM"ubh)}(hXThese perform the same role as timestamping Ethernet PHYs, save for the fact that they are discrete devices and can therefore be used in conjunction with any PHY even if it doesn't support timestamping. In Linux, they are discoverable and attachable to a ``struct phy_device`` through Device Tree, and for the rest, they use the same mii_ts infrastructure as those. See Documentation/devicetree/bindings/ptp/timestamper.txt for more details.h](hXThese perform the same role as timestamping Ethernet PHYs, save for the fact that they are discrete devices and can therefore be used in conjunction with any PHY even if it doesn’t support timestamping. In Linux, they are discoverable and attachable to a }(hj;hhhNhNubjt )}(h``struct phy_device``h]hstruct phy_device}(hjChhhNhNubah}(h]h ]h"]h$]h&]uh1js hj;ubh through Device Tree, and for the rest, they use the same mii_ts infrastructure as those. See Documentation/devicetree/bindings/ptp/timestamper.txt for more details.}(hj;hhhNhNubeh}(h]h ]h"]h$]h&]uh1hhhhM$hj*hhubeh}(h]mii-bus-snooping-devicesah ]h"]3.2.3 mii bus snooping devicesah$]h&]uh1hhj% hhhhhM"ubh)}(hhh](h)}(h#3.2.4 Other caveats for MAC driversh]h#3.2.4 Other caveats for MAC drivers}(hjfhhhNhNubah}(h]h ]h"]h$]h&]uh1hhjchhhhhM,ubh)}(hXfStacked PHCs, especially DSA (but not only) - since that doesn't require any modification to MAC drivers, so it is more difficult to ensure correctness of all possible code paths - is that they uncover bugs which were impossible to trigger before the existence of stacked PTP clocks. One example has to do with this line of code, already presented earlier::h]hXgStacked PHCs, especially DSA (but not only) - since that doesn’t require any modification to MAC drivers, so it is more difficult to ensure correctness of all possible code paths - is that they uncover bugs which were impossible to trigger before the existence of stacked PTP clocks. One example has to do with this line of code, already presented earlier:}(hjthhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhM.hjchhubj)}(h/skb_shinfo(skb)->tx_flags |= SKBTX_IN_PROGRESS;h]h/skb_shinfo(skb)->tx_flags |= SKBTX_IN_PROGRESS;}hjsbah}(h]h ]h"]h$]h&]hhuh1j~hhhM4hjchhubh)}(hXAny TX timestamping logic, be it a plain MAC driver, a DSA switch driver, a PHY driver or a MII bus snooping device driver, should set this flag. But a MAC driver that is unaware of PHC stacking might get tripped up by somebody other than itself setting this flag, and deliver a duplicate timestamp. For example, a typical driver design for TX timestamping might be to split the transmission part into 2 portions:h]hXAny TX timestamping logic, be it a plain MAC driver, a DSA switch driver, a PHY driver or a MII bus snooping device driver, should set this flag. But a MAC driver that is unaware of PHC stacking might get tripped up by somebody other than itself setting this flag, and deliver a duplicate timestamp. For example, a typical driver design for TX timestamping might be to split the transmission part into 2 portions:}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhM6hjchhubhenumerated_list)}(hhh](j )}(hX-"TX": checks whether PTP timestamping has been previously enabled through the ``.ndo_eth_ioctl`` ("``priv->hwtstamp_tx_enabled == true``") and the current skb requires a TX timestamp ("``skb_shinfo(skb)->tx_flags & SKBTX_HW_TSTAMP``"). If this is true, it sets the "``skb_shinfo(skb)->tx_flags |= SKBTX_IN_PROGRESS``" flag. Note: as described above, in the case of a stacked PHC system, this condition should never trigger, as this MAC is certainly not the outermost PHC. But this is not where the typical issue is. Transmission proceeds with this packet. h]h)}(hX,"TX": checks whether PTP timestamping has been previously enabled through the ``.ndo_eth_ioctl`` ("``priv->hwtstamp_tx_enabled == true``") and the current skb requires a TX timestamp ("``skb_shinfo(skb)->tx_flags & SKBTX_HW_TSTAMP``"). If this is true, it sets the "``skb_shinfo(skb)->tx_flags |= SKBTX_IN_PROGRESS``" flag. Note: as described above, in the case of a stacked PHC system, this condition should never trigger, as this MAC is certainly not the outermost PHC. But this is not where the typical issue is. Transmission proceeds with this packet.h](hR“TX”: checks whether PTP timestamping has been previously enabled through the }(hjhhhNhNubjt )}(h``.ndo_eth_ioctl``h]h.ndo_eth_ioctl}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1js hjubh (”}(hjhhhNhNubjt )}(h%``priv->hwtstamp_tx_enabled == true``h]h!priv->hwtstamp_tx_enabled == true}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1js hjubh5”) and the current skb requires a TX timestamp (”}(hjhhhNhNubjt )}(h/``skb_shinfo(skb)->tx_flags & SKBTX_HW_TSTAMP``h]h+skb_shinfo(skb)->tx_flags & SKBTX_HW_TSTAMP}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1js hjubh&”). If this is true, it sets the “}(hjhhhNhNubjt )}(h2``skb_shinfo(skb)->tx_flags |= SKBTX_IN_PROGRESS``h]h.skb_shinfo(skb)->tx_flags |= SKBTX_IN_PROGRESS}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1js hjubh” flag. Note: as described above, in the case of a stacked PHC system, this condition should never trigger, as this MAC is certainly not the outermost PHC. But this is not where the typical issue is. Transmission proceeds with this packet.}(hjhhhNhNubeh}(h]h ]h"]h$]h&]uh1hhhhM>hjubah}(h]h ]h"]h$]h&]uh1j hjhhhhhNubj )}(hX"TX confirmation": Transmission has finished. The driver checks whether it is necessary to collect any TX timestamp for it. Here is where the typical issues are: the MAC driver takes a shortcut and only checks whether "``skb_shinfo(skb)->tx_flags & SKBTX_IN_PROGRESS``" was set. With a stacked PHC system, this is incorrect because this MAC driver is not the only entity in the TX data path who could have enabled SKBTX_IN_PROGRESS in the first place. h]h)}(hX"TX confirmation": Transmission has finished. The driver checks whether it is necessary to collect any TX timestamp for it. Here is where the typical issues are: the MAC driver takes a shortcut and only checks whether "``skb_shinfo(skb)->tx_flags & SKBTX_IN_PROGRESS``" was set. With a stacked PHC system, this is incorrect because this MAC driver is not the only entity in the TX data path who could have enabled SKBTX_IN_PROGRESS in the first place.h](h“TX confirmation”: Transmission has finished. The driver checks whether it is necessary to collect any TX timestamp for it. Here is where the typical issues are: the MAC driver takes a shortcut and only checks whether “}(hjhhhNhNubjt )}(h1``skb_shinfo(skb)->tx_flags & SKBTX_IN_PROGRESS``h]h-skb_shinfo(skb)->tx_flags & SKBTX_IN_PROGRESS}(hjhhhNhNubah}(h]h ]h"]h$]h&]uh1js hjubh” was set. With a stacked PHC system, this is incorrect because this MAC driver is not the only entity in the TX data path who could have enabled SKBTX_IN_PROGRESS in the first place.}(hjhhhNhNubeh}(h]h ]h"]h$]h&]uh1hhhhMGhjubah}(h]h ]h"]h$]h&]uh1j hjhhhhhNubeh}(h]h ]h"]h$]h&]enumtypearabicprefixhsuffix.uh1jhjchhhhhM>ubh)}(hXThe correct solution for this problem is for MAC drivers to have a compound check in their "TX confirmation" portion, not only for "``skb_shinfo(skb)->tx_flags & SKBTX_IN_PROGRESS``", but also for "``priv->hwtstamp_tx_enabled == true``". Because the rest of the system ensures that PTP timestamping is not enabled for anything other than the outermost PHC, this enhanced check will avoid delivering a duplicated TX timestamp to user space.h](hThe correct solution for this problem is for MAC drivers to have a compound check in their “TX confirmation” portion, not only for “}(hj8hhhNhNubjt )}(h1``skb_shinfo(skb)->tx_flags & SKBTX_IN_PROGRESS``h]h-skb_shinfo(skb)->tx_flags & SKBTX_IN_PROGRESS}(hj@hhhNhNubah}(h]h ]h"]h$]h&]uh1js hj8ubh”, but also for “}(hj8hhhNhNubjt )}(h%``priv->hwtstamp_tx_enabled == true``h]h!priv->hwtstamp_tx_enabled == true}(hjRhhhNhNubah}(h]h ]h"]h$]h&]uh1js hj8ubh”. Because the rest of the system ensures that PTP timestamping is not enabled for anything other than the outermost PHC, this enhanced check will avoid delivering a duplicated TX timestamp to user space.}(hj8hhhNhNubeh}(h]h ]h"]h$]h&]uh1hhhhMOhjchhubeh}(h]other-caveats-for-mac-driversah ]h"]#3.2.4 other caveats for mac driversah$]h&]uh1hhj% hhhhhM,ubeh}(h]6special-considerations-for-stacked-ptp-hardware-clocksah ]h"]:3.2 special considerations for stacked ptp hardware clocksah$]h&]uh1hhj> hhhhhMubeh}(h]@hardware-timestamping-configuration-ethtool-msg-tsconfig-set-getah ]h"]D3. hardware timestamping configuration: ethtool_msg_tsconfig_set/getah$]h&]uh1hhhhhhhhMubeh}(h] timestampingah ]h"] timestampingah$]h&]uh1hhhhhhhhKubeh}(h]h ]h"]h$]h&]sourcehuh1hcurrent_sourceN current_lineNsettingsdocutils.frontendValues)}(hN generatorN datestampN source_linkN source_urlN toc_backlinksentryfootnote_backlinksK sectnum_xformKstrip_commentsNstrip_elements_with_classesN strip_classesN report_levelK halt_levelKexit_status_levelKdebugNwarning_streamN tracebackinput_encoding utf-8-siginput_encoding_error_handlerstrictoutput_encodingutf-8output_encoding_error_handlerjerror_encodingutf-8error_encoding_error_handlerbackslashreplace language_codeenrecord_dependenciesNconfigN id_prefixhauto_id_prefixid dump_settingsNdump_internalsNdump_transformsNdump_pseudo_xmlNexpose_internalsNstrict_visitorN_disable_configN_sourceh _destinationN _config_files]7/var/lib/git/docbuild/linux/Documentation/docutils.confafile_insertion_enabled raw_enabledKline_length_limitM'pep_referencesN pep_base_urlhttps://peps.python.org/pep_file_url_templatepep-%04drfc_referencesN rfc_base_url&https://datatracker.ietf.org/doc/html/ tab_widthKtrim_footnote_reference_spacesyntax_highlightlong smart_quotessmartquotes_locales]character_level_inline_markupdoctitle_xform docinfo_xformKsectsubtitle_xform image_loadinglinkembed_stylesheetcloak_email_addressessection_self_linkenvNubreporterNindirect_targets]substitution_defs}substitution_names}refnames}refids}nameids}(jjj3j0jjj\jYjjj jjjjIjFjjj+j(j; j8 j3 j0 j j ju jr j j j j j j j+ j( jj|j" j jwjtjS jP j'j$j`j]jojlu nametypes}(jj3jj\jj jjIjj+j; j3 j ju j j j j+ jj" jwjS j'j`jouh}(jhj0hjjjYjjj_jjjj#jFjjjLj(jj8 j6j0 jyj j jr jC j jx j j j j j( j j|j> j jI jtj% jP jD j$jV j]j*jljcu footnote_refs} citation_refs} autofootnotes]autofootnote_refs]symbol_footnotes]symbol_footnote_refs] footnotes] citations]autofootnote_startKsymbol_footnote_startK id_counter collectionsCounter}Rparse_messages]transform_messages] transformerN include_log] decorationNhhub.