6sphinx.addnodesdocument)}( rawsourcechildren]( translations LanguagesNode)}(hhh](h pending_xref)}(hhh]docutils.nodesTextChinese (Simplified)}(hhparenthuba attributes}(ids]classes]names]dupnames]backrefs] refdomainstdreftypedoc reftarget'/translations/zh_CN/RCU/rcu_dereferencemodnameN classnameN refexplicitutagnamehhh ubh)}(hhh]hChinese (Traditional)}(hhhh2ubah}(h]h ]h"]h$]h&] refdomainh)reftypeh+ reftarget'/translations/zh_TW/RCU/rcu_dereferencemodnameN classnameN refexplicituh1hhh ubh)}(hhh]hItalian}(hhhhFubah}(h]h ]h"]h$]h&] refdomainh)reftypeh+ reftarget'/translations/it_IT/RCU/rcu_dereferencemodnameN classnameN refexplicituh1hhh ubh)}(hhh]hJapanese}(hhhhZubah}(h]h ]h"]h$]h&] refdomainh)reftypeh+ reftarget'/translations/ja_JP/RCU/rcu_dereferencemodnameN classnameN refexplicituh1hhh ubh)}(hhh]hKorean}(hhhhnubah}(h]h ]h"]h$]h&] refdomainh)reftypeh+ reftarget'/translations/ko_KR/RCU/rcu_dereferencemodnameN classnameN refexplicituh1hhh ubh)}(hhh]hSpanish}(hhhhubah}(h]h ]h"]h$]h&] refdomainh)reftypeh+ reftarget'/translations/sp_SP/RCU/rcu_dereferencemodnameN classnameN refexplicituh1hhh ubeh}(h]h ]h"]h$]h&]current_languageEnglishuh1h hh _documenthsourceNlineNubhtarget)}(h.. _rcu_dereference_doc:h]h}(h]h ]h"]h$]h&]refidrcu-dereference-docuh1hhKhhhhhA/var/lib/git/docbuild/linux/Documentation/RCU/rcu_dereference.rstubhsection)}(hhh](htitle)}(h?PROPER CARE AND FEEDING OF RETURN VALUES FROM rcu_dereference()h]h?PROPER CARE AND FEEDING OF RETURN VALUES FROM rcu_dereference()}(hhhhhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhhhhhKubh paragraph)}(hX Proper care and feeding of address and data dependencies is critically important to correct use of things like RCU. To this end, the pointers returned from the rcu_dereference() family of primitives carry address and data dependencies. These dependencies extend from the rcu_dereference() macro's load of the pointer to the later use of that pointer to compute either the address of a later memory access (representing an address dependency) or the value written by a later memory access (representing a data dependency).h]hX Proper care and feeding of address and data dependencies is critically important to correct use of things like RCU. To this end, the pointers returned from the rcu_dereference() family of primitives carry address and data dependencies. These dependencies extend from the rcu_dereference() macro’s load of the pointer to the later use of that pointer to compute either the address of a later memory access (representing an address dependency) or the value written by a later memory access (representing a data dependency).}(hhhhhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhhhhubh)}(hXMost of the time, these dependencies are preserved, permitting you to freely use values from rcu_dereference(). For example, dereferencing (prefix "*"), field selection ("->"), assignment ("="), address-of ("&"), casts, and addition or subtraction of constants all work quite naturally and safely. However, because current compilers do not take either address or data dependencies into account it is still possible to get into trouble.h]hXMost of the time, these dependencies are preserved, permitting you to freely use values from rcu_dereference(). For example, dereferencing (prefix “*”), field selection (“->”), assignment (“=”), address-of (”&”), casts, and addition or subtraction of constants all work quite naturally and safely. However, because current compilers do not take either address or data dependencies into account it is still possible to get into trouble.}(hXMost of the time, these dependencies are preserved, permitting you to freely use values from rcu_dereference(). For example, dereferencing (prefix "*"), field selection ("->"), assignment ("="), address-of ("&"), casts, and addition or subtraction of constants all work quite naturally and safely. However, because current compilers do not take either address or data dependencies into account it is still possible to get into trouble.hhhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhhhhubh)}(hFollow these rules to preserve the address and data dependencies emanating from your calls to rcu_dereference() and friends, thus keeping your RCU readers working properly:h]hFollow these rules to preserve the address and data dependencies emanating from your calls to rcu_dereference() and friends, thus keeping your RCU readers working properly:}(hhhhhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhhhhubh bullet_list)}(hhh](h list_item)}(hXYou must use one of the rcu_dereference() family of primitives to load an RCU-protected pointer, otherwise CONFIG_PROVE_RCU will complain. Worse yet, your code can see random memory-corruption bugs due to games that compilers and DEC Alpha can play. Without one of the rcu_dereference() primitives, compilers can reload the value, and won't your code have fun with two different values for a single pointer! Without rcu_dereference(), DEC Alpha can load a pointer, dereference that pointer, and return data preceding initialization that preceded the store of the pointer. (As noted later, in recent kernels READ_ONCE() also prevents DEC Alpha from playing these tricks.) In addition, the volatile cast in rcu_dereference() prevents the compiler from deducing the resulting pointer value. Please see the section entitled "EXAMPLE WHERE THE COMPILER KNOWS TOO MUCH" for an example where the compiler can in fact deduce the exact value of the pointer, and thus cause misordering. h](h)}(hXYou must use one of the rcu_dereference() family of primitives to load an RCU-protected pointer, otherwise CONFIG_PROVE_RCU will complain. Worse yet, your code can see random memory-corruption bugs due to games that compilers and DEC Alpha can play. Without one of the rcu_dereference() primitives, compilers can reload the value, and won't your code have fun with two different values for a single pointer! Without rcu_dereference(), DEC Alpha can load a pointer, dereference that pointer, and return data preceding initialization that preceded the store of the pointer. (As noted later, in recent kernels READ_ONCE() also prevents DEC Alpha from playing these tricks.)h]hXYou must use one of the rcu_dereference() family of primitives to load an RCU-protected pointer, otherwise CONFIG_PROVE_RCU will complain. Worse yet, your code can see random memory-corruption bugs due to games that compilers and DEC Alpha can play. Without one of the rcu_dereference() primitives, compilers can reload the value, and won’t your code have fun with two different values for a single pointer! Without rcu_dereference(), DEC Alpha can load a pointer, dereference that pointer, and return data preceding initialization that preceded the store of the pointer. (As noted later, in recent kernels READ_ONCE() also prevents DEC Alpha from playing these tricks.)}(hhhhhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhhubh)}(hX2In addition, the volatile cast in rcu_dereference() prevents the compiler from deducing the resulting pointer value. Please see the section entitled "EXAMPLE WHERE THE COMPILER KNOWS TOO MUCH" for an example where the compiler can in fact deduce the exact value of the pointer, and thus cause misordering.h]hX6In addition, the volatile cast in rcu_dereference() prevents the compiler from deducing the resulting pointer value. Please see the section entitled “EXAMPLE WHERE THE COMPILER KNOWS TOO MUCH” for an example where the compiler can in fact deduce the exact value of the pointer, and thus cause misordering.}(hj hj hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhK'hhubeh}(h]h ]h"]h$]h&]uh1hhhhhhhhNubh)}(hXIn the special case where data is added but is never removed while readers are accessing the structure, READ_ONCE() may be used instead of rcu_dereference(). In this case, use of READ_ONCE() takes on the role of the lockless_dereference() primitive that was removed in v4.15. h]h)}(hXIn the special case where data is added but is never removed while readers are accessing the structure, READ_ONCE() may be used instead of rcu_dereference(). In this case, use of READ_ONCE() takes on the role of the lockless_dereference() primitive that was removed in v4.15.h]hXIn the special case where data is added but is never removed while readers are accessing the structure, READ_ONCE() may be used instead of rcu_dereference(). In this case, use of READ_ONCE() takes on the role of the lockless_dereference() primitive that was removed in v4.15.}(hj%hj#hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhK-hjubah}(h]h ]h"]h$]h&]uh1hhhhhhhhNubh)}(hXYou are only permitted to use rcu_dereference() on pointer values. The compiler simply knows too much about integral values to trust it to carry dependencies through integer operations. There are a very few exceptions, namely that you can temporarily cast the pointer to uintptr_t in order to: - Set bits and clear bits down in the must-be-zero low-order bits of that pointer. This clearly means that the pointer must have alignment constraints, for example, this does *not* work in general for char* pointers. - XOR bits to translate pointers, as is done in some classic buddy-allocator algorithms. It is important to cast the value back to pointer before doing much of anything else with it. h](h)}(hX%You are only permitted to use rcu_dereference() on pointer values. The compiler simply knows too much about integral values to trust it to carry dependencies through integer operations. There are a very few exceptions, namely that you can temporarily cast the pointer to uintptr_t in order to:h]hX%You are only permitted to use rcu_dereference() on pointer values. The compiler simply knows too much about integral values to trust it to carry dependencies through integer operations. There are a very few exceptions, namely that you can temporarily cast the pointer to uintptr_t in order to:}(hj=hj;hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhK3hj7ubh)}(hhh](h)}(hSet bits and clear bits down in the must-be-zero low-order bits of that pointer. This clearly means that the pointer must have alignment constraints, for example, this does *not* work in general for char* pointers. h]h)}(hSet bits and clear bits down in the must-be-zero low-order bits of that pointer. This clearly means that the pointer must have alignment constraints, for example, this does *not* work in general for char* pointers.h](hSet bits and clear bits down in the must-be-zero low-order bits of that pointer. This clearly means that the pointer must have alignment constraints, for example, this does }(hSet bits and clear bits down in the must-be-zero low-order bits of that pointer. This clearly means that the pointer must have alignment constraints, for example, this does hjPhhhNhNubhemphasis)}(h*not*h]hnot}(hhhj[hhhNhNubah}(h]h ]h"]h$]h&]uh1jYhjPubh$ work in general for char* pointers.}(h$ work in general for char* pointers.hjPhhhNhNubeh}(h]h ]h"]h$]h&]uh1hhhhK9hjLubah}(h]h ]h"]h$]h&]uh1hhjIubh)}(hWXOR bits to translate pointers, as is done in some classic buddy-allocator algorithms. h]h)}(hVXOR bits to translate pointers, as is done in some classic buddy-allocator algorithms.h]hVXOR bits to translate pointers, as is done in some classic buddy-allocator algorithms.}(hjhj~hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhK>hjzubah}(h]h ]h"]h$]h&]uh1hhjIubeh}(h]h ]h"]h$]h&]bullet-uh1hhhhK9hj7ubh)}(h]It is important to cast the value back to pointer before doing much of anything else with it.h]h]It is important to cast the value back to pointer before doing much of anything else with it.}(hjhjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKAhj7ubeh}(h]h ]h"]h$]h&]uh1hhhhhhhhNubh)}(hXcAvoid cancellation when using the "+" and "-" infix arithmetic operators. For example, for a given variable "x", avoid "(x-(uintptr_t)x)" for char* pointers. The compiler is within its rights to substitute zero for this sort of expression, so that subsequent accesses no longer depend on the rcu_dereference(), again possibly resulting in bugs due to misordering. Of course, if "p" is a pointer from rcu_dereference(), and "a" and "b" are integers that happen to be equal, the expression "p+a-b" is safe because its value still necessarily depends on the rcu_dereference(), thus maintaining proper ordering. h](h)}(hXmAvoid cancellation when using the "+" and "-" infix arithmetic operators. For example, for a given variable "x", avoid "(x-(uintptr_t)x)" for char* pointers. The compiler is within its rights to substitute zero for this sort of expression, so that subsequent accesses no longer depend on the rcu_dereference(), again possibly resulting in bugs due to misordering.h]hX}Avoid cancellation when using the “+” and “-” infix arithmetic operators. For example, for a given variable “x”, avoid “(x-(uintptr_t)x)” for char* pointers. The compiler is within its rights to substitute zero for this sort of expression, so that subsequent accesses no longer depend on the rcu_dereference(), again possibly resulting in bugs due to misordering.}(hjhjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKDhjubh)}(hOf course, if "p" is a pointer from rcu_dereference(), and "a" and "b" are integers that happen to be equal, the expression "p+a-b" is safe because its value still necessarily depends on the rcu_dereference(), thus maintaining proper ordering.h]hXOf course, if “p” is a pointer from rcu_dereference(), and “a” and “b” are integers that happen to be equal, the expression “p+a-b” is safe because its value still necessarily depends on the rcu_dereference(), thus maintaining proper ordering.}(hjhjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKKhjubeh}(h]h ]h"]h$]h&]uh1hhhhhhhhNubh)}(hXIf you are using RCU to protect JITed functions, so that the "()" function-invocation operator is applied to a value obtained (directly or indirectly) from rcu_dereference(), you may need to interact directly with the hardware to flush instruction caches. This issue arises on some systems when a newly JITed function is using the same memory that was used by an earlier JITed function. h]h)}(hXIf you are using RCU to protect JITed functions, so that the "()" function-invocation operator is applied to a value obtained (directly or indirectly) from rcu_dereference(), you may need to interact directly with the hardware to flush instruction caches. This issue arises on some systems when a newly JITed function is using the same memory that was used by an earlier JITed function.h]hXIf you are using RCU to protect JITed functions, so that the “()” function-invocation operator is applied to a value obtained (directly or indirectly) from rcu_dereference(), you may need to interact directly with the hardware to flush instruction caches. This issue arises on some systems when a newly JITed function is using the same memory that was used by an earlier JITed function.}(hjhjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKPhjubah}(h]h ]h"]h$]h&]uh1hhhhhhhhNubh)}(hX[Do not use the results from relational operators ("==", "!=", ">", ">=", "<", or "<=") when dereferencing. For example, the following (quite strange) code is buggy:: int *p; int *q; ... p = rcu_dereference(gp) q = &global_q; q += p > &oom_p; r1 = *q; /* BUGGY!!! */ As before, the reason this is buggy is that relational operators are often compiled using branches. And as before, although weak-memory machines such as ARM or PowerPC do order stores after such branches, but can speculate loads, which can again result in misordering bugs. h](h)}(hDo not use the results from relational operators ("==", "!=", ">", ">=", "<", or "<=") when dereferencing. For example, the following (quite strange) code is buggy::h]hDo not use the results from relational operators (“==”, “!=”, “>”, “>=”, “<”, or “<=”) when dereferencing. For example, the following (quite strange) code is buggy:}(hDo not use the results from relational operators ("==", "!=", ">", ">=", "<", or "<=") when dereferencing. For example, the following (quite strange) code is buggy:hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKWhjubh literal_block)}(hfint *p; int *q; ... p = rcu_dereference(gp) q = &global_q; q += p > &oom_p; r1 = *q; /* BUGGY!!! */h]hfint *p; int *q; ... p = rcu_dereference(gp) q = &global_q; q += p > &oom_p; r1 = *q; /* BUGGY!!! */}(hhhjubah}(h]h ]h"]h$]h&] xml:spacepreserveuh1jhhhK[hjubh)}(hXAs before, the reason this is buggy is that relational operators are often compiled using branches. And as before, although weak-memory machines such as ARM or PowerPC do order stores after such branches, but can speculate loads, which can again result in misordering bugs.h]hXAs before, the reason this is buggy is that relational operators are often compiled using branches. And as before, although weak-memory machines such as ARM or PowerPC do order stores after such branches, but can speculate loads, which can again result in misordering bugs.}(hjhjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKehjubeh}(h]h ]h"]h$]h&]uh1hhhhhhhhNubh)}(hXBe very careful about comparing pointers obtained from rcu_dereference() against non-NULL values. As Linus Torvalds explained, if the two pointers are equal, the compiler could substitute the pointer you are comparing against for the pointer obtained from rcu_dereference(). For example:: p = rcu_dereference(gp); if (p == &default_struct) do_default(p->a); Because the compiler now knows that the value of "p" is exactly the address of the variable "default_struct", it is free to transform this code into the following:: p = rcu_dereference(gp); if (p == &default_struct) do_default(default_struct.a); On ARM and Power hardware, the load from "default_struct.a" can now be speculated, such that it might happen before the rcu_dereference(). This could result in bugs due to misordering. However, comparisons are OK in the following cases: - The comparison was against the NULL pointer. If the compiler knows that the pointer is NULL, you had better not be dereferencing it anyway. If the comparison is non-equal, the compiler is none the wiser. Therefore, it is safe to compare pointers from rcu_dereference() against NULL pointers. - The pointer is never dereferenced after being compared. Since there are no subsequent dereferences, the compiler cannot use anything it learned from the comparison to reorder the non-existent subsequent dereferences. This sort of comparison occurs frequently when scanning RCU-protected circular linked lists. Note that if the pointer comparison is done outside of an RCU read-side critical section, and the pointer is never dereferenced, rcu_access_pointer() should be used in place of rcu_dereference(). In most cases, it is best to avoid accidental dereferences by testing the rcu_access_pointer() return value directly, without assigning it to a variable. Within an RCU read-side critical section, there is little reason to use rcu_access_pointer(). - The comparison is against a pointer that references memory that was initialized "a long time ago." The reason this is safe is that even if misordering occurs, the misordering will not affect the accesses that follow the comparison. So exactly how long ago is "a long time ago"? Here are some possibilities: - Compile time. - Boot time. - Module-init time for module code. - Prior to kthread creation for kthread code. - During some prior acquisition of the lock that we now hold. - Before mod_timer() time for a timer handler. There are many other possibilities involving the Linux kernel's wide array of primitives that cause code to be invoked at a later time. - The pointer being compared against also came from rcu_dereference(). In this case, both pointers depend on one rcu_dereference() or another, so you get proper ordering either way. That said, this situation can make certain RCU usage bugs more likely to happen. Which can be a good thing, at least if they happen during testing. An example of such an RCU usage bug is shown in the section titled "EXAMPLE OF AMPLIFIED RCU-USAGE BUG". - All of the accesses following the comparison are stores, so that a control dependency preserves the needed ordering. That said, it is easy to get control dependencies wrong. Please see the "CONTROL DEPENDENCIES" section of Documentation/memory-barriers.txt for more details. - The pointers are not equal *and* the compiler does not have enough information to deduce the value of the pointer. Note that the volatile cast in rcu_dereference() will normally prevent the compiler from knowing too much. However, please note that if the compiler knows that the pointer takes on only one of two values, a not-equal comparison will provide exactly the information that the compiler needs to deduce the value of the pointer. h](h)}(hX"Be very careful about comparing pointers obtained from rcu_dereference() against non-NULL values. As Linus Torvalds explained, if the two pointers are equal, the compiler could substitute the pointer you are comparing against for the pointer obtained from rcu_dereference(). For example::h]hX!Be very careful about comparing pointers obtained from rcu_dereference() against non-NULL values. As Linus Torvalds explained, if the two pointers are equal, the compiler could substitute the pointer you are comparing against for the pointer obtained from rcu_dereference(). For example:}(hX!Be very careful about comparing pointers obtained from rcu_dereference() against non-NULL values. As Linus Torvalds explained, if the two pointers are equal, the compiler could substitute the pointer you are comparing against for the pointer obtained from rcu_dereference(). For example:hj)hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKkhj%ubj)}(hLp = rcu_dereference(gp); if (p == &default_struct) do_default(p->a);h]hLp = rcu_dereference(gp); if (p == &default_struct) do_default(p->a);}(hhhj8ubah}(h]h ]h"]h$]h&]jjuh1jhhhKqhj%ubh)}(hBecause the compiler now knows that the value of "p" is exactly the address of the variable "default_struct", it is free to transform this code into the following::h]hBecause the compiler now knows that the value of “p” is exactly the address of the variable “default_struct”, it is free to transform this code into the following:}(hBecause the compiler now knows that the value of "p" is exactly the address of the variable "default_struct", it is free to transform this code into the following:hjFhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKuhj%ubj)}(hXp = rcu_dereference(gp); if (p == &default_struct) do_default(default_struct.a);h]hXp = rcu_dereference(gp); if (p == &default_struct) do_default(default_struct.a);}(hhhjUubah}(h]h ]h"]h$]h&]jjuh1jhhhKyhj%ubh)}(hOn ARM and Power hardware, the load from "default_struct.a" can now be speculated, such that it might happen before the rcu_dereference(). This could result in bugs due to misordering.h]hOn ARM and Power hardware, the load from “default_struct.a” can now be speculated, such that it might happen before the rcu_dereference(). This could result in bugs due to misordering.}(hjehjchhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhK}hj%ubh)}(h3However, comparisons are OK in the following cases:h]h3However, comparisons are OK in the following cases:}(hjshjqhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhj%ubh)}(hhh](h)}(hX'The comparison was against the NULL pointer. If the compiler knows that the pointer is NULL, you had better not be dereferencing it anyway. If the comparison is non-equal, the compiler is none the wiser. Therefore, it is safe to compare pointers from rcu_dereference() against NULL pointers. h]h)}(hX&The comparison was against the NULL pointer. If the compiler knows that the pointer is NULL, you had better not be dereferencing it anyway. If the comparison is non-equal, the compiler is none the wiser. Therefore, it is safe to compare pointers from rcu_dereference() against NULL pointers.h]hX&The comparison was against the NULL pointer. If the compiler knows that the pointer is NULL, you had better not be dereferencing it anyway. If the comparison is non-equal, the compiler is none the wiser. Therefore, it is safe to compare pointers from rcu_dereference() against NULL pointers.}(hjhjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjubah}(h]h ]h"]h$]h&]uh1hhjubh)}(hXThe pointer is never dereferenced after being compared. Since there are no subsequent dereferences, the compiler cannot use anything it learned from the comparison to reorder the non-existent subsequent dereferences. This sort of comparison occurs frequently when scanning RCU-protected circular linked lists. Note that if the pointer comparison is done outside of an RCU read-side critical section, and the pointer is never dereferenced, rcu_access_pointer() should be used in place of rcu_dereference(). In most cases, it is best to avoid accidental dereferences by testing the rcu_access_pointer() return value directly, without assigning it to a variable. Within an RCU read-side critical section, there is little reason to use rcu_access_pointer(). h](h)}(hX5The pointer is never dereferenced after being compared. Since there are no subsequent dereferences, the compiler cannot use anything it learned from the comparison to reorder the non-existent subsequent dereferences. This sort of comparison occurs frequently when scanning RCU-protected circular linked lists.h]hX5The pointer is never dereferenced after being compared. Since there are no subsequent dereferences, the compiler cannot use anything it learned from the comparison to reorder the non-existent subsequent dereferences. This sort of comparison occurs frequently when scanning RCU-protected circular linked lists.}(hjhjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjubh)}(hX^Note that if the pointer comparison is done outside of an RCU read-side critical section, and the pointer is never dereferenced, rcu_access_pointer() should be used in place of rcu_dereference(). In most cases, it is best to avoid accidental dereferences by testing the rcu_access_pointer() return value directly, without assigning it to a variable.h]hX^Note that if the pointer comparison is done outside of an RCU read-side critical section, and the pointer is never dereferenced, rcu_access_pointer() should be used in place of rcu_dereference(). In most cases, it is best to avoid accidental dereferences by testing the rcu_access_pointer() return value directly, without assigning it to a variable.}(hjhjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjubh)}(h]Within an RCU read-side critical section, there is little reason to use rcu_access_pointer().h]h]Within an RCU read-side critical section, there is little reason to use rcu_access_pointer().}(hjhjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjubeh}(h]h ]h"]h$]h&]uh1hhjubh)}(hXThe comparison is against a pointer that references memory that was initialized "a long time ago." The reason this is safe is that even if misordering occurs, the misordering will not affect the accesses that follow the comparison. So exactly how long ago is "a long time ago"? Here are some possibilities: - Compile time. - Boot time. - Module-init time for module code. - Prior to kthread creation for kthread code. - During some prior acquisition of the lock that we now hold. - Before mod_timer() time for a timer handler. There are many other possibilities involving the Linux kernel's wide array of primitives that cause code to be invoked at a later time. h](h)}(hX5The comparison is against a pointer that references memory that was initialized "a long time ago." The reason this is safe is that even if misordering occurs, the misordering will not affect the accesses that follow the comparison. So exactly how long ago is "a long time ago"? Here are some possibilities:h]hX=The comparison is against a pointer that references memory that was initialized “a long time ago.” The reason this is safe is that even if misordering occurs, the misordering will not affect the accesses that follow the comparison. So exactly how long ago is “a long time ago”? Here are some possibilities:}(hjhjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjubh)}(hhh](h)}(hCompile time. h]h)}(h Compile time.h]h Compile time.}(hjhjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjubah}(h]h ]h"]h$]h&]uh1hhjubh)}(h Boot time. h]h)}(h Boot time.h]h Boot time.}(hjhjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjubah}(h]h ]h"]h$]h&]uh1hhjubh)}(h"Module-init time for module code. h]h)}(h!Module-init time for module code.h]h!Module-init time for module code.}(hjhjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhjubah}(h]h ]h"]h$]h&]uh1hhjubh)}(h,Prior to kthread creation for kthread code. h]h)}(h+Prior to kthread creation for kthread code.h]h+Prior to kthread creation for kthread code.}(hj1hj/hhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhKhj+ubah}(h]h ]h"]h$]h&]uh1hhjubh)}(ha = 42; /* Each field in its own cache line. */ p->b = 43; p->c = 44; rcu_assign_pointer(gp1, p); p->b = 143; p->c = 144; rcu_assign_pointer(gp2, p); } void reader(void) { struct foo *p; struct foo *q; int r1, r2; rcu_read_lock(); p = rcu_dereference(gp2); if (p == NULL) return; r1 = p->b; /* Guaranteed to get 143. */ q = rcu_dereference(gp1); /* Guaranteed non-NULL. */ if (p == q) { /* The compiler decides that q->c is same as p->c. */ r2 = p->c; /* Could get 44 on weakly order system. */ } else { r2 = p->c - r1; /* Unconditional access to p->c. */ } rcu_read_unlock(); do_something_with(r1, r2); }h]hX#struct foo { int a; int b; int c; }; struct foo *gp1; struct foo *gp2; void updater(void) { struct foo *p; p = kmalloc(...); if (p == NULL) deal_with_it(); p->a = 42; /* Each field in its own cache line. */ p->b = 43; p->c = 44; rcu_assign_pointer(gp1, p); p->b = 143; p->c = 144; rcu_assign_pointer(gp2, p); } void reader(void) { struct foo *p; struct foo *q; int r1, r2; rcu_read_lock(); p = rcu_dereference(gp2); if (p == NULL) return; r1 = p->b; /* Guaranteed to get 143. */ q = rcu_dereference(gp1); /* Guaranteed non-NULL. */ if (p == q) { /* The compiler decides that q->c is same as p->c. */ r2 = p->c; /* Could get 44 on weakly order system. */ } else { r2 = p->c - r1; /* Unconditional access to p->c. */ } rcu_read_unlock(); do_something_with(r1, r2); }}(hhhj]ubah}(h]h ]h"]h$]h&]jjuh1jhhhKhj=hhubh)}(hXdYou might be surprised that the outcome (r1 == 143 && r2 == 44) is possible, but you should not be. After all, the updater might have been invoked a second time between the time reader() loaded into "r1" and the time that it loaded into "r2". The fact that this same result can occur due to some reordering from the compiler and CPUs is beside the point.h]hXlYou might be surprised that the outcome (r1 == 143 && r2 == 44) is possible, but you should not be. After all, the updater might have been invoked a second time between the time reader() loaded into “r1” and the time that it loaded into “r2”. The fact that this same result can occur due to some reordering from the compiler and CPUs is beside the point.}(hjmhjkhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhj=hhubh)}(h4But suppose that the reader needs a consistent view?h]h4But suppose that the reader needs a consistent view?}(hj{hjyhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhj=hhubh)}(h>Then one approach is to use locking, for example, as follows::h]h=Then one approach is to use locking, for example, as follows:}(h=Then one approach is to use locking, for example, as follows:hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhj=hhubj)}(hXstruct foo { int a; int b; int c; spinlock_t lock; }; struct foo *gp1; struct foo *gp2; void updater(void) { struct foo *p; p = kmalloc(...); if (p == NULL) deal_with_it(); spin_lock(&p->lock); p->a = 42; /* Each field in its own cache line. */ p->b = 43; p->c = 44; spin_unlock(&p->lock); rcu_assign_pointer(gp1, p); spin_lock(&p->lock); p->b = 143; p->c = 144; spin_unlock(&p->lock); rcu_assign_pointer(gp2, p); } void reader(void) { struct foo *p; struct foo *q; int r1, r2; rcu_read_lock(); p = rcu_dereference(gp2); if (p == NULL) return; spin_lock(&p->lock); r1 = p->b; /* Guaranteed to get 143. */ q = rcu_dereference(gp1); /* Guaranteed non-NULL. */ if (p == q) { /* The compiler decides that q->c is same as p->c. */ r2 = p->c; /* Locking guarantees r2 == 144. */ } else { spin_lock(&q->lock); r2 = q->c - r1; spin_unlock(&q->lock); } rcu_read_unlock(); spin_unlock(&p->lock); do_something_with(r1, r2); }h]hXstruct foo { int a; int b; int c; spinlock_t lock; }; struct foo *gp1; struct foo *gp2; void updater(void) { struct foo *p; p = kmalloc(...); if (p == NULL) deal_with_it(); spin_lock(&p->lock); p->a = 42; /* Each field in its own cache line. */ p->b = 43; p->c = 44; spin_unlock(&p->lock); rcu_assign_pointer(gp1, p); spin_lock(&p->lock); p->b = 143; p->c = 144; spin_unlock(&p->lock); rcu_assign_pointer(gp2, p); } void reader(void) { struct foo *p; struct foo *q; int r1, r2; rcu_read_lock(); p = rcu_dereference(gp2); if (p == NULL) return; spin_lock(&p->lock); r1 = p->b; /* Guaranteed to get 143. */ q = rcu_dereference(gp1); /* Guaranteed non-NULL. */ if (p == q) { /* The compiler decides that q->c is same as p->c. */ r2 = p->c; /* Locking guarantees r2 == 144. */ } else { spin_lock(&q->lock); r2 = q->c - r1; spin_unlock(&q->lock); } rcu_read_unlock(); spin_unlock(&p->lock); do_something_with(r1, r2); }}(hhhjubah}(h]h ]h"]h$]h&]jjuh1jhhhMhj=hhubh)}(h*As always, use the right tool for the job!h]h*As always, use the right tool for the job!}(hjhjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMRhj=hhubeh}(h]"example-of-amplified-rcu-usage-bugah ]h"]"example of amplified rcu-usage bugah$]h&]uh1hhhhhhhhKubh)}(hhh](h)}(h)EXAMPLE WHERE THE COMPILER KNOWS TOO MUCHh]h)EXAMPLE WHERE THE COMPILER KNOWS TOO MUCH}(hjhjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhjhhhhhMVubh)}(hXIf a pointer obtained from rcu_dereference() compares not-equal to some other pointer, the compiler normally has no clue what the value of the first pointer might be. This lack of knowledge prevents the compiler from carrying out optimizations that otherwise might destroy the ordering guarantees that RCU depends on. And the volatile cast in rcu_dereference() should prevent the compiler from guessing the value.h]hXIf a pointer obtained from rcu_dereference() compares not-equal to some other pointer, the compiler normally has no clue what the value of the first pointer might be. This lack of knowledge prevents the compiler from carrying out optimizations that otherwise might destroy the ordering guarantees that RCU depends on. And the volatile cast in rcu_dereference() should prevent the compiler from guessing the value.}(hjhjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMXhjhhubh)}(huBut without rcu_dereference(), the compiler knows more than you might expect. Consider the following code fragment::h]htBut without rcu_dereference(), the compiler knows more than you might expect. Consider the following code fragment:}(htBut without rcu_dereference(), the compiler knows more than you might expect. Consider the following code fragment:hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhM_hjhhubj)}(hXystruct foo { int a; int b; }; static struct foo variable1; static struct foo variable2; static struct foo *gp = &variable1; void updater(void) { initialize_foo(&variable2); rcu_assign_pointer(gp, &variable2); /* * The above is the only store to gp in this translation unit, * and the address of gp is not exported in any way. */ } int reader(void) { struct foo *p; p = gp; barrier(); if (p == &variable1) return p->a; /* Must be variable1.a. */ else return p->b; /* Must be variable2.b. */ }h]hXystruct foo { int a; int b; }; static struct foo variable1; static struct foo variable2; static struct foo *gp = &variable1; void updater(void) { initialize_foo(&variable2); rcu_assign_pointer(gp, &variable2); /* * The above is the only store to gp in this translation unit, * and the address of gp is not exported in any way. */ } int reader(void) { struct foo *p; p = gp; barrier(); if (p == &variable1) return p->a; /* Must be variable1.a. */ else return p->b; /* Must be variable2.b. */ }}(hhhjubah}(h]h ]h"]h$]h&]jjuh1jhhhMbhjhhubh)}(hXBecause the compiler can see all stores to "gp", it knows that the only possible values of "gp" are "variable1" on the one hand and "variable2" on the other. The comparison in reader() therefore tells the compiler the exact value of "p" even in the not-equals case. This allows the compiler to make the return values independent of the load from "gp", in turn destroying the ordering between this load and the loads of the return values. This can result in "p->b" returning pre-initialization garbage values on weakly ordered systems.h]hX5Because the compiler can see all stores to “gp”, it knows that the only possible values of “gp” are “variable1” on the one hand and “variable2” on the other. The comparison in reader() therefore tells the compiler the exact value of “p” even in the not-equals case. This allows the compiler to make the return values independent of the load from “gp”, in turn destroying the ordering between this load and the loads of the return values. This can result in “p->b” returning pre-initialization garbage values on weakly ordered systems.}(hjhjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhjhhubh)}(hfIn short, rcu_dereference() is *not* optional when you are going to dereference the resulting pointer.h](hIn short, rcu_dereference() is }(hIn short, rcu_dereference() is hjhhhNhNubjZ)}(h*not*h]hnot}(hhhj hhhNhNubah}(h]h ]h"]h$]h&]uh1jYhjubhB optional when you are going to dereference the resulting pointer.}(hB optional when you are going to dereference the resulting pointer.hjhhhNhNubeh}(h]h ]h"]h$]h&]uh1hhhhMhjhhubeh}(h])example-where-the-compiler-knows-too-muchah ]h"])example where the compiler knows too muchah$]h&]uh1hhhhhhhhMVubh)}(hhh](h)}(hrcu_protected_pointer, lockdep_is_held(&my_lock)); h](h)}(hIf the access might be within an RCU read-side critical section on the one hand, or protected by (say) my_lock on the other, use rcu_dereference_check(), for example::h]hIf the access might be within an RCU read-side critical section on the one hand, or protected by (say) my_lock on the other, use rcu_dereference_check(), for example:}(hIf the access might be within an RCU read-side critical section on the one hand, or protected by (say) my_lock on the other, use rcu_dereference_check(), for example:hjnhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhjjubj)}(hkp1 = rcu_dereference_check(p->rcu_protected_pointer, lockdep_is_held(&my_lock));h]hkp1 = rcu_dereference_check(p->rcu_protected_pointer, lockdep_is_held(&my_lock));}(hhhj}ubah}(h]h ]h"]h$]h&]jjuh1jhhhMhjjubeh}(h]h ]h"]h$]h&]uh1hhjOhhhhhNubh)}(hX{If the access might be within an RCU read-side critical section on the one hand, or protected by either my_lock or your_lock on the other, again use rcu_dereference_check(), for example:: p1 = rcu_dereference_check(p->rcu_protected_pointer, lockdep_is_held(&my_lock) || lockdep_is_held(&your_lock)); h](h)}(hIf the access might be within an RCU read-side critical section on the one hand, or protected by either my_lock or your_lock on the other, again use rcu_dereference_check(), for example::h]hIf the access might be within an RCU read-side critical section on the one hand, or protected by either my_lock or your_lock on the other, again use rcu_dereference_check(), for example:}(hIf the access might be within an RCU read-side critical section on the one hand, or protected by either my_lock or your_lock on the other, again use rcu_dereference_check(), for example:hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhjubj)}(hp1 = rcu_dereference_check(p->rcu_protected_pointer, lockdep_is_held(&my_lock) || lockdep_is_held(&your_lock));h]hp1 = rcu_dereference_check(p->rcu_protected_pointer, lockdep_is_held(&my_lock) || lockdep_is_held(&your_lock));}(hhhjubah}(h]h ]h"]h$]h&]jjuh1jhhhMhjubeh}(h]h ]h"]h$]h&]uh1hhjOhhhhhNubh)}(hXrIf the access is on the update side, so that it is always protected by my_lock, use rcu_dereference_protected():: p1 = rcu_dereference_protected(p->rcu_protected_pointer, lockdep_is_held(&my_lock)); This can be extended to handle multiple locks as in #3 above, and both can be extended to check other conditions as well. h](h)}(hqIf the access is on the update side, so that it is always protected by my_lock, use rcu_dereference_protected()::h]hpIf the access is on the update side, so that it is always protected by my_lock, use rcu_dereference_protected():}(hpIf the access is on the update side, so that it is always protected by my_lock, use rcu_dereference_protected():hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhjubj)}(hsp1 = rcu_dereference_protected(p->rcu_protected_pointer, lockdep_is_held(&my_lock));h]hsp1 = rcu_dereference_protected(p->rcu_protected_pointer, lockdep_is_held(&my_lock));}(hhhjubah}(h]h ]h"]h$]h&]jjuh1jhhhMhjubh)}(hyThis can be extended to handle multiple locks as in #3 above, and both can be extended to check other conditions as well.h]hyThis can be extended to handle multiple locks as in #3 above, and both can be extended to check other conditions as well.}(hjhjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhjubeh}(h]h ]h"]h$]h&]uh1hhjOhhhhhNubh)}(hXIf the protection is supplied by the caller, and is thus unknown to this code, that is the rare case when rcu_dereference_raw() is appropriate. In addition, rcu_dereference_raw() might be appropriate when the lockdep expression would be excessively complex, except that a better approach in that case might be to take a long hard look at your synchronization design. Still, there are data-locking cases where any one of a very large number of locks or reference counters suffices to protect the pointer, so rcu_dereference_raw() does have its place. However, its place is probably quite a bit smaller than one might expect given the number of uses in the current kernel. Ditto for its synonym, rcu_dereference_check( ... , 1), and its close relative, rcu_dereference_protected(... , 1). h](h)}(hX'If the protection is supplied by the caller, and is thus unknown to this code, that is the rare case when rcu_dereference_raw() is appropriate. In addition, rcu_dereference_raw() might be appropriate when the lockdep expression would be excessively complex, except that a better approach in that case might be to take a long hard look at your synchronization design. Still, there are data-locking cases where any one of a very large number of locks or reference counters suffices to protect the pointer, so rcu_dereference_raw() does have its place.h]hX'If the protection is supplied by the caller, and is thus unknown to this code, that is the rare case when rcu_dereference_raw() is appropriate. In addition, rcu_dereference_raw() might be appropriate when the lockdep expression would be excessively complex, except that a better approach in that case might be to take a long hard look at your synchronization design. Still, there are data-locking cases where any one of a very large number of locks or reference counters suffices to protect the pointer, so rcu_dereference_raw() does have its place.}(hjhjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhjubh)}(hHowever, its place is probably quite a bit smaller than one might expect given the number of uses in the current kernel. Ditto for its synonym, rcu_dereference_check( ... , 1), and its close relative, rcu_dereference_protected(... , 1).h]hHowever, its place is probably quite a bit smaller than one might expect given the number of uses in the current kernel. Ditto for its synonym, rcu_dereference_check( ... , 1), and its close relative, rcu_dereference_protected(... , 1).}(hjhjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhjubeh}(h]h ]h"]h$]h&]uh1hhjOhhhhhNubeh}(h]h ]h"]h$]h&]enumtypearabicprefixhsuffix.uh1jMhj.hhhhhMubeh}(h]9which-member-of-the-rcu-dereference-family-should-you-useah ]h"]rcu_protected_pointer; do_something_with(p->a); do_something_else_with(p->b);h]hTp = q->rcu_protected_pointer; do_something_with(p->a); do_something_else_with(p->b);}(hhhjFubah}(h]h ]h"]h$]h&]jjuh1jhhhMhj&hhubh)}(h~If register pressure is high, the compiler might optimize "p" out of existence, transforming the code to something like this::h]hIf register pressure is high, the compiler might optimize “p” out of existence, transforming the code to something like this:}(h}If register pressure is high, the compiler might optimize "p" out of existence, transforming the code to something like this:hjThhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhj&hhubj)}(hddo_something_with(q->rcu_protected_pointer->a); do_something_else_with(q->rcu_protected_pointer->b);h]hddo_something_with(q->rcu_protected_pointer->a); do_something_else_with(q->rcu_protected_pointer->b);}(hhhjcubah}(h]h ]h"]h$]h&]jjuh1jhhhMhj&hhubh)}(hXThis could fatally disappoint your code if q->rcu_protected_pointer changed in the meantime. Nor is this a theoretical problem: Exactly this sort of bug cost Paul E. McKenney (and several of his innocent colleagues) a three-day weekend back in the early 1990s.h]hXThis could fatally disappoint your code if q->rcu_protected_pointer changed in the meantime. Nor is this a theoretical problem: Exactly this sort of bug cost Paul E. McKenney (and several of his innocent colleagues) a three-day weekend back in the early 1990s.}(hjshjqhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhj&hhubh)}(hLoad tearing could of course result in dereferencing a mashup of a pair of pointers, which also might fatally disappoint your code.h]hLoad tearing could of course result in dereferencing a mashup of a pair of pointers, which also might fatally disappoint your code.}(hjhjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhj&hhubh)}(hZThese problems could have been avoided simply by making the code instead read as follows::h]hYThese problems could have been avoided simply by making the code instead read as follows:S}(hYThese problems could have been avoided simply by making the code instead read as follows:hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhj&hhubj)}(hep = rcu_dereference(q->rcu_protected_pointer); do_something_with(p->a); do_something_else_with(p->b);h]hep = rcu_dereference(q->rcu_protected_pointer); do_something_with(p->a); do_something_else_with(p->b);}(hhhjubah}(h]h ]h"]h$]h&]jjuh1jhhhMhj&hhubh)}(hXUnfortunately, these sorts of bugs can be extremely hard to spot during review. This is where the sparse tool comes into play, along with the "__rcu" marker. If you mark a pointer declaration, whether in a structure or as a formal parameter, with "__rcu", which tells sparse to complain if this pointer is accessed directly. It will also cause sparse to complain if a pointer not marked with "__rcu" is accessed using rcu_dereference() and friends. For example, ->rcu_protected_pointer might be declared as follows::h]hXUnfortunately, these sorts of bugs can be extremely hard to spot during review. This is where the sparse tool comes into play, along with the “__rcu” marker. If you mark a pointer declaration, whether in a structure or as a formal parameter, with “__rcu”, which tells sparse to complain if this pointer is accessed directly. It will also cause sparse to complain if a pointer not marked with “__rcu” is accessed using rcu_dereference() and friends. For example, ->rcu_protected_pointer might be declared as follows:}(hXUnfortunately, these sorts of bugs can be extremely hard to spot during review. This is where the sparse tool comes into play, along with the "__rcu" marker. If you mark a pointer declaration, whether in a structure or as a formal parameter, with "__rcu", which tells sparse to complain if this pointer is accessed directly. It will also cause sparse to complain if a pointer not marked with "__rcu" is accessed using rcu_dereference() and friends. For example, ->rcu_protected_pointer might be declared as follows:hjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhj&hhubj)}(h(struct foo __rcu *rcu_protected_pointer;h]h(struct foo __rcu *rcu_protected_pointer;}(hhhjubah}(h]h ]h"]h$]h&]jjuh1jhhhMhj&hhubh)}(hcUse of "__rcu" is opt-in. If you choose not to use it, then you should ignore the sparse warnings.h]hgUse of “__rcu” is opt-in. If you choose not to use it, then you should ignore the sparse warnings.}(hjhjhhhNhNubah}(h]h ]h"]h$]h&]uh1hhhhMhj&hhubeh}(h])sparse-checking-of-rcu-protected-pointersah ]h"])sparse checking of rcu-protected pointersah$]h&]uh1hhhhhhhhMubeh}(h](=proper-care-and-feeding-of-return-values-from-rcu-dereferenceheh ]h"](?proper care and feeding of return values from rcu_dereference()rcu_dereference_doceh$]h&]uh1hhhhhhhhKexpect_referenced_by_name}jhsexpect_referenced_by_id}hhsubeh}(h]h ]h"]h$]h&]sourcehuh1hcurrent_sourceN current_lineNsettingsdocutils.frontendValues)}(hN generatorN datestampN source_linkN source_urlN toc_backlinksentryfootnote_backlinksK sectnum_xformKstrip_commentsNstrip_elements_with_classesN strip_classesN report_levelK halt_levelKexit_status_levelKdebugNwarning_streamN tracebackinput_encoding utf-8-siginput_encoding_error_handlerstrictoutput_encodingutf-8output_encoding_error_handlerj error_encodingUTF-8error_encoding_error_handlerbackslashreplace language_codeenrecord_dependenciesNconfigN id_prefixhauto_id_prefixid dump_settingsNdump_internalsNdump_transformsNdump_pseudo_xmlNexpose_internalsNstrict_visitorN_disable_configN_sourceh _destinationN _config_files]7/var/lib/git/docbuild/linux/Documentation/docutils.confapep_referencesN pep_base_urlhttps://peps.python.org/pep_file_url_templatepep-%04drfc_referencesN rfc_base_url&https://datatracker.ietf.org/doc/html/ tab_widthKtrim_footnote_reference_spacefile_insertion_enabled raw_enabledKline_length_limitM'syntax_highlightlong smart_quotessmartquotes_locales]character_level_inline_markupdoctitle_xform docinfo_xformKsectsubtitle_xform image_loadinglinkembed_stylesheetcloak_email_addressessection_self_link embed_imagesenvNubreporterNindirect_targets]substitution_defs}substitution_names}refnames}refids}h]hasnameids}(jhjjjjj+j(j#j jju nametypes}(jjNjNj+Nj#NjNuh}(hhjhjj=j(jj j.jj&u footnote_refs} citation_refs} autofootnotes]autofootnote_refs]symbol_footnotes]symbol_footnote_refs] footnotes] citations]autofootnote_startKsymbol_footnote_startK id_counter collectionsCounter}Rparse_messages]transform_messages]hsystem_message)}(hhh]h)}(hhh]h9Hyperlink target "rcu-dereference-doc" is not referenced.}(hhhjxubah}(h]h ]h"]h$]h&]uh1hhjuubah}(h]h ]h"]h$]h&]levelKtypeINFOsourcehlineKuh1jsuba transformerN include_log] decorationNhhub.