x86: Initialize CPU info via IFUNC relocation [BZ 26203]

System Internals / glibc - H.J. Lu [gmail.com] - 16 October 2020 23:17 UTC

X86 CPU features in ld.so are initialized by init_cpu_features, which is invoked by DL_PLATFORM_INIT from _dl_sysdep_start. But when ld.so is loaded by static executable, DL_PLATFORM_INIT is never called. Also x86 cache info in libc.o and libc.a is initialized by a constructor which may be called too late. Since some fields in _rtld_global_ro in ld.so are initialized by dynamic relocation, we can also initialize x86 CPU features in _rtld_global_ro in ld.so and cache info in libc.so by initializing dummy function pointers in ld.so and libc.so via IFUNC relocation.

Key points:

1. IFUNC is always supported, independent of --enable-multi-arch or--disable-multi-arch. Linker generates IFUNC relocations from input IFUNC objects and ld.so performs IFUNC relocations. 2. There are no IFUNC dependencies in ld.so before dynamic relocation have been performed, 3. The x86 CPU features in ld.so is initialized by DL_PLATFORM_INIT in dynamic executable and by IFUNC relocation in dlopen in static executable. 4. The x86 cache info in libc.o is initialized by IFUNC relocation. 5. In libc.a, both x86 CPU features and cache info are initialized from ARCH_INIT_CPU_FEATURES, not by IFUNC relocation, before __libc_early_init is called.

Note: _dl_x86_init_cpu_features can be called more than once from DL_PLATFORM_INIT and during relocation in ld.so.

0f09154c64 x86: Initialize CPU info via IFUNC relocation [BZ 26203]
sysdeps/i386/dl-machine.h | 7 +-
sysdeps/x86/cacheinfo.c | 868 +------------------------------------
sysdeps/x86/cacheinfo.h | 413 ++++++++++++++++++
sysdeps/x86/cpu-features.c | 12 +-
sysdeps/x86/dl-cacheinfo.h | 478 ++++++++++++++++++++
sysdeps/x86/dl-get-cpu-features.c | 27 +-
sysdeps/x86/include/cpu-features.h | 1 +
sysdeps/x86/libc-start.c | 1 -
sysdeps/x86_64/dl-machine.h | 7 +-
9 files changed, 949 insertions(+), 865 deletions(-)

Upstream: sourceware.org


  • Share