Windows 10 and Windows 11 don't have a built-in CPU temperature monitor.
You can usually see CPU temperature in BIOS. To go to BIOS, you have to press a certain key after you turn on your PC (depends on brand).
Alternatively, you have to install a third-party app, to check CPU temperature in Windows.