There’s a reason for that. Imagine you lost all your devices and backup options. You will be locked out in this extreme and unlikely but not an impossible scenario.
I believe a unique strong password used for one thing only, i.e. your password manager is enough even in the worst case scenario to get back into your accounts with your new devices.
This is the ultimate contingency set up.