I added the 'vue/no-undef-components': 'error' rule to my eslint.config.js:
'vue/no-undef-components': 'error' rule
rules: { 'vue/no-undef-components': 'error' }
Now it checks for undefined components!
EDIT: Stackoverflow says I must wait to accept my own answer in 2 days.