Surprising to hear about considerable time spent in the recipe run; usually it's building up the model of your code that takes far longer than any recipe execution. Helpful that you already used the data tables to pinpoint the recipe execution duration. Would you mind logging an issue with your findings?
If indeed considerable time is spent parsing yaml files that are unlikely to contain the keys you're after then a FindSourceFiles precondition could be a great way to limit which files are evaluated to speed up performance today.