For whatever reason this problem still exists - and it's almost 2025...

My fix to the problem after creating/editing a run config and hitting the Store as project file button was to simply close the project File > Close Project and reopen it again.

This creates/updates the files.