Turns out you just need to set one more option
config: plugins: metrics-by-endpoint: useOnlyRequestNames: true groupDynamicURLs: false