Resolved the issue as per suggestions in the github issue. User config takes precedence over the project config. When I was setting up VS Code initially, a user config got created. I had to delete the user config to resolve it (could have removed the project config as well).

On Linux, the user config was under ${HOME}/.config/clangd/config.yaml