Additionally for anyone who came across this post (same as me), if git ignore is not ignoring as expected, clean the cache:
git rm --cached *.json