Once the files are in your repository, Git will track them. So delete those files (or move them out of the repo) make a commit and then they should not appear anymore.

Example:

rm -rf .idea
git add .idea
git commit -m "Delete .idea folder"