When you delete a file, git generates new commit to delete that, and git saves history of that file deleted. So you can't push it to remote repository.

To remove that file from history, you should run git rm --cached file

If it also doesn't work, you can consider to clear git history and generate new commits, but it can lead to losing commit history.

Good approach is to reset commit until large file is commited, and then re-generate from that.