It might be so obvious that one may miss it but thanks to the Open process explorer command I noticed I had some empty workspaces open that took some RAM. Depending on your os (here macOS), one could miss this quite easily. Saved me about 1GB RAM