While it's true that you may not be using all the memory that your card provides to you, perhaps your processes are using up all the memory that has been allocated to them. In other words, maybe giving them less memory was actually the opposite direction?