It turned out that when in full debug mode, FastMM never releases the used memory back to the OS. The memory is released back into the unallocated memory pool and re-used internally (by your program) when needed, but never back to Windows.
Source of information: https://www.youtube.com/watch?v=204qa4wVR2I