Could you log the short term memory contents right before you generate the response? That ought to help with debugging—see if it's similar to what you were expecting, or what's different.