Figured it out. Use env to set the variable and invoke the bash shell.

me@my_machine $ ssh adminact@remote_machine -- /bin/env FOO=1 /bin/bash

adminact@remote_machine $ echo $FOO
1