That is how JWT works. There are pros and cons with JWT's you just noticed the largest "con" imho.
I wrote some remedies in a similar question here: How to revoke an accesstoken?