Ideally logout url from login.microsoftonline.com will not destroy any access token but it will only refrain from providing any new access token using a refresh tokens.

The simple solution from the application logout perspective is to destroy the access token and refresh token on the client cache / cookie.

You can also hit the logout endpoint of azure. This will ensure that current access token is destroyed and new access token will also not be granted using a refresh token.