Send a request to:
https://www.googleapis.com/oauth2/v1/tokeninfo?access_token=<TOKEN>
The server returns HTTP 200 if token is valid and 400 if not. If it's valid the response also contains details about the user.