Are you using the Access token value or the ID token value? It won't work with Access Token. Try using ID token value that you get after successful oauth.