I’m facing the exact same issue, but the percentage of failures in my case is much higher.
I’m using the Python client to upload/download/delete files from Google Drive, and I’m using service account credentials. It was working fine 4 days ago, but before 4 days I start receiving the connection timeout errors.
Have you found any solutions yet?