In case anyone is encountering the same issue using the Java SDK, here's the solution. Note the port number and setEndpoint() function call.

SpeechClient.create(
    SpeechSettings.newBuilder().setEndpoint("us-central1-speech.googleapis.com:443").build()
)