This is a Dart VM issue. Dart first looks up ipv4, then after a delay looks up ipv6. Linking to github issue: https://github.com/dart-lang/sdk/issues/60192
Some workarounds are using a custom http client that manually looks up ipv6 addresses of hosts, or using a proxy in your http client.