After hours of retry, I finally get it.

When downloaded, you must set the path to

flutter config --jdk-dir *JDK-folder-version*/Content/Home

(cause Flutter will search that path/bin/java to determine jdk version)