You better use Deep Learning models if you want to have good accuracy.
Have you tried Android VAD library?
This library supports multiple models for VAD: WebRTC VAD GMM, Silero VAD DNN, Yamnet VAD DNN models.
https://github.com/gkonovalov/android-vad