Ok, the problem was that I accidentally set VoiceStateManager to 0 in discordClientOptions. This meant that VoiceState was not cached.