Downgrading python to 3.11.9 worked. As per the OpenAI Whisper documentation they only support till version 3.11.9