I got the error resolved by first installing xformers since it is not able to recognize the torch module which was already installed

pip3 install -U xformers --index-url https://download.pytorch.org/whl/cu124

then try installing mistral_inference

pip3 install mistral-inference