candle looking for model.embed_tokens.weight whereas the original tensor name is embedding_model.embed_tokens.weight. You just have to change this line of mistral.rs in candle_transformers.

// from
let vb_m = vb.pp("model");
//to
let vb_m = vb.pp("embedding_model");