79494138

Date: 2025-03-08 09:02:33
Score: 0.5
Natty:
Report link

Add same initi parameters to the LlamaForCausalLM instantiation(B)

# B) Load with LlamaForCausalLM + config

model_llama = LlamaForCausalLM(config, attn_implementation="eager", torch_dtype=dtype).cuda()

If you don't use same parameters in the init, the model will use different default settings.

Reasons:
  • Low length (0.5):
  • Has code block (-0.5):
  • Low reputation (0.5):
Posted by: Coco Q.