79218779

Date: 2024-11-23 20:39:41
Score: 1.5
Natty:
Report link

Late answer here, I ran into the same issue where it would use the 2 GPUs I have so I made a simple shell utility that allows to specify the numbers of servers you want to launch with a specific port range and it works very well!

https://github.com/theodufort/ollama-server-scaler

Reasons:
  • Low length (0.5):
  • No code block (0.5):
  • Low reputation (0.5):
Posted by: Ted's Projects