As per U880D's comment, using device_requests works.
device_requests
Instead of gpus: all I used:
gpus: all
- driver: nvidia count: -1 capabilities: - [ "gpu" ]