It sounds like you're missing the CUDA Toolkit. Here's how to install it:
Visit NVIDIA's CUDA Toolkit download page, on google:
- For the latest version search for: CUDA Toolkit Downloads
For specific versions (e.g. CUDA 12.1): CUDA Toolkit 12.1 Archive
- Select your configuration (OS, architecture, version)
For Linux users, I recommend choosing the runfile (local) installation method as it's straightforward.
Important Installation Notes:
- If using VSCode, maximize your terminal window before running the installer to avoid issues with the license agreement display
- During installation, select only the NVIDIA CUDA Toolkit option. Uncheck other components unless specifically needed