As mentioned on https://stable-baselines3.readthedocs.io/en/master/modules/ppo.html, StableBaseline3's PPO is meant to be run on the CPU.
StableBaselines3 PPO note