It is not possible to run pytorch-2.5+ with MPS on MacOS12, as in #133141. PyTorch developers have disabled MacOS 12 support, because too many things are broken in MPS framework on MacOS 12. But even if one rolled-back the change, one would not see any perf benefits/new functionality in MPS support on 2.5 compared to 2.4.
But the message is really confusing, it should have said that MPS is supported starting from 13.0 (they might update the error message soon).