I was able to resolve this by using FVM (Flutter Version Manager).
After installing FVM, run
fvm use x.x.x # eg, 3.19.0
Then
fvm dart run build_runner build
And hopefully your issue will be resolved.
In general FVM has resulted in way less headaches working with Flutter.