What I did was a simple stupid fix that I didn't knew would ever fix this issue but hey it works so I can't complain. I have found that when adding a .coordinateSpace this fixed the issue in all screens affected by this bug the following code was my fix for this issue.
ScrollView(showIndicators: false) { ContentView() } .coordinateSpace(name: "scrollViewCoordinateSpaceName")
So I hope this can help some people out if you have any more questions feel free to ask happy coding to y'all :)