Only selecting a Field has the side-effect of the page scrolling. If you don't want this, then you need to navigate back to the initial starting point. To navigate back, use Range.Select(), but if you are in a (modern) comment, use Comment.Edit().

I've created a solution for this, it can be found here: https://stackoverflow.com/a/77273213/77273213