Normalization is a very good practise, and RTK Query doesn't have it just because they could not implement it in a good way, same as other cool things like infinite scrolling pagination.
But there is a better lib for working with fetching and caching that supports both of that - react-redux-cache, and is not over engineered - its API is very simple.