This problem can be simply solved by "react-window" library for viewing huge amount of data without any performance issue.
Read about it here - https://github.com/bvaughn/react-window
This solution will effectively solve your problem, if you have all rows of fixed size. You can basically enclose the whole table inside the react-window component.
And here is the guide how to import it to your respective project- https://www.npmjs.com/package/react-window