No, the problem is exactly that now in framework mode you no longer have index.html file.
Instead you need to create a root.tsx file with Layout which automatically generates inline scripts, through the <Script /> component.
Check it out
https://reactrouter.com/upgrading/router-provider#4-add-the-root-entry-point