Next.js uses specific extensions for it to work. Like:
If you use other extensions, it won't work.
So, your best answer is to use above extensions and write your code using jsx.
const page = () => ( <div> <p>My html</p> </div> )