I didn't see anyone else post this answer so I wrote this solution.

If you wanna stay in server components and don't wanna use any hooks. You can achieve this by passing relative pathnames to Next/Link Component.

<Link href={"../"} >Go Back</Link>