Private endpoints are meant for internal use and not public. That is the purpose of bastion you connect first to bastian and then to the private endpoint.

If you want to connect to a private endpoint resource from your PC you need a VPN (p2s or s2s).

Now following the documentation, if you created a virtual machine, and the private endpoint is in the same VNET, there must be also created a private DNS zone, to be able to resolve the DNS.