In my case the default database name which was created is 'postgres'. So with psql -d postgres I was able to connect to my server.