The best way I found to do this is use the "FORMAT" function in DAX and make a custom date format in the function.

For Example (Create a New Calculated Column)

FORMAT('Date', "DD-MMM-YY")

I am not sure why Power Bi is behaving the way it is, throwing errors when trying to change between hierarchy and standard format, but this is a good workaround.