I'm not sure this is the best solution, but maybe something like this could work?
units(df$volume) <- "mmᶾ"
Or, alternatively,
units(df$volume) <- "mmᶟ"
These special characters are taken from https://graphemica.com/%E1%B6%BE and https://graphemica.com/%E1%B5%8C