Turns out I needed to add
[HttpPost("itn.{format}"), FormatFilter]
To my endpoint, with this I don't need OutputFormatters.
Also you need to include the .xml extension in your request URL, like /api/shop/itn.xml