From the docs for IAudioClient::Initialize it appears that in exclusive mode the API will change the endpoint device's format (which sounds like what I want). Whereas shared mode, will do resampling of the endpoint's current format (which I don't want).

AUDCLNT_E_UNSUPPORTED_FORMAT

The audio engine (shared mode) or audio endpoint device (exclusive mode) does not support the specified format.