In case anyone else ends up here, add the following to your AJAX call:
xhrFields: { responseType: "arraybuffer" }, dataType: "binary",