Switching to pdflatex was not sufficient. Apparently, the key is a switch called mathspec, so for me the winning combination was:

format:
  beamer:
   theme: CambridgeUS
   latex_engine: pdflatex
   mathspec: true