fd.set(
    "session",
    JSON.stringify({
      type: "realtime",
      model: "gpt-realtime",
      audio: {
        output: {
          voice: "marin",
        },
      },
    })
  )

Documentation was wrong - this fixes it