This uses standard HTML/JavaScript confirmation and works with Turbo disabled.

   <%= form_with(url: cancel_mergeables_path, 
                  data: { turbo: false }, 
                  html: { onsubmit: "return confirm('#{t('mergeable.cancel_confirm')}')" }) do |form| %>