There is now a clear_button plugin in selectizeInput.

shiny::selectizeInput(
    ...,
    options = list(
      plugins = list("remove_button", "clear_button")
    )
 )