It have to help you: https://reflex.dev/docs/datatable-tutorial/add-styling/

theme = {
...
 "bgHeader": "blue",
...
}

rx.data_editor(
   data=...
   theme=theme,
)