Try setting the style of the dialog's window to UTILITY, e.g.

       ((Stage)dialog.getDialogPane().getScene().getWindow()).initStyle(StageStyle.UTILITY);