It looks like designs live forever; they continue to exist even after their parent issue is deleted or the project to which they belong is destroyed.

What you probably want to do is archive the design file which will prevent it from showing in the GitLab GUI.
https://docs.gitlab.com/user/project/issues/design_management/#archive-a-design