I think I may have the answer. My KQL that triggers the alert includes

AppPageViews
| where ClientType == 'Browser'
| where TimeGenerated between (now(-30d) .. now())
| summarize count_sum = sum(ItemCount)

When this returns a zero I know that the site is no longer needed.