In my case the count remains 3,957 if I select all events, an event that had 2 attendees, or an event that had 1,734 attendees.

You need to exclude the "Event ID:" using ALLEXCEPT() maybe!, If you would share a sample of your data, may be I could try writing some DAX for it.