For server-side .NET apps you should not use GoogleWebAuthorizationBroker (it opens a local browser). The right way is to use a Service Account with a key file. My suggestion is first Create a Service Account in Google Cloud, enable the Drive API, download the JSON key, and share the target Drive folder with that service account email.
Then use GoogleCredential.FromFile("key.json").CreateScoped(DriveService.Scope.Drive) to build your DriveService. This works on any web server without user interaction.