is it possible to directly set the background color of the window in a .NET MAUI app for Windows?

No, this color from the window of the current Application. There are no properties or methods to change it.

You can validate it by changing the default app mode to dark like following screenshot. When you start your application, you can see the background will be change to dark when the page loads