I was trying to make a similar "transparent" window to experiment with Avalonia.

After a few hours of digging, I found that...

ExtendClientAreaToDecorationsHint="True"

...seemed to be the culprit in my case.

Try to set the value to "False" - the border and shadows should disappear.