I've come to the conclusion that the best way to go about this is:
Setup a "normal" OTel provider in your Go application.
Send OTel to a OTel collector which again exports data through the azure monitor exporter.
It actually works quite well with Sidecar containers in Azure web apps.