The solution is to add the Draw-Option stopClick: true

https://openlayers.org/en/latest/apidoc/module-ol_interaction_Draw-Draw.html

this.draw = new ol.interaction.Draw({
    features : features,
    type : "Point",
    stopClick: true // Stop click, singleclick, and doubleclick events from firing during drawing.
});