To anyone still hitting this problem, it appears to be related to a combination of certain versions of VM, OS and Chrome : https://github.com/openlayers/openlayers/issues/12934

In a nutshell, under these conditions, the browser sends erroneous events where the mousedown event is attributed to the mouse, but the mouseup is attributed to some pen device. As a result, openlayers does not release the drag behaviour.