I have tested the slave with this Modbus Scanner: https://store.chipkin.com/products/tools/cas-modbus-scanner
With an hour of observation I was able replicate the behaviour, altough it occours, that it's much less frequent with the scanner, which lead me to blame the modbus library first.
I guess thats it for this question. Thanks to everyone!