Okey after some trail and error I found something, When i use toRefs(testValue).houseNumber it seems to work.
But still I have no idea why this is working, how this is working underwater and if this hits the performance.