Could you resolve it already? I'm working on the same topic. My workaround is to place an invisible around the object to get a raycaster:
<Splat renderOrder={renderOrder} src={'./path/to/my.splat'} />
<RigidBody type="fixed">
<mesh
renderOrder={renderOrder+1}
ref={meshRef}
onClick={onMachineClick}
onPointerOver={handlePointerOver}
onPointerOut={handlePointerOut}
name="my_splat"
position={[0, 0, 0]}
material={transparentMaterial}>
<boxGeometry args={[3, 2, 1.5]} />
</mesh>
{hovered && (
<Html
position={[0.5, 0.5, 0]}
center
distanceFactor={8}
style={{ pointerEvents: 'none' }}>
<Label title={'Lasercutter'} content={'Click me!'} />
</Html>
)}
</RigidBody>