Okay, figured out this behavior is more so emerging from drei's <Merged/>
Helper component and how it forwards the mesh references. Replacing my previous IInstanceContext
Interface with
type ContextType = Record<string, React.ForwardRefExoticComponent<JSX.IntrinsicElements['mesh']>>;
Made typescript happy in my case.