The short answer then is: no, the backing memory being pinned or unpinned doesn't matter for unsafeFreeze or unsafeThaw usage patterns.
unsafeFreeze
unsafeThaw