I recently did it for my libraries, so I can tell you this: The latest Skiasharp package is still not using the right version of HarfBuzz, probably to maintain backward compatibility.
The fix? It's easy, just add the following package reference (This is temporary, and you might have to remove it in the future based on changes to the Skiasharp package)
<PackageReference Include="SkiaSharp.HarfBuzz" Version="3.119.0" />